2024-09-20T20:15:01.754 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-20T20:15:01.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T20:15:01.866 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7912567' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ed8ee0f26ef720e6504cefa8be1a2d0872192de7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 8245 sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 sleep_before_teardown: 0 subset: 3/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ed8ee0f26ef720e6504cefa8be1a2d0872192de7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ed8ee0f26ef720e6504cefa8be1a2d0872192de7 targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0WZ87tzrBXLRXhjU66VQ7bzGt8XYXzv1vdjsPvb/K+8XyVzgmv+DXr2+zuUBw0M5jbfMJ7eb23nWOxxZitccI= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRVLRuqwNfROdj5LGz8me/CuxOgkzeKd8xbxDS1TJUqNfoupYNFr/YqlnfWQoVDCpIl2X/Bowl6wZojVlnQ76k= smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPf4H0Ogwo97VFOYLlUdqX2F13gQ1BQMPXtjEzXRxbXeTPRG1cHQWZY+mElLxNDHVj/WTXo69F7MEK0cZPELN4E= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZInyGv8pz68ABUmDV1uMheqsGKhQU3IDBAZq6d4invMTHzdZeJqSVgruyudeN47ff6Qy+vrzs4MHnyk4NzWaw= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-19_21:32:06 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-20T20:15:01.866 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ed8ee0f26ef720e6504cefa8be1a2d0872192de7/qa; will attempt to use it 2024-09-20T20:15:01.867 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ed8ee0f26ef720e6504cefa8be1a2d0872192de7/qa/tasks 2024-09-20T20:15:01.867 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-20T20:15:01.868 INFO:teuthology.task.internal:Checking packages... 2024-09-20T20:15:01.890 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9e2ac70bb7aea67d34f0d50002344abbe7803736' 2024-09-20T20:15:01.890 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T20:15:01.891 INFO:teuthology.packaging:ref: None 2024-09-20T20:15:01.891 INFO:teuthology.packaging:tag: None 2024-09-20T20:15:01.891 INFO:teuthology.packaging:branch: squid 2024-09-20T20:15:01.891 INFO:teuthology.packaging:sha1: 9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:15:01.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-20T20:15:02.122 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:15:02.124 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-20T20:15:02.130 INFO:teuthology.task.internal:no buildpackages task found 2024-09-20T20:15:02.130 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-20T20:15:02.134 INFO:teuthology.task.internal:Saving configuration 2024-09-20T20:15:02.146 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-20T20:15:02.152 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-20T20:15:02.174 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 20:08:26.989531', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINTw9ISP8nQxv4VC9LgGW5KsYnBY74ehbcWqtIb4GICr'} 2024-09-20T20:15:02.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 20:08:26.988016', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIxgJRcfcs3poBNbKiWgw/6tuSGEOfmRluPS4x9fv/nw'} 2024-09-20T20:15:02.223 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 20:08:26.990772', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO0DLVdQhQDcHhgfBOItq2NkkmbOnBg2wqxLo8KpQWIH'} 2024-09-20T20:15:02.249 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 20:08:26.992029', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL0cx6ne31v7zaAr64Z1RGs9ss8O+8OtNZGlfTUCOdWU'} 2024-09-20T20:15:02.250 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-20T20:15:02.255 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-20T20:15:02.255 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['osd.0'] 2024-09-20T20:15:02.255 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['osd.1'] 2024-09-20T20:15:02.255 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['osd.2'] 2024-09-20T20:15:02.255 INFO:teuthology.run_tasks:Running task console_log... 2024-09-20T20:15:02.366 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8e37363490>, signals=[15]) 2024-09-20T20:15:02.366 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-20T20:15:02.375 INFO:teuthology.task.internal:Opening connections... 2024-09-20T20:15:02.375 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-20T20:15:02.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:15:02.457 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:15:02.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:15:02.536 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-09-20T20:15:02.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:15:02.616 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-09-20T20:15:02.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:15:02.695 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-20T20:15:02.701 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-20T20:15:02.706 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-20T20:15:02.706 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-20T20:15:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T20:15:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2024-09-20T20:15:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2024-09-20T20:15:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T20:15:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2024-09-20T20:15:02.754 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2024-09-20T20:15:02.754 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2024-09-20T20:15:02.754 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T20:15:02.754 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T20:15:02.754 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T20:15:02.754 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T20:15:02.754 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2024-09-20T20:15:02.755 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-20T20:15:02.782 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-09-20T20:15:02.787 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-09-20T20:15:02.788 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-09-20T20:15:02.835 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="22.04" 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=jammy 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T20:15:02.836 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=jammy 2024-09-20T20:15:02.837 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-09-20T20:15:02.865 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-09-20T20:15:02.871 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-09-20T20:15:02.871 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-09-20T20:15:02.919 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T20:15:02.919 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2024-09-20T20:15:02.919 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="22.04" 2024-09-20T20:15:02.919 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T20:15:02.919 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=jammy 2024-09-20T20:15:02.919 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2024-09-20T20:15:02.920 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2024-09-20T20:15:02.920 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T20:15:02.920 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T20:15:02.920 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T20:15:02.920 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T20:15:02.920 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=jammy 2024-09-20T20:15:02.920 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-09-20T20:15:02.940 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-09-20T20:15:02.946 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-09-20T20:15:02.946 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-09-20T20:15:02.994 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-20T20:15:02.994 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2024-09-20T20:15:02.994 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2024-09-20T20:15:02.994 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-20T20:15:02.994 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2024-09-20T20:15:02.995 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2024-09-20T20:15:02.995 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2024-09-20T20:15:02.995 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-20T20:15:02.995 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-20T20:15:02.995 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-20T20:15:02.995 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-20T20:15:02.995 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2024-09-20T20:15:02.995 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-09-20T20:15:03.023 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-20T20:15:03.032 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-20T20:15:03.036 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-20T20:15:03.036 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-20T20:15:03.038 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-09-20T20:15:03.041 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-09-20T20:15:03.043 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-09-20T20:15:03.048 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-20T20:15:03.053 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-20T20:15:03.053 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-20T20:15:03.086 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-09-20T20:15:03.089 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-09-20T20:15:03.091 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-09-20T20:15:03.158 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-20T20:15:03.260 INFO:teuthology.run_tasks:Running task kernel... 2024-09-20T20:15:03.276 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-20T20:15:03.277 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-20T20:15:03.277 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T20:15:03.277 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T20:15:03.278 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T20:15:03.278 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T20:15:03.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:15:03.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:15:03.284 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-20T20:15:03.284 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-20T20:15:03.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:15:03.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:15:03.286 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-20T20:15:03.286 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-20T20:15:03.328 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-56-generic 2024-09-20T20:15:03.328 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.15.0-56-generic 2024-09-20T20:15:03.328 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-20T20:15:03.330 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-56-generic 2024-09-20T20:15:03.330 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.15.0-56-generic 2024-09-20T20:15:03.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-20T20:15:03.332 INFO:teuthology.orchestra.run.smithi090.stdout:5.15.0-56-generic 2024-09-20T20:15:03.332 INFO:teuthology.task.kernel:Running kernel on smithi090: 5.15.0-56-generic 2024-09-20T20:15:03.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get clean 2024-09-20T20:15:03.336 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-56-generic 2024-09-20T20:15:03.336 INFO:teuthology.task.kernel:Running kernel on smithi187: 5.15.0-56-generic 2024-09-20T20:15:03.336 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-09-20T20:15:03.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-20T20:15:03.462 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2024-09-20T20:15:03.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-20T20:15:03.482 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-20T20:15:03.613 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T20:15:03.613 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T20:15:03.642 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:15:03.642 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T20:15:03.642 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T20:15:03.710 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T20:15:03.718 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:15:03.720 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:15:03.789 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:15:03.791 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-20T20:15:03.802 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T20:15:03.804 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T20:15:03.821 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T20:15:03.840 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-20T20:15:03.843 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T20:15:03.861 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T20:15:03.912 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T20:15:03.922 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T20:15:03.926 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T20:15:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T20:15:03.928 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T20:15:03.934 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T20:15:03.934 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T20:15:03.948 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T20:15:03.948 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T20:15:03.949 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T20:15:03.951 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T20:15:03.951 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T20:15:03.952 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T20:15:03.952 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T20:15:03.957 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T20:15:03.962 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T20:15:03.964 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T20:15:03.964 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T20:15:03.964 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T20:15:03.971 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T20:15:03.972 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T20:15:03.972 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T20:15:03.975 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T20:15:03.975 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T20:15:03.976 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T20:15:03.976 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T20:15:03.981 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T20:15:03.981 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T20:15:03.984 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T20:15:03.986 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T20:15:03.986 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T20:15:03.987 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T20:15:03.993 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T20:15:03.994 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T20:15:04.000 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T20:15:04.004 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T20:15:04.004 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T20:15:04.005 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T20:15:04.005 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T20:15:04.017 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T20:15:04.021 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T20:15:04.044 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T20:15:04.044 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T20:15:04.050 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T20:15:04.050 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T20:15:04.051 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T20:15:04.052 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T20:15:04.052 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T20:15:04.053 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T20:15:04.054 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T20:15:04.067 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T20:15:04.090 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T20:15:04.093 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T20:15:04.097 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T20:15:04.105 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T20:15:04.137 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T20:15:04.154 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T20:15:04.158 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T20:15:04.170 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T20:15:04.174 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T20:15:04.177 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T20:15:04.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T20:15:04.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T20:15:04.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T20:15:04.179 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T20:15:04.181 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T20:15:04.181 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T20:15:04.192 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T20:15:04.196 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-20T20:15:04.209 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T20:15:04.209 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T20:15:04.209 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T20:15:04.218 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-20T20:15:04.293 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T20:15:04.297 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T20:15:04.335 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-20T20:15:04.512 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-20T20:15:04.612 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T20:15:04.618 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T20:15:04.647 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T20:15:04.652 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T20:15:04.655 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-20T20:15:04.660 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T20:15:04.661 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T20:15:04.667 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T20:15:04.667 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T20:15:04.669 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T20:15:04.687 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-20T20:15:04.690 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-20T20:15:04.699 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-20T20:15:04.700 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-20T20:15:04.703 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-20T20:15:04.704 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-20T20:15:04.733 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T20:15:04.734 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T20:15:04.737 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T20:15:04.748 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T20:15:04.748 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T20:15:04.753 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T20:15:04.754 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T20:15:04.770 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T20:15:04.774 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-20T20:15:04.778 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-20T20:15:04.785 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-20T20:15:04.788 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T20:15:04.800 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T20:15:04.806 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T20:15:04.809 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T20:15:04.810 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T20:15:04.811 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T20:15:04.815 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T20:15:04.815 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T20:15:04.815 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T20:15:04.816 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T20:15:04.843 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-20T20:15:04.843 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-20T20:15:04.844 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-20T20:15:04.854 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-20T20:15:04.854 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-20T20:15:04.856 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T20:15:04.857 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T20:15:04.857 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T20:15:04.859 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T20:15:04.860 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T20:15:04.862 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-20T20:15:04.863 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T20:15:04.864 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T20:15:04.864 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T20:15:04.869 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-20T20:15:04.883 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-20T20:15:04.884 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-20T20:15:04.887 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-20T20:15:04.887 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-20T20:15:04.887 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-20T20:15:04.888 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-20T20:15:04.888 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-20T20:15:04.888 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-20T20:15:04.897 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T20:15:04.898 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T20:15:04.898 INFO:teuthology.orchestra.run.smithi090.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T20:15:04.898 INFO:teuthology.orchestra.run.smithi090.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T20:15:04.899 INFO:teuthology.orchestra.run.smithi090.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T20:15:04.902 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-20T20:15:04.903 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-20T20:15:04.934 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-20T20:15:04.934 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-20T20:15:04.938 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T20:15:04.939 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T20:15:04.939 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T20:15:04.940 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T20:15:04.940 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T20:15:04.945 INFO:teuthology.orchestra.run.smithi090.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T20:15:04.970 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-20T20:15:04.971 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-20T20:15:04.972 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-20T20:15:04.972 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-20T20:15:04.972 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-20T20:15:04.982 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-20T20:15:05.064 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-20T20:15:05.064 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-20T20:15:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 16.3 MB in 2s (7,407 kB/s) 2024-09-20T20:15:10.311 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 16.3 MB in 2s (7,397 kB/s) 2024-09-20T20:15:10.326 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 16.3 MB in 2s (7,565 kB/s) 2024-09-20T20:15:11.019 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 16.3 MB in 3s (5,833 kB/s) 2024-09-20T20:15:11.706 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-20T20:15:11.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:15:11.726 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-20T20:15:11.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:15:11.798 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-20T20:15:11.830 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-20T20:15:11.950 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-20T20:15:11.969 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:15:11.986 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-20T20:15:11.986 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-20T20:15:12.026 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-20T20:15:12.026 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-20T20:15:12.026 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-20T20:15:12.156 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:15:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:15:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:15:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:15:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T20:15:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2024-09-20T20:15:12.157 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:15:12.158 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-20T20:15:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:15:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T20:15:12.159 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T20:15:12.160 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-20T20:15:12.160 INFO:teuthology.orchestra.run.smithi070.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T20:15:12.160 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-20T20:15:12.161 INFO:teuthology.orchestra.run.smithi070.stdout: thermald 2024-09-20T20:15:12.197 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:15:12.197 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:15:12.197 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:15:12.198 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:15:12.198 INFO:teuthology.orchestra.run.smithi079.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T20:15:12.198 INFO:teuthology.orchestra.run.smithi079.stdout: python2.7-minimal 2024-09-20T20:15:12.198 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:15:12.199 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-20T20:15:12.199 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:15:12.199 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T20:15:12.200 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T20:15:12.201 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-20T20:15:12.201 INFO:teuthology.orchestra.run.smithi079.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T20:15:12.201 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-20T20:15:12.201 INFO:teuthology.orchestra.run.smithi079.stdout: thermald 2024-09-20T20:15:12.220 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-20T20:15:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:15:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T20:15:12.221 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T20:15:12.222 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-09-20T20:15:12.223 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T20:15:12.237 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2024-09-20T20:15:12.237 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2024-09-20T20:15:12.250 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-20T20:15:12.250 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:15:12.250 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T20:15:12.251 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T20:15:12.252 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2024-09-20T20:15:12.252 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T20:15:12.402 INFO:teuthology.orchestra.run.smithi070.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:15:12.402 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 113 MB of archives. 2024-09-20T20:15:12.402 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T20:15:12.402 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T20:15:12.412 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:15:12.412 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:15:12.412 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:15:12.412 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:15:12.412 INFO:teuthology.orchestra.run.smithi090.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T20:15:12.413 INFO:teuthology.orchestra.run.smithi090.stdout: python2.7-minimal 2024-09-20T20:15:12.413 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:15:12.414 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2024-09-20T20:15:12.414 INFO:teuthology.orchestra.run.smithi090.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:15:12.414 INFO:teuthology.orchestra.run.smithi090.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T20:15:12.415 INFO:teuthology.orchestra.run.smithi090.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T20:15:12.416 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2024-09-20T20:15:12.416 INFO:teuthology.orchestra.run.smithi090.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T20:15:12.416 INFO:teuthology.orchestra.run.smithi090.stdout:Recommended packages: 2024-09-20T20:15:12.416 INFO:teuthology.orchestra.run.smithi090.stdout: thermald 2024-09-20T20:15:12.431 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:15:12.432 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 113 MB of archives. 2024-09-20T20:15:12.432 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T20:15:12.432 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T20:15:12.511 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2024-09-20T20:15:12.511 INFO:teuthology.orchestra.run.smithi090.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:15:12.511 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T20:15:12.511 INFO:teuthology.orchestra.run.smithi090.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T20:15:12.513 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2024-09-20T20:15:12.513 INFO:teuthology.orchestra.run.smithi090.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T20:15:12.548 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-20T20:15:12.564 INFO:teuthology.orchestra.run.smithi090.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:15:12.565 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 113 MB of archives. 2024-09-20T20:15:12.565 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T20:15:12.565 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T20:15:12.567 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:15:12.625 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-20T20:15:12.836 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-20T20:15:12.837 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-20T20:15:12.998 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T20:15:13.010 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:15:13.010 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:15:13.010 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:15:13.011 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:15:13.011 INFO:teuthology.orchestra.run.smithi187.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-20T20:15:13.011 INFO:teuthology.orchestra.run.smithi187.stdout: python2.7-minimal 2024-09-20T20:15:13.011 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:15:13.012 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-20T20:15:13.012 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:15:13.012 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-20T20:15:13.013 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-20T20:15:13.014 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-20T20:15:13.014 INFO:teuthology.orchestra.run.smithi187.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-20T20:15:13.014 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-09-20T20:15:13.015 INFO:teuthology.orchestra.run.smithi187.stdout: thermald 2024-09-20T20:15:13.058 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-20T20:15:13.058 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-20T20:15:13.059 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-20T20:15:13.059 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-20T20:15:13.060 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2024-09-20T20:15:13.061 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-20T20:15:13.108 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T20:15:13.240 INFO:teuthology.orchestra.run.smithi187.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:15:13.240 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 113 MB of archives. 2024-09-20T20:15:13.240 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-20T20:15:13.240 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-20T20:15:13.794 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T20:15:13.851 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T20:15:13.960 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T20:15:13.961 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T20:15:13.961 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T20:15:14.084 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T20:15:14.106 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T20:15:14.194 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T20:15:14.200 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T20:15:14.557 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 113 MB in 2s (68.7 MB/s) 2024-09-20T20:15:14.673 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-20T20:15:14.740 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T20:15:15.022 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-20T20:15:16.346 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T20:15:16.347 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T20:15:16.347 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T20:15:16.430 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T20:15:16.430 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T20:15:16.431 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T20:15:16.750 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T20:15:16.800 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T20:15:17.205 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-20T20:15:17.206 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-20T20:15:17.206 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-20T20:15:17.216 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 113 MB in 5s (24.8 MB/s) 2024-09-20T20:15:17.398 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T20:15:17.446 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T20:15:17.534 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-20T20:15:17.569 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T20:15:17.602 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T20:15:17.606 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:17.619 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-20T20:15:17.693 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:17.983 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 113 MB in 5s (21.3 MB/s) 2024-09-20T20:15:18.011 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-20T20:15:18.152 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T20:15:18.187 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-20T20:15:19.341 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T20:15:19.345 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:19.412 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:20.182 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T20:15:20.186 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:20.266 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-20T20:15:20.266 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:20.270 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:20.409 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:20.509 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T20:15:20.530 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:20.616 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:21.097 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T20:15:21.117 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:21.155 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:21.606 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T20:15:21.627 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:21.716 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:22.193 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T20:15:22.214 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:22.251 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:22.367 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T20:15:22.388 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:22.480 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:22.801 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-20T20:15:22.822 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:22.898 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:22.946 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T20:15:22.966 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:23.003 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:23.382 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-20T20:15:23.403 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:23.440 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:28.564 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:28.705 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:29.030 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:29.134 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:29.404 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T20:15:29.426 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T20:15:29.470 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:15:29.602 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:29.755 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:30.042 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:30.171 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:30.178 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:30.300 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:30.520 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:30.603 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T20:15:30.625 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T20:15:30.648 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:30.670 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:15:30.700 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:30.820 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:30.968 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T20:15:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T20:15:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:15:31.154 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:31.258 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:31.562 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-20T20:15:31.584 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-20T20:15:31.653 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:15:35.176 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T20:15:35.214 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:35.250 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:36.087 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T20:15:36.124 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:36.162 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:36.979 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T20:15:37.016 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:37.129 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:37.988 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:38.113 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:38.472 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:15:38.593 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:38.719 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T20:15:38.741 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:38.849 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:38.855 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:40.065 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:15:40.161 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:40.181 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:15:40.181 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T20:15:40.181 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:15:40.181 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:40.278 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T20:15:40.334 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:40.407 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:40.688 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-20T20:15:40.725 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-20T20:15:40.763 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:40.964 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:41.106 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:41.481 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:15:41.577 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:41.720 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T20:15:41.772 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:15:41.772 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T20:15:41.772 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:15:41.772 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:41.849 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:41.933 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:42.156 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T20:15:42.278 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T20:15:42.404 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:43.195 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:15:43.195 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T20:15:43.195 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:15:43.195 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:43.335 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T20:15:43.384 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:43.444 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T20:15:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:43.814 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:43.878 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T20:15:43.878 INFO:teuthology.orchestra.run.smithi070.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:43.989 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-20T20:15:44.112 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-20T20:15:44.497 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-20T20:15:44.619 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:44.745 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-20T20:15:44.810 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T20:15:44.874 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:44.911 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T20:15:44.938 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:44.993 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T20:15:44.993 INFO:teuthology.orchestra.run.smithi079.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:45.054 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:46.248 INFO:teuthology.orchestra.run.smithi090.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:15:46.248 INFO:teuthology.orchestra.run.smithi090.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-20T20:15:46.249 INFO:teuthology.orchestra.run.smithi090.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:15:46.249 INFO:teuthology.orchestra.run.smithi090.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:46.414 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:46.572 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:46.643 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T20:15:46.643 INFO:teuthology.orchestra.run.smithi187.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:47.791 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-20T20:15:47.933 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-20T20:15:48.052 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:49.421 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-20T20:15:49.490 INFO:teuthology.orchestra.run.smithi090.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-20T20:15:49.490 INFO:teuthology.orchestra.run.smithi090.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:57.815 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T20:15:57.815 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub' 2024-09-20T20:15:57.829 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:15:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:Generating grub configuration file ... 2024-09-20T20:15:58.134 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:15:58.156 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:58.444 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:15:58.450 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:15:58.516 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:15:58.521 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:15:58.692 INFO:teuthology.orchestra.run.smithi070.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:15:58.692 INFO:teuthology.orchestra.run.smithi070.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:15:58.692 INFO:teuthology.orchestra.run.smithi070.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:15:58.740 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-09-20T20:15:58.880 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T20:15:58.880 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub' 2024-09-20T20:15:58.897 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:15:58.909 INFO:teuthology.orchestra.run.smithi079.stdout:Generating grub configuration file ... 2024-09-20T20:15:59.164 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:15:59.192 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-20T20:15:59.193 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:15:59.207 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.122.122 2024-09-20T20:15:59.208 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:15:59.209 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:15:59.209 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-20T20:15:59.209 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-20T20:15:59.209 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:15:59.209 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-20T20:15:59.209 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T20:15:59.209 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T20:15:59.209 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T20:15:59.209 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-20T20:15:59.209 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T20:15:59.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-20T20:15:59.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-20T20:15:59.467 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:15:59.473 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:15:59.535 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:15:59.540 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:15:59.566 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:15:59.575 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:15:59.592 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:15:59.689 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:15:59.694 INFO:teuthology.orchestra.run.smithi079.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:15:59.694 INFO:teuthology.orchestra.run.smithi079.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:15:59.694 INFO:teuthology.orchestra.run.smithi079.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:15:59.748 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-09-20T20:16:00.183 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-20T20:16:00.201 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-20T20:16:00.201 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-20T20:16:00.201 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-20T20:16:00.201 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-20T20:16:00.201 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-20T20:16:00.201 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.122.122 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:16:00.202 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-20T20:16:00.202 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T20:16:00.202 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T20:16:00.202 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T20:16:00.203 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-20T20:16:00.203 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T20:16:00.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-20T20:16:00.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-20T20:16:00.457 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:16:00.580 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:16:00.663 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:16:00.745 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:16:00.794 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T20:16:00.794 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub' 2024-09-20T20:16:00.819 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:16:00.840 INFO:teuthology.orchestra.run.smithi187.stdout:Generating grub configuration file ... 2024-09-20T20:16:00.939 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-20T20:16:00.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:16:01.022 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-20T20:16:01.212 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:16:01.234 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-20T20:16:01.234 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-20T20:16:01.236 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:16:01.423 INFO:teuthology.orchestra.run.smithi070.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T20:16:01.423 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:16:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:16:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:16:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:16:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:16:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:16:01.424 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:16:01.462 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:16:01.464 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-20T20:16:01.479 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.122.122 2024-09-20T20:16:01.480 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:16:01.480 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:16:01.480 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-20T20:16:01.480 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-20T20:16:01.480 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:16:01.480 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-20T20:16:01.480 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-20T20:16:01.523 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.ZzZ2BdSThY 2024-09-20T20:16:01.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZzZ2BdSThY 2024-09-20T20:16:01.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.ZzZ2BdSThY 2024-09-20T20:16:01.667 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:16:01.674 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:16:01.697 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.ZzZ2BdSThY is 10KB 2024-09-20T20:16:01.709 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.ZzZ2BdSThY 2024-09-20T20:16:01.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T20:16:01.745 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:16:01.751 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:16:01.771 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:16:01.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T20:16:01.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T20:16:01.834 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T20:16:01.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-grub 2024-09-20T20:16:01.913 INFO:teuthology.orchestra.run.smithi187.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:16:01.913 INFO:teuthology.orchestra.run.smithi187.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:16:01.913 INFO:teuthology.orchestra.run.smithi187.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:16:01.941 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-20T20:16:01.957 INFO:teuthology.orchestra.run.smithi187.stdout:done 2024-09-20T20:16:01.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:16:02.021 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-20T20:16:02.234 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-20T20:16:02.235 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-20T20:16:02.424 INFO:teuthology.orchestra.run.smithi079.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T20:16:02.424 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:16:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:16:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:16:02.424 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:16:02.425 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:16:02.425 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:16:02.425 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:16:02.467 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:16:02.469 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-20T20:16:02.484 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-20T20:16:02.484 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-20T20:16:02.484 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-20T20:16:02.484 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-20T20:16:02.484 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-20T20:16:02.484 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.122.122 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:16:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-20T20:16:02.485 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-20T20:16:02.494 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-09-20T20:16:02.516 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.122.122 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-09-20T20:16:02.517 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:16:02.518 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-09-20T20:16:02.518 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T20:16:02.518 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T20:16:02.518 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T20:16:02.518 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-20T20:16:02.518 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T20:16:02.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-09-20T20:16:02.534 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.CwYPjFBL6A 2024-09-20T20:16:02.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub/grub.cfg /tmp/tmp.CwYPjFBL6A 2024-09-20T20:16:02.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.CwYPjFBL6A 2024-09-20T20:16:02.687 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-20T20:16:02.724 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.CwYPjFBL6A is 10KB 2024-09-20T20:16:02.736 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.CwYPjFBL6A 2024-09-20T20:16:02.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T20:16:02.794 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:16:02.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T20:16:02.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T20:16:02.819 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:16:02.828 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:16:02.845 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:16:02.862 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T20:16:02.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo update-grub 2024-09-20T20:16:02.939 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:16:03.108 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2024-09-20T20:16:03.109 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:16:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-20T20:16:03.303 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:16:03.310 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:16:03.546 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:16:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:16:03.591 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:16:03.595 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:16:03.725 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:16:03.725 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:16:03.725 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:16:03.735 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-20T20:16:03.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-20T20:16:04.072 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2024-09-20T20:16:04.073 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:16:04.078 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-09-20T20:16:04.258 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:16:04.265 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:16:04.295 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-20T20:16:04.313 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:16:04.368 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-20T20:16:04.493 INFO:teuthology.orchestra.run.smithi090.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-20T20:16:04.493 INFO:teuthology.orchestra.run.smithi090.stdout:Sourcing file `/etc/default/grub' 2024-09-20T20:16:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:16:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:16:04.514 INFO:teuthology.orchestra.run.smithi090.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:16:04.544 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:16:04.548 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:16:04.549 INFO:teuthology.orchestra.run.smithi090.stdout:Generating grub configuration file ... 2024-09-20T20:16:04.557 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-20T20:16:04.558 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-20T20:16:04.692 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:16:04.692 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:16:04.692 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:16:04.706 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-09-20T20:16:04.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-09-20T20:16:04.730 INFO:teuthology.orchestra.run.smithi187.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T20:16:04.730 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:16:04.730 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:16:04.730 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:16:04.730 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:16:04.731 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:16:04.731 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:16:04.731 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:16:04.771 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:16:04.773 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.122.122 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:16:04.786 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:16:04.787 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-09-20T20:16:04.787 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-09-20T20:16:04.787 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:16:04.787 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-09-20T20:16:04.787 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-20T20:16:04.833 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.i9jghTbRzi 2024-09-20T20:16:04.834 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub/grub.cfg /tmp/tmp.i9jghTbRzi 2024-09-20T20:16:04.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.i9jghTbRzi 2024-09-20T20:16:04.912 INFO:teuthology.orchestra.run.smithi090.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:16:04.948 INFO:teuthology.orchestra.run.smithi090.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:16:05.009 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.i9jghTbRzi is 10KB 2024-09-20T20:16:05.021 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.i9jghTbRzi 2024-09-20T20:16:05.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T20:16:05.081 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:16:05.081 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T20:16:05.081 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T20:16:05.161 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T20:16:05.161 DEBUG:teuthology.orchestra.run.smithi187:> sudo update-grub 2024-09-20T20:16:05.375 INFO:teuthology.orchestra.run.smithi090.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:16:05.382 INFO:teuthology.orchestra.run.smithi090.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:16:05.458 INFO:teuthology.orchestra.run.smithi090.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:16:05.463 INFO:teuthology.orchestra.run.smithi090.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:16:05.737 INFO:teuthology.orchestra.run.smithi090.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:16:05.737 INFO:teuthology.orchestra.run.smithi090.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:16:05.737 INFO:teuthology.orchestra.run.smithi090.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:16:05.846 INFO:teuthology.orchestra.run.smithi090.stdout:done 2024-09-20T20:16:06.355 DEBUG:teuthology.orchestra.run.smithi090:> dpkg -s linux-image-generic 2024-09-20T20:16:06.379 INFO:teuthology.orchestra.run.smithi090.stdout:Package: linux-image-generic 2024-09-20T20:16:06.379 INFO:teuthology.orchestra.run.smithi090.stdout:Status: install ok installed 2024-09-20T20:16:06.379 INFO:teuthology.orchestra.run.smithi090.stdout:Priority: optional 2024-09-20T20:16:06.379 INFO:teuthology.orchestra.run.smithi090.stdout:Section: kernel 2024-09-20T20:16:06.379 INFO:teuthology.orchestra.run.smithi090.stdout:Installed-Size: 21 2024-09-20T20:16:06.379 INFO:teuthology.orchestra.run.smithi090.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: amd64 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout:Source: linux-meta 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout:Version: 5.15.0.122.122 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout:Recommends: thermald 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout:Description: Generic Linux kernel image 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:16:06.380 INFO:teuthology.orchestra.run.smithi090.stdout: available. 2024-09-20T20:16:06.380 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-20T20:16:06.380 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T20:16:06.380 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T20:16:06.381 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-20T20:16:06.381 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi090.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T20:16:06.381 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get clean 2024-09-20T20:16:06.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2024-09-20T20:16:06.556 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2024-09-20T20:16:06.567 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:16:06.577 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2024-09-20T20:16:06.639 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:16:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:16:06.834 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:16:06.841 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:16:06.842 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:16:06.923 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:16:07.155 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:16:07.160 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:16:07.200 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:16:07.205 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:16:07.364 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:16:07.364 INFO:teuthology.orchestra.run.smithi187.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:16:07.364 INFO:teuthology.orchestra.run.smithi187.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:16:07.375 INFO:teuthology.orchestra.run.smithi187.stderr:done 2024-09-20T20:16:07.378 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2024-09-20T20:16:08.145 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-20T20:16:08.165 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-20T20:16:08.232 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-20T20:16:08.452 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2024-09-20T20:16:08.453 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2024-09-20T20:16:08.641 INFO:teuthology.orchestra.run.smithi090.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-20T20:16:08.641 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:16:08.641 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:16:08.641 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:16:08.641 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:16:08.642 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:16:08.642 INFO:teuthology.orchestra.run.smithi090.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:16:08.642 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:16:08.685 INFO:teuthology.orchestra.run.smithi090.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-20T20:16:08.687 DEBUG:teuthology.orchestra.run.smithi090:> dpkg -s linux-image-generic 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Package: linux-image-generic 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Status: install ok installed 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Priority: optional 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Section: kernel 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Installed-Size: 21 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Maintainer: Ubuntu Kernel Team 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: amd64 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Source: linux-meta 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Version: 5.15.0.122.122 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-20T20:16:08.700 INFO:teuthology.orchestra.run.smithi090.stdout:Recommends: thermald 2024-09-20T20:16:08.701 INFO:teuthology.orchestra.run.smithi090.stdout:Description: Generic Linux kernel image 2024-09-20T20:16:08.701 INFO:teuthology.orchestra.run.smithi090.stdout: This package will always depend on the latest generic kernel image 2024-09-20T20:16:08.701 INFO:teuthology.orchestra.run.smithi090.stdout: available. 2024-09-20T20:16:08.701 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-09-20T20:16:08.750 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.S5cgdNYusb 2024-09-20T20:16:08.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo cp /boot/grub/grub.cfg /tmp/tmp.S5cgdNYusb 2024-09-20T20:16:08.806 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.S5cgdNYusb 2024-09-20T20:16:08.939 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.S5cgdNYusb is 10KB 2024-09-20T20:16:08.951 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.S5cgdNYusb 2024-09-20T20:16:08.957 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-20T20:16:09.011 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:16:09.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-20T20:16:09.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-20T20:16:09.108 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-20T20:16:09.108 DEBUG:teuthology.orchestra.run.smithi090:> sudo update-grub 2024-09-20T20:16:11.034 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub' 2024-09-20T20:16:11.039 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-20T20:16:11.056 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2024-09-20T20:16:11.312 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-20T20:16:11.319 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-20T20:16:11.773 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-20T20:16:11.778 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-20T20:16:11.824 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-20T20:16:11.829 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-20T20:16:11.960 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-20T20:16:11.961 INFO:teuthology.orchestra.run.smithi090.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-20T20:16:11.961 INFO:teuthology.orchestra.run.smithi090.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-20T20:16:11.979 INFO:teuthology.orchestra.run.smithi090.stderr:done 2024-09-20T20:16:11.981 DEBUG:teuthology.orchestra.run.smithi090:> sudo shutdown -r now 2024-09-20T20:16:33.770 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-20T20:16:33.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-20T20:16:33.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:16:34.722 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-20T20:16:34.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:16:34.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:16:37.381 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-20T20:16:37.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-20T20:16:37.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:16:41.986 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-20T20:16:41.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-20T20:16:41.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:16:52.207 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-20T20:16:53.231 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-20T20:16:55.795 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-20T20:17:00.403 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-20T20:17:01.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-20T20:17:01.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:02.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:17:02.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:04.271 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-20T20:17:04.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-20T20:17:04.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:05.299 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-20T20:17:07.859 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-20T20:17:09.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-20T20:17:09.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:12.463 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-20T20:17:16.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-20T20:17:16.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:17.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:17:17.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:19.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-20T20:17:19.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:24.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-20T20:17:24.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:27.535 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-20T20:17:35.731 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-20T20:17:38.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-20T20:17:42.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-20T20:17:42.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:48.570 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-20T20:17:49.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-20T20:17:49.623 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-20T20:17:49.624 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-20T20:17:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-122-generic 2024-09-20T20:17:49.628 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T20:17:49.628 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T20:17:49.628 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T20:17:50.630 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-20T20:17:50.630 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T20:17:50.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:17:50.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:50.816 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-20T20:17:50.816 DEBUG:teuthology.parallel:result is None 2024-09-20T20:17:51.096 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-20T20:17:51.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:17:51.659 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-122-generic"... 2024-09-20T20:17:51.659 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-20T20:17:51.705 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-122-generic 2024-09-20T20:17:51.705 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T20:17:51.705 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T20:17:51.705 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T20:17:52.707 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-20T20:17:52.707 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T20:17:53.036 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-09-20T20:17:53.063 DEBUG:teuthology.parallel:result is None 2024-09-20T20:17:53.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-20T20:17:53.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:17:53.667 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-20T20:17:54.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-20T20:17:54.679 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-122-generic"... 2024-09-20T20:17:54.679 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-20T20:17:54.683 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-122-generic 2024-09-20T20:17:54.683 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T20:17:54.683 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T20:17:54.683 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T20:17:55.684 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-20T20:17:55.684 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T20:17:55.805 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2024-09-20T20:17:55.837 DEBUG:teuthology.parallel:result is None 2024-09-20T20:18:42.540 DEBUG:teuthology.orchestra.remote:timed out 2024-09-20T20:19:00.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-20T20:19:00.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:19:00.777 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-20T20:19:01.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-20T20:19:01.342 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-122-generic"... 2024-09-20T20:19:01.342 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-20T20:19:01.386 INFO:teuthology.orchestra.run.smithi090.stdout:5.15.0-122-generic 2024-09-20T20:19:01.386 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-20T20:19:01.386 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T20:19:01.386 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-20T20:19:02.387 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-20T20:19:02.387 DEBUG:teuthology.orchestra.run.smithi090:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T20:19:02.488 INFO:teuthology.orchestra.run.smithi090.stdout:ttyS1 2024-09-20T20:19:02.521 DEBUG:teuthology.parallel:result is None 2024-09-20T20:19:02.521 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-20T20:19:02.529 INFO:teuthology.task.internal:Creating test directory... 2024-09-20T20:19:02.529 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T20:19:02.532 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T20:19:02.534 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T20:19:02.537 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T20:19:02.544 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-20T20:19:02.601 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-20T20:19:02.609 INFO:teuthology.task.internal:Creating archive directory... 2024-09-20T20:19:02.609 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T20:19:02.611 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T20:19:02.614 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T20:19:02.616 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T20:19:02.707 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-20T20:19:02.714 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-20T20:19:02.715 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T20:19:02.717 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T20:19:02.720 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T20:19:02.722 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T20:19:02.735 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:19:02.741 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:19:02.742 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:19:02.743 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:19:02.745 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:19:02.750 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:19:02.750 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:19:02.752 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T20:19:02.754 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-20T20:19:02.761 INFO:teuthology.task.internal:Configuring sudo... 2024-09-20T20:19:02.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T20:19:02.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T20:19:02.796 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T20:19:02.798 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T20:19:02.812 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-20T20:19:02.821 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-20T20:19:02.821 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T20:19:02.846 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T20:19:02.852 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T20:19:02.855 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T20:19:02.861 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T20:19:02.897 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T20:19:02.945 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:19:02.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T20:19:03.030 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T20:19:03.036 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T20:19:03.084 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:19:03.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T20:19:03.155 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T20:19:03.162 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T20:19:03.211 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:19:03.211 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T20:19:03.285 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T20:19:03.290 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T20:19:03.339 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:19:03.339 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T20:19:03.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-20T20:19:03.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-09-20T20:19:03.406 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-09-20T20:19:03.408 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-09-20T20:19:03.471 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-20T20:19:03.479 INFO:teuthology.task.internal:Starting timer... 2024-09-20T20:19:03.479 INFO:teuthology.run_tasks:Running task pcp... 2024-09-20T20:19:03.510 INFO:teuthology.run_tasks:Running task selinux... 2024-09-20T20:19:03.523 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2024-09-20T20:19:03.523 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2024-09-20T20:19:03.523 DEBUG:teuthology.task.selinux:Excluding smithi090: OS 'ubuntu' does not support SELinux 2024-09-20T20:19:03.523 DEBUG:teuthology.task.selinux:Excluding smithi187: OS 'ubuntu' does not support SELinux 2024-09-20T20:19:03.523 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-20T20:19:03.523 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-20T20:19:03.523 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-20T20:19:03.523 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-20T20:19:03.531 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-20T20:19:03.541 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-20T20:19:03.542 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi079.front.sepia.ceph.com,smithi090.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-20T20:26:53.891 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-09-20T20:26:53.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-20T20:26:53.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:26:53.971 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-20T20:26:54.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-20T20:26:54.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:26:54.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:26:54.131 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-20T20:26:54.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:26:54.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-20T20:26:54.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:26:54.295 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-20T20:26:54.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-20T20:26:54.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-20T20:26:54.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:26:54.450 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-20T20:26:54.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-20T20:26:54.527 INFO:teuthology.run_tasks:Running task clock... 2024-09-20T20:26:54.537 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-20T20:26:54.537 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T20:26:54.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:26:54.540 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T20:26:54.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:26:54.542 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T20:26:54.542 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:26:54.544 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T20:26:54.545 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:26:54.566 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T20:26:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Command line: ntpd -gq 2024-09-20T20:26:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: ---------------------------------------------------- 2024-09-20T20:26:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T20:26:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T20:26:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: corporation. Support and training for ntp-4 are 2024-09-20T20:26:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: available at https://www.nwtime.org/support 2024-09-20T20:26:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: ---------------------------------------------------- 2024-09-20T20:26:54.567 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: proto: precision = 0.060 usec (-24) 2024-09-20T20:26:54.568 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: basedate set to 2022-02-04 2024-09-20T20:26:54.568 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: gps base set to 2022-02-06 (week 2196) 2024-09-20T20:26:54.568 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:26:54.568 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:26:54.568 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:26:54.568 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:26:54.569 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T20:26:54.569 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T20:26:54.570 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T20:26:54.570 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2024-09-20T20:26:54.570 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Listen normally on 4 lo [::1]:123 2024-09-20T20:26:54.570 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2024-09-20T20:26:54.570 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:26:54 ntpd[18469]: Listening on routing socket on fd #22 for interface updates 2024-09-20T20:26:54.570 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T20:26:54.570 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Command line: ntpd -gq 2024-09-20T20:26:54.570 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: ---------------------------------------------------- 2024-09-20T20:26:54.571 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T20:26:54.571 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T20:26:54.571 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: corporation. Support and training for ntp-4 are 2024-09-20T20:26:54.571 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: available at https://www.nwtime.org/support 2024-09-20T20:26:54.571 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: ---------------------------------------------------- 2024-09-20T20:26:54.572 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: proto: precision = 0.087 usec (-23) 2024-09-20T20:26:54.572 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: basedate set to 2022-02-04 2024-09-20T20:26:54.572 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: gps base set to 2022-02-06 (week 2196) 2024-09-20T20:26:54.572 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:26:54.572 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:26:54.572 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:26:54.573 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:26:54.573 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T20:26:54.574 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T20:26:54.574 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T20:26:54.574 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2024-09-20T20:26:54.574 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Listen normally on 4 lo [::1]:123 2024-09-20T20:26:54.574 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2024-09-20T20:26:54.574 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:26:54 ntpd[18471]: Listening on routing socket on fd #22 for interface updates 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Command line: ntpd -gq 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: ---------------------------------------------------- 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: corporation. Support and training for ntp-4 are 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: available at https://www.nwtime.org/support 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: ---------------------------------------------------- 2024-09-20T20:26:54.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: proto: precision = 0.043 usec (-24) 2024-09-20T20:26:54.576 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: basedate set to 2022-02-04 2024-09-20T20:26:54.576 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: gps base set to 2022-02-06 (week 2196) 2024-09-20T20:26:54.576 INFO:teuthology.orchestra.run.smithi090.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:26:54.576 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:26:54.576 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:26:54.577 INFO:teuthology.orchestra.run.smithi090.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:26:54.577 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T20:26:54.577 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T20:26:54.577 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T20:26:54.577 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Listen normally on 3 enp3s0f1 172.21.15.90:123 2024-09-20T20:26:54.577 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Listen normally on 4 lo [::1]:123 2024-09-20T20:26:54.578 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d767%5]:123 2024-09-20T20:26:54.578 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:26:54 ntpd[18492]: Listening on routing socket on fd #22 for interface updates 2024-09-20T20:26:54.595 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-20T20:26:54.595 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Command line: ntpd -gq 2024-09-20T20:26:54.595 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: ---------------------------------------------------- 2024-09-20T20:26:54.595 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: ntp-4 is maintained by Network Time Foundation, 2024-09-20T20:26:54.595 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-20T20:26:54.595 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: corporation. Support and training for ntp-4 are 2024-09-20T20:26:54.595 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: available at https://www.nwtime.org/support 2024-09-20T20:26:54.595 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: ---------------------------------------------------- 2024-09-20T20:26:54.596 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: proto: precision = 0.044 usec (-24) 2024-09-20T20:26:54.596 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: basedate set to 2022-02-04 2024-09-20T20:26:54.596 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: gps base set to 2022-02-06 (week 2196) 2024-09-20T20:26:54.596 INFO:teuthology.orchestra.run.smithi187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:26:54.597 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-20T20:26:54.597 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:26:54.597 INFO:teuthology.orchestra.run.smithi187.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-20T20:26:54.598 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Listen and drop on 0 v6wildcard [::]:123 2024-09-20T20:26:54.598 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-20T20:26:54.598 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Listen normally on 2 lo 127.0.0.1:123 2024-09-20T20:26:54.598 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Listen normally on 3 enp3s0f1 172.21.15.187:123 2024-09-20T20:26:54.598 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Listen normally on 4 lo [::1]:123 2024-09-20T20:26:54.598 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77b1%5]:123 2024-09-20T20:26:54.598 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:26:54 ntpd[18514]: Listening on routing socket on fd #22 for interface updates 2024-09-20T20:26:55.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:55 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:55 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:55 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:55 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:55 ntpd[18469]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:55.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:55 ntpd[18469]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:55.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:55 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:55.595 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:55 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.595 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:55 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:55 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:55.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:55 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:55.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:55 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:55.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:55 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:56 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:56 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:56.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:56.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:56 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:56.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:56.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:56 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:56.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:56 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:56.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:56 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:56.595 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:56 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:56.595 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:56 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:56.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:56 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:56.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:56 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:56.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:56 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:56.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:56 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:57.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:57 ntpd[18469]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:57 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:57 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:57 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:57 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:57 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:57 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:57 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:57 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:57.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:57 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:57.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:57.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:57.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:57.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:57.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:57 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:58.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:58 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:58.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:58 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:58.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:58 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:58.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:58 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:58.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:58 ntpd[18469]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:58.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:58 ntpd[18469]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:58.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:58 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:58.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:58 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:58.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:58 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:58.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:58 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:58.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:58 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:58.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:58 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:58.595 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:58 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:58.595 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:58 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:58.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:58 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:58.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:58 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:58.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:58 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:58.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:58 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:26:59 ntpd[18469]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:26:59 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:26:59 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:26:59.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:26:59.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:26:59.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:26:59.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:26:59 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:00.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:00 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:00.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:00 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:00.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:00 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:00.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:00 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:00.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:00 ntpd[18469]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:00.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:00 ntpd[18469]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:00 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:00 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:00 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:00 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:00.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:00 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:00.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:00 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:00.595 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:00 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:00.595 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:00 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:00.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:00 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:00.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:00 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:00.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:00 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:00.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:00 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stdout:20 Sep 20:27:01 ntpd[18469]: ntpd: time slew -0.000402 s 2024-09-20T20:27:01.568 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew -0.000402s 2024-09-20T20:27:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T20:27:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:20 Sep 20:27:01 ntpd[18469]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:01 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:01.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:01.574 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:01.575 INFO:teuthology.orchestra.run.smithi090.stdout:20 Sep 20:27:01 ntpd[18492]: ntpd: time slew +0.001119 s 2024-09-20T20:27:01.575 INFO:teuthology.orchestra.run.smithi090.stdout:ntpd: time slew +0.001119s 2024-09-20T20:27:01.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T20:27:01.575 INFO:teuthology.orchestra.run.smithi090.stderr:20 Sep 20:27:01 ntpd[18492]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T20:27:01.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:01.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:01.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:01.596 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:01.597 INFO:teuthology.orchestra.run.smithi187.stdout:20 Sep 20:27:01 ntpd[18514]: ntpd: time slew -0.000749 s 2024-09-20T20:27:01.597 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew -0.000749s 2024-09-20T20:27:01.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T20:27:01.597 INFO:teuthology.orchestra.run.smithi187.stderr:20 Sep 20:27:01 ntpd[18514]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T20:27:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:27:01.613 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-20T20:27:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.621 INFO:teuthology.orchestra.run.smithi090.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:27:01.621 INFO:teuthology.orchestra.run.smithi090.stdout:============================================================================== 2024-09-20T20:27:01.622 INFO:teuthology.orchestra.run.smithi090.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.622 INFO:teuthology.orchestra.run.smithi090.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.622 INFO:teuthology.orchestra.run.smithi090.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.622 INFO:teuthology.orchestra.run.smithi090.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.642 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:27:01.643 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-09-20T20:27:01.643 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.643 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.643 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:01.643 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:03.572 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-20T20:27:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: can't open /var/log/ntpstats/rawstats.20240920: Permission denied 2024-09-20T20:27:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-20T20:27:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: can't open /var/log/ntpstats/peerstats.20240920: Permission denied 2024-09-20T20:27:03.573 INFO:teuthology.orchestra.run.smithi079.stdout:20 Sep 20:27:03 ntpd[18471]: ntpd: time slew -0.000698 s 2024-09-20T20:27:03.573 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew -0.000698s 2024-09-20T20:27:03.573 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-20T20:27:03.574 INFO:teuthology.orchestra.run.smithi079.stderr:20 Sep 20:27:03 ntpd[18471]: can't open /var/log/ntpstats/loopstats.20240920: Permission denied 2024-09-20T20:27:03.625 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:27:03.625 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-20T20:27:03.625 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:03.625 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:03.625 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:03.625 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:27:03.626 INFO:teuthology.run_tasks:Running task install... 2024-09-20T20:27:03.634 DEBUG:teuthology.task.install:project ceph 2024-09-20T20:27:03.634 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}} 2024-09-20T20:27:03.634 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'} 2024-09-20T20:27:03.634 INFO:teuthology.task.install:Using flavor: default 2024-09-20T20:27:03.639 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-20T20:27:03.639 INFO:teuthology.task.install:extra packages: [] 2024-09-20T20:27:03.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2024-09-20T20:27:03.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2024-09-20T20:27:03.640 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-key list | grep Ceph 2024-09-20T20:27:03.641 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-key list | grep Ceph 2024-09-20T20:27:03.702 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T20:27:03.703 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T20:27:03.712 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T20:27:03.727 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-20T20:27:03.731 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T20:27:03.731 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T20:27:03.732 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T20:27:03.732 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-20T20:27:03.732 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:27:03.741 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T20:27:03.741 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T20:27:03.742 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T20:27:03.742 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-20T20:27:03.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:27:03.754 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T20:27:03.754 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T20:27:03.755 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T20:27:03.755 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-20T20:27:03.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:27:03.765 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-20T20:27:03.766 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2024-09-20T20:27:03.766 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-20T20:27:03.766 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-20T20:27:03.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:27:03.875 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T20:27:03.875 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:27:03.878 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T20:27:03.879 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:27:03.892 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T20:27:03.892 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:27:03.896 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default/ 2024-09-20T20:27:03.896 INFO:teuthology.task.install.deb:Package version is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:27:03.987 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:27:03.987 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T20:27:03.989 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:27:03.989 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T20:27:03.997 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:27:03.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T20:27:04.002 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2024-09-20T20:27:04.003 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-20T20:27:04.010 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:27:04.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-20T20:27:04.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-20T20:27:04.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-20T20:27:04.170 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:27:04.172 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:27:04.180 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:27:04.181 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:27:04.192 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:27:04.195 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:27:04.197 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:27:04.204 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:27:04.209 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:27:04.224 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T20:27:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:27:04.227 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T20:27:04.236 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T20:27:04.245 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T20:27:04.247 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy InRelease 2024-09-20T20:27:04.248 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T20:27:04.257 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T20:27:04.267 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T20:27:04.268 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-09-20T20:27:04.269 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T20:27:04.279 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T20:27:04.288 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T20:27:04.289 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-20T20:27:04.290 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T20:27:04.293 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:27:04.299 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-20T20:27:04.300 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T20:27:04.306 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:27:04.310 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T20:27:04.314 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-09-20T20:27:04.316 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-20T20:27:04.320 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T20:27:04.327 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T20:27:04.340 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-20T20:27:04.378 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-20T20:27:04.457 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-20T20:27:04.503 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 28.3 kB in 0s (87.5 kB/s) 2024-09-20T20:27:04.520 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 28.3 kB in 0s (85.7 kB/s) 2024-09-20T20:27:04.547 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 28.3 kB in 0s (82.6 kB/s) 2024-09-20T20:27:04.591 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 28.3 kB in 0s (69.3 kB/s) 2024-09-20T20:27:05.487 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-20T20:27:05.504 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:27:05.510 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-20T20:27:05.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:27:05.532 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-20T20:27:05.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:27:05.569 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-20T20:27:05.576 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-20T20:27:05.612 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-20T20:27:05.615 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-20T20:27:05.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-367-g9e2ac70b-1jammy cephadm=19.1.1-367-g9e2ac70b-1jammy ceph-mds=19.1.1-367-g9e2ac70b-1jammy ceph-mgr=19.1.1-367-g9e2ac70b-1jammy ceph-common=19.1.1-367-g9e2ac70b-1jammy ceph-fuse=19.1.1-367-g9e2ac70b-1jammy ceph-test=19.1.1-367-g9e2ac70b-1jammy ceph-volume=19.1.1-367-g9e2ac70b-1jammy radosgw=19.1.1-367-g9e2ac70b-1jammy python3-rados=19.1.1-367-g9e2ac70b-1jammy python3-rgw=19.1.1-367-g9e2ac70b-1jammy python3-cephfs=19.1.1-367-g9e2ac70b-1jammy python3-rbd=19.1.1-367-g9e2ac70b-1jammy libcephfs2=19.1.1-367-g9e2ac70b-1jammy libcephfs-dev=19.1.1-367-g9e2ac70b-1jammy librados2=19.1.1-367-g9e2ac70b-1jammy librbd1=19.1.1-367-g9e2ac70b-1jammy rbd-fuse=19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:27:05.691 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-20T20:27:05.762 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-20T20:27:05.763 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-20T20:27:05.782 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-20T20:27:05.783 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-20T20:27:05.821 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-20T20:27:05.822 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-20T20:27:05.901 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2024-09-20T20:27:05.902 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2024-09-20T20:27:05.948 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:27:05.948 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:27:05.948 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:27:05.948 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:27:05.948 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:27:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:27:05.949 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:27:05.949 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-20T20:27:05.949 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T20:27:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T20:27:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T20:27:05.950 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T20:27:05.951 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T20:27:05.951 INFO:teuthology.orchestra.run.smithi079.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T20:27:05.951 INFO:teuthology.orchestra.run.smithi079.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T20:27:05.951 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T20:27:05.951 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T20:27:05.952 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet zip 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-20T20:27:05.953 INFO:teuthology.orchestra.run.smithi079.stdout: btrfs-tools 2024-09-20T20:27:05.995 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:27:05.995 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:27:05.996 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:27:05.996 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:27:05.996 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:27:05.996 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:27:05.997 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:27:05.998 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-20T20:27:05.998 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T20:27:05.998 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T20:27:05.998 INFO:teuthology.orchestra.run.smithi187.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T20:27:05.998 INFO:teuthology.orchestra.run.smithi187.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T20:27:05.999 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T20:27:05.999 INFO:teuthology.orchestra.run.smithi187.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T20:27:05.999 INFO:teuthology.orchestra.run.smithi187.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T20:27:05.999 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T20:27:05.999 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T20:27:05.999 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:27:05.999 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T20:27:06.000 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet zip 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-09-20T20:27:06.001 INFO:teuthology.orchestra.run.smithi187.stdout: btrfs-tools 2024-09-20T20:27:06.029 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:27:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:27:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:27:06.029 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:27:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:27:06.030 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:27:06.030 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:27:06.030 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-20T20:27:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T20:27:06.031 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:27:06.032 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T20:27:06.033 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet zip 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-20T20:27:06.034 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2024-09-20T20:27:06.053 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-20T20:27:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T20:27:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T20:27:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T20:27:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T20:27:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T20:27:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T20:27:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T20:27:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T20:27:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T20:27:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T20:27:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T20:27:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T20:27:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T20:27:06.096 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:27:06.096 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:27:06.096 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:27:06.096 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:27:06.096 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:27:06.096 INFO:teuthology.orchestra.run.smithi090.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:27:06.096 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:27:06.097 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2024-09-20T20:27:06.097 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-20T20:27:06.097 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-20T20:27:06.098 INFO:teuthology.orchestra.run.smithi090.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-20T20:27:06.098 INFO:teuthology.orchestra.run.smithi090.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-20T20:27:06.099 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet zip 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-20T20:27:06.100 INFO:teuthology.orchestra.run.smithi090.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-20T20:27:06.101 INFO:teuthology.orchestra.run.smithi090.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-20T20:27:06.101 INFO:teuthology.orchestra.run.smithi090.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-20T20:27:06.101 INFO:teuthology.orchestra.run.smithi090.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-20T20:27:06.101 INFO:teuthology.orchestra.run.smithi090.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-20T20:27:06.101 INFO:teuthology.orchestra.run.smithi090.stdout:Recommended packages: 2024-09-20T20:27:06.101 INFO:teuthology.orchestra.run.smithi090.stdout: btrfs-tools 2024-09-20T20:27:06.103 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-20T20:27:06.103 INFO:teuthology.orchestra.run.smithi187.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T20:27:06.103 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T20:27:06.103 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T20:27:06.104 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T20:27:06.104 INFO:teuthology.orchestra.run.smithi187.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T20:27:06.104 INFO:teuthology.orchestra.run.smithi187.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T20:27:06.105 INFO:teuthology.orchestra.run.smithi187.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T20:27:06.105 INFO:teuthology.orchestra.run.smithi187.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T20:27:06.105 INFO:teuthology.orchestra.run.smithi187.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T20:27:06.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T20:27:06.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T20:27:06.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:27:06.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T20:27:06.106 INFO:teuthology.orchestra.run.smithi187.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T20:27:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T20:27:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 181 MB of archives. 2024-09-20T20:27:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T20:27:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T20:27:06.135 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-20T20:27:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T20:27:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T20:27:06.135 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T20:27:06.137 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T20:27:06.138 INFO:teuthology.orchestra.run.smithi070.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T20:27:06.196 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T20:27:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T20:27:06.203 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2024-09-20T20:27:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-20T20:27:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-20T20:27:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-20T20:27:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-20T20:27:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-20T20:27:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-20T20:27:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-20T20:27:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-20T20:27:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-20T20:27:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-20T20:27:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-20T20:27:06.206 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T20:27:06.223 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T20:27:06.247 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T20:27:06.247 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 181 MB of archives. 2024-09-20T20:27:06.247 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T20:27:06.247 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T20:27:06.263 INFO:teuthology.orchestra.run.smithi090.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T20:27:06.263 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 181 MB of archives. 2024-09-20T20:27:06.264 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T20:27:06.264 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T20:27:06.276 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-20T20:27:06.277 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 181 MB of archives. 2024-09-20T20:27:06.277 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-20T20:27:06.277 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T20:27:06.288 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T20:27:06.293 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T20:27:06.293 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T20:27:06.308 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T20:27:06.313 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T20:27:06.313 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T20:27:06.314 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T20:27:06.323 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-20T20:27:06.324 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T20:27:06.327 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T20:27:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T20:27:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T20:27:06.331 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T20:27:06.343 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T20:27:06.345 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-367-g9e2ac70b-1jammy [3,591 kB] 2024-09-20T20:27:06.346 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T20:27:06.347 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T20:27:06.348 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T20:27:06.352 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T20:27:06.355 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T20:27:06.361 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T20:27:06.362 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T20:27:06.362 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T20:27:06.362 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T20:27:06.363 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T20:27:06.363 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T20:27:06.372 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T20:27:06.378 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T20:27:06.378 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T20:27:06.380 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T20:27:06.381 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T20:27:06.395 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T20:27:06.395 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T20:27:06.397 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T20:27:06.397 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T20:27:06.397 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T20:27:06.398 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T20:27:06.401 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T20:27:06.412 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T20:27:06.412 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T20:27:06.418 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T20:27:06.418 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T20:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T20:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T20:27:06.430 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T20:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T20:27:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T20:27:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T20:27:06.434 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T20:27:06.435 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T20:27:06.447 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T20:27:06.447 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T20:27:06.450 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T20:27:06.450 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T20:27:06.451 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T20:27:06.451 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T20:27:06.452 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T20:27:06.452 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T20:27:06.461 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T20:27:06.463 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T20:27:06.463 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T20:27:06.465 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T20:27:06.466 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T20:27:06.470 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T20:27:06.472 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T20:27:06.474 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T20:27:06.488 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T20:27:06.489 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T20:27:06.489 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T20:27:06.490 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T20:27:06.491 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T20:27:06.491 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T20:27:06.491 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T20:27:06.499 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T20:27:06.505 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T20:27:06.506 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T20:27:06.506 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T20:27:06.515 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T20:27:06.516 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T20:27:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T20:27:06.518 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T20:27:06.519 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T20:27:06.523 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T20:27:06.523 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T20:27:06.524 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T20:27:06.524 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T20:27:06.525 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T20:27:06.525 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T20:27:06.526 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T20:27:06.530 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T20:27:06.540 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T20:27:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T20:27:06.542 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T20:27:06.542 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T20:27:06.543 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T20:27:06.543 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T20:27:06.555 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T20:27:06.557 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T20:27:06.558 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T20:27:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T20:27:06.558 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T20:27:06.559 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T20:27:06.559 INFO:teuthology.orchestra.run.smithi090.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T20:27:06.559 INFO:teuthology.orchestra.run.smithi090.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T20:27:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T20:27:06.560 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T20:27:06.560 INFO:teuthology.orchestra.run.smithi090.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T20:27:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T20:27:06.562 INFO:teuthology.orchestra.run.smithi090.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T20:27:06.563 INFO:teuthology.orchestra.run.smithi090.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T20:27:06.568 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T20:27:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T20:27:06.574 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T20:27:06.575 INFO:teuthology.orchestra.run.smithi090.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T20:27:06.575 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T20:27:06.575 INFO:teuthology.orchestra.run.smithi090.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T20:27:06.577 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T20:27:06.578 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T20:27:06.578 INFO:teuthology.orchestra.run.smithi090.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T20:27:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T20:27:06.582 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T20:27:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T20:27:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T20:27:06.587 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T20:27:06.590 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T20:27:06.592 INFO:teuthology.orchestra.run.smithi090.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T20:27:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T20:27:06.593 INFO:teuthology.orchestra.run.smithi090.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T20:27:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T20:27:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T20:27:06.596 INFO:teuthology.orchestra.run.smithi090.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T20:27:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T20:27:06.648 INFO:teuthology.orchestra.run.smithi090.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T20:27:06.649 INFO:teuthology.orchestra.run.smithi090.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T20:27:06.650 INFO:teuthology.orchestra.run.smithi090.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T20:27:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T20:27:06.651 INFO:teuthology.orchestra.run.smithi090.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T20:27:06.663 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T20:27:06.664 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T20:27:06.664 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T20:27:06.668 INFO:teuthology.orchestra.run.smithi090.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T20:27:06.669 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T20:27:06.669 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T20:27:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T20:27:06.670 INFO:teuthology.orchestra.run.smithi090.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T20:27:06.671 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T20:27:06.671 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T20:27:06.673 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T20:27:06.674 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T20:27:06.684 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T20:27:06.684 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T20:27:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T20:27:06.684 INFO:teuthology.orchestra.run.smithi090.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T20:27:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T20:27:06.685 INFO:teuthology.orchestra.run.smithi090.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T20:27:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T20:27:06.686 INFO:teuthology.orchestra.run.smithi090.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T20:27:06.686 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T20:27:06.694 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T20:27:06.695 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T20:27:06.699 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T20:27:06.700 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T20:27:06.701 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T20:27:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T20:27:06.701 INFO:teuthology.orchestra.run.smithi090.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T20:27:06.703 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T20:27:06.703 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T20:27:06.704 INFO:teuthology.orchestra.run.smithi090.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T20:27:06.713 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T20:27:06.718 INFO:teuthology.orchestra.run.smithi090.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T20:27:06.718 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T20:27:06.719 INFO:teuthology.orchestra.run.smithi090.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T20:27:06.720 INFO:teuthology.orchestra.run.smithi090.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T20:27:06.723 INFO:teuthology.orchestra.run.smithi090.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T20:27:06.725 INFO:teuthology.orchestra.run.smithi090.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T20:27:06.725 INFO:teuthology.orchestra.run.smithi090.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T20:27:06.726 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T20:27:06.726 INFO:teuthology.orchestra.run.smithi090.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T20:27:06.735 INFO:teuthology.orchestra.run.smithi090.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T20:27:06.736 INFO:teuthology.orchestra.run.smithi090.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T20:27:06.739 INFO:teuthology.orchestra.run.smithi090.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T20:27:06.740 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T20:27:06.747 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-20T20:27:06.752 INFO:teuthology.orchestra.run.smithi090.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T20:27:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T20:27:06.753 INFO:teuthology.orchestra.run.smithi090.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T20:27:06.754 INFO:teuthology.orchestra.run.smithi090.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T20:27:06.755 INFO:teuthology.orchestra.run.smithi090.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T20:27:06.759 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-20T20:27:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T20:27:06.761 INFO:teuthology.orchestra.run.smithi090.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T20:27:06.761 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T20:27:06.771 INFO:teuthology.orchestra.run.smithi090.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T20:27:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T20:27:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T20:27:06.776 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T20:27:06.777 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T20:27:06.781 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T20:27:06.782 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T20:27:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T20:27:06.818 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T20:27:06.840 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-20T20:27:06.952 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T20:27:06.954 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T20:27:06.969 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T20:27:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T20:27:07.047 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T20:27:07.069 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-20T20:27:07.073 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T20:27:07.076 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T20:27:07.076 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T20:27:07.080 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-20T20:27:07.085 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T20:27:07.086 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T20:27:07.087 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T20:27:07.105 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T20:27:07.110 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T20:27:07.110 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-20T20:27:07.114 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T20:27:07.118 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T20:27:07.119 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-20T20:27:07.120 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-20T20:27:07.121 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-20T20:27:07.130 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T20:27:07.139 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-20T20:27:07.143 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-20T20:27:07.148 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-20T20:27:07.152 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-20T20:27:07.185 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T20:27:07.188 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T20:27:07.199 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T20:27:07.203 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T20:27:07.207 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T20:27:07.210 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T20:27:07.212 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T20:27:07.212 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T20:27:07.214 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T20:27:07.215 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T20:27:07.215 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T20:27:07.232 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-20T20:27:07.236 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-20T20:27:07.236 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T20:27:07.240 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-20T20:27:07.244 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-20T20:27:07.245 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-20T20:27:07.245 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-20T20:27:07.247 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-20T20:27:07.248 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-20T20:27:07.249 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-20T20:27:07.281 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T20:27:07.298 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T20:27:07.299 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T20:27:07.299 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T20:27:07.305 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T20:27:07.306 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T20:27:07.315 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-20T20:27:07.331 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-20T20:27:07.332 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-20T20:27:07.332 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-20T20:27:07.338 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-20T20:27:07.339 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-20T20:27:07.363 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T20:27:07.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T20:27:07.366 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T20:27:07.366 INFO:teuthology.orchestra.run.smithi187.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T20:27:07.398 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-20T20:27:07.398 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-20T20:27:07.399 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-20T20:27:07.400 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-20T20:27:07.444 INFO:teuthology.orchestra.run.smithi187.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T20:27:07.447 INFO:teuthology.orchestra.run.smithi187.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T20:27:07.448 INFO:teuthology.orchestra.run.smithi187.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T20:27:07.449 INFO:teuthology.orchestra.run.smithi187.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T20:27:07.460 INFO:teuthology.orchestra.run.smithi187.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T20:27:07.477 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-20T20:27:07.480 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-20T20:27:07.481 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-20T20:27:07.482 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-20T20:27:07.493 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-20T20:27:07.526 INFO:teuthology.orchestra.run.smithi187.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T20:27:07.527 INFO:teuthology.orchestra.run.smithi187.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T20:27:07.528 INFO:teuthology.orchestra.run.smithi187.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T20:27:07.531 INFO:teuthology.orchestra.run.smithi187.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T20:27:07.534 INFO:teuthology.orchestra.run.smithi187.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T20:27:07.559 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-20T20:27:07.560 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-20T20:27:07.561 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-20T20:27:07.563 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-20T20:27:07.567 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-20T20:27:07.607 INFO:teuthology.orchestra.run.smithi187.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T20:27:07.610 INFO:teuthology.orchestra.run.smithi187.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T20:27:07.612 INFO:teuthology.orchestra.run.smithi187.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T20:27:07.617 INFO:teuthology.orchestra.run.smithi187.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T20:27:07.618 INFO:teuthology.orchestra.run.smithi187.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T20:27:07.640 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-20T20:27:07.643 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-20T20:27:07.644 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-20T20:27:07.649 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-20T20:27:07.650 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-20T20:27:07.668 INFO:teuthology.orchestra.run.smithi090.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-367-g9e2ac70b-1jammy [3,241 kB] 2024-09-20T20:27:07.689 INFO:teuthology.orchestra.run.smithi187.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T20:27:07.694 INFO:teuthology.orchestra.run.smithi187.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T20:27:07.722 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-20T20:27:07.726 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-20T20:27:07.886 INFO:teuthology.orchestra.run.smithi187.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T20:27:07.887 INFO:teuthology.orchestra.run.smithi187.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T20:27:07.889 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-20T20:27:07.890 INFO:teuthology.orchestra.run.smithi187.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T20:27:07.890 INFO:teuthology.orchestra.run.smithi187.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T20:27:07.891 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-20T20:27:07.894 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-20T20:27:07.894 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-20T20:27:07.896 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T20:27:07.932 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T20:27:07.935 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T20:27:07.936 INFO:teuthology.orchestra.run.smithi187.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-20T20:27:07.936 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T20:27:07.974 INFO:teuthology.orchestra.run.smithi187.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-20T20:27:07.977 INFO:teuthology.orchestra.run.smithi187.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-20T20:27:07.977 INFO:teuthology.orchestra.run.smithi187.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-20T20:27:07.994 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T20:27:07.995 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T20:27:08.034 INFO:teuthology.orchestra.run.smithi187.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-20T20:27:08.034 INFO:teuthology.orchestra.run.smithi187.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-20T20:27:08.055 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T20:27:08.056 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T20:27:08.057 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T20:27:08.058 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T20:27:08.059 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T20:27:08.060 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T20:27:08.067 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T20:27:08.097 INFO:teuthology.orchestra.run.smithi187.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-20T20:27:08.098 INFO:teuthology.orchestra.run.smithi187.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-20T20:27:08.098 INFO:teuthology.orchestra.run.smithi187.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-20T20:27:08.099 INFO:teuthology.orchestra.run.smithi187.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-20T20:27:08.100 INFO:teuthology.orchestra.run.smithi187.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-20T20:27:08.101 INFO:teuthology.orchestra.run.smithi187.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-20T20:27:08.107 INFO:teuthology.orchestra.run.smithi187.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-20T20:27:08.137 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T20:27:08.140 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T20:27:08.142 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T20:27:08.178 INFO:teuthology.orchestra.run.smithi187.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-20T20:27:08.182 INFO:teuthology.orchestra.run.smithi187.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-20T20:27:08.183 INFO:teuthology.orchestra.run.smithi187.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-20T20:27:08.221 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T20:27:08.227 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T20:27:08.230 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T20:27:08.231 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T20:27:08.233 INFO:teuthology.orchestra.run.smithi090.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-367-g9e2ac70b-1jammy [719 kB] 2024-09-20T20:27:08.242 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T20:27:08.244 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T20:27:08.251 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T20:27:08.260 INFO:teuthology.orchestra.run.smithi187.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-20T20:27:08.266 INFO:teuthology.orchestra.run.smithi187.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-20T20:27:08.268 INFO:teuthology.orchestra.run.smithi187.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-20T20:27:08.270 INFO:teuthology.orchestra.run.smithi187.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-20T20:27:08.281 INFO:teuthology.orchestra.run.smithi187.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-20T20:27:08.282 INFO:teuthology.orchestra.run.smithi187.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-20T20:27:08.290 INFO:teuthology.orchestra.run.smithi187.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-20T20:27:08.303 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T20:27:08.305 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T20:27:08.306 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T20:27:08.341 INFO:teuthology.orchestra.run.smithi187.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-20T20:27:08.343 INFO:teuthology.orchestra.run.smithi187.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-20T20:27:08.344 INFO:teuthology.orchestra.run.smithi187.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-20T20:27:08.362 INFO:teuthology.orchestra.run.smithi090.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-367-g9e2ac70b-1jammy [357 kB] 2024-09-20T20:27:08.385 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T20:27:08.387 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T20:27:08.404 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T20:27:08.405 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T20:27:08.405 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T20:27:08.410 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T20:27:08.412 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T20:27:08.423 INFO:teuthology.orchestra.run.smithi187.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-20T20:27:08.425 INFO:teuthology.orchestra.run.smithi187.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-20T20:27:08.426 INFO:teuthology.orchestra.run.smithi090.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-367-g9e2ac70b-1jammy [32.8 kB] 2024-09-20T20:27:08.427 INFO:teuthology.orchestra.run.smithi090.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-367-g9e2ac70b-1jammy [180 kB] 2024-09-20T20:27:08.431 INFO:teuthology.orchestra.run.smithi090.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-367-g9e2ac70b-1jammy [67.8 kB] 2024-09-20T20:27:08.433 INFO:teuthology.orchestra.run.smithi090.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-367-g9e2ac70b-1jammy [333 kB] 2024-09-20T20:27:08.486 INFO:teuthology.orchestra.run.smithi187.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-20T20:27:08.487 INFO:teuthology.orchestra.run.smithi187.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-20T20:27:08.487 INFO:teuthology.orchestra.run.smithi187.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-20T20:27:08.496 INFO:teuthology.orchestra.run.smithi090.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-367-g9e2ac70b-1jammy [6,875 kB] 2024-09-20T20:27:08.546 INFO:teuthology.orchestra.run.smithi187.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-20T20:27:08.547 INFO:teuthology.orchestra.run.smithi187.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T20:27:08.548 INFO:teuthology.orchestra.run.smithi187.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-20T20:27:08.656 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T20:27:08.687 INFO:teuthology.orchestra.run.smithi187.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T20:27:08.696 INFO:teuthology.orchestra.run.smithi187.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T20:27:08.698 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T20:27:08.699 INFO:teuthology.orchestra.run.smithi187.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T20:27:08.762 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T20:27:08.776 INFO:teuthology.orchestra.run.smithi187.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T20:27:08.777 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T20:27:08.781 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T20:27:08.884 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T20:27:08.939 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T20:27:08.945 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T20:27:08.948 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T20:27:09.026 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T20:27:09.123 INFO:teuthology.orchestra.run.smithi187.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T20:27:09.200 INFO:teuthology.orchestra.run.smithi090.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-367-g9e2ac70b-1jammy [112 kB] 2024-09-20T20:27:09.203 INFO:teuthology.orchestra.run.smithi090.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-367-g9e2ac70b-1jammy [472 kB] 2024-09-20T20:27:09.240 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T20:27:09.263 INFO:teuthology.orchestra.run.smithi090.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-367-g9e2ac70b-1jammy [25.9 MB] 2024-09-20T20:27:09.434 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T20:27:10.635 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T20:27:10.636 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T20:27:10.651 INFO:teuthology.orchestra.run.smithi187.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T20:27:10.652 INFO:teuthology.orchestra.run.smithi187.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T20:27:10.653 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T20:27:10.669 INFO:teuthology.orchestra.run.smithi187.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T20:27:10.700 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T20:27:10.749 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T20:27:10.762 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T20:27:10.792 INFO:teuthology.orchestra.run.smithi187.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T20:27:10.850 INFO:teuthology.orchestra.run.smithi187.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T20:27:10.853 INFO:teuthology.orchestra.run.smithi187.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T20:27:10.881 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T20:27:10.958 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T20:27:10.959 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T20:27:10.976 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T20:27:10.991 INFO:teuthology.orchestra.run.smithi187.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T20:27:11.028 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T20:27:11.095 INFO:teuthology.orchestra.run.smithi079.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T20:27:11.098 INFO:teuthology.orchestra.run.smithi079.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T20:27:11.254 INFO:teuthology.orchestra.run.smithi079.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T20:27:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T20:27:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T20:27:11.565 INFO:teuthology.orchestra.run.smithi187.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T20:27:11.565 INFO:teuthology.orchestra.run.smithi187.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T20:27:11.657 INFO:teuthology.orchestra.run.smithi090.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-367-g9e2ac70b-1jammy [5,145 kB] 2024-09-20T20:27:11.838 INFO:teuthology.orchestra.run.smithi079.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T20:27:11.839 INFO:teuthology.orchestra.run.smithi079.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T20:27:12.074 INFO:teuthology.orchestra.run.smithi090.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-367-g9e2ac70b-1jammy [245 kB] 2024-09-20T20:27:12.097 INFO:teuthology.orchestra.run.smithi090.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-367-g9e2ac70b-1jammy [124 kB] 2024-09-20T20:27:12.100 INFO:teuthology.orchestra.run.smithi090.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-367-g9e2ac70b-1jammy [1,555 kB] 2024-09-20T20:27:12.245 INFO:teuthology.orchestra.run.smithi090.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-367-g9e2ac70b-1jammy [6,142 kB] 2024-09-20T20:27:12.776 INFO:teuthology.orchestra.run.smithi090.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-367-g9e2ac70b-1jammy [22.8 MB] 2024-09-20T20:27:14.388 INFO:teuthology.orchestra.run.smithi070.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T20:27:14.432 INFO:teuthology.orchestra.run.smithi070.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T20:27:14.433 INFO:teuthology.orchestra.run.smithi070.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T20:27:14.617 INFO:teuthology.orchestra.run.smithi090.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-367-g9e2ac70b-1jammy [14.1 kB] 2024-09-20T20:27:14.617 INFO:teuthology.orchestra.run.smithi090.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [877 kB] 2024-09-20T20:27:14.634 INFO:teuthology.orchestra.run.smithi090.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-367-g9e2ac70b-1jammy [2,462 kB] 2024-09-20T20:27:14.833 INFO:teuthology.orchestra.run.smithi090.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-367-g9e2ac70b-1jammy [795 kB] 2024-09-20T20:27:14.905 INFO:teuthology.orchestra.run.smithi090.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-367-g9e2ac70b-1jammy [152 kB] 2024-09-20T20:27:14.919 INFO:teuthology.orchestra.run.smithi090.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-367-g9e2ac70b-1jammy [2,347 kB] 2024-09-20T20:27:14.993 INFO:teuthology.orchestra.run.smithi070.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T20:27:15.037 INFO:teuthology.orchestra.run.smithi187.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T20:27:15.040 INFO:teuthology.orchestra.run.smithi187.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T20:27:15.041 INFO:teuthology.orchestra.run.smithi187.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T20:27:15.048 INFO:teuthology.orchestra.run.smithi090.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-367-g9e2ac70b-1jammy [8,625 kB] 2024-09-20T20:27:15.433 INFO:teuthology.orchestra.run.smithi079.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T20:27:15.442 INFO:teuthology.orchestra.run.smithi187.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T20:27:15.445 INFO:teuthology.orchestra.run.smithi090.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-367-g9e2ac70b-1jammy [14.2 kB] 2024-09-20T20:27:15.445 INFO:teuthology.orchestra.run.smithi090.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-367-g9e2ac70b-1jammy [51.4 MB] 2024-09-20T20:27:15.446 INFO:teuthology.orchestra.run.smithi079.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T20:27:15.450 INFO:teuthology.orchestra.run.smithi079.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T20:27:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 181 MB in 9s (20.5 MB/s) 2024-09-20T20:27:15.734 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T20:27:15.758 INFO:teuthology.orchestra.run.smithi079.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T20:27:15.834 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T20:27:15.840 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T20:27:15.932 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:27:16.031 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 181 MB in 9s (19.4 MB/s) 2024-09-20T20:27:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T20:27:16.277 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T20:27:16.303 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T20:27:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T20:27:16.319 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T20:27:16.327 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 181 MB in 10s (18.7 MB/s) 2024-09-20T20:27:16.344 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:27:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:27:16.454 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T20:27:16.551 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T20:27:16.556 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T20:27:16.637 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T20:27:16.644 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:27:16.663 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T20:27:16.697 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:27:16.705 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T20:27:16.721 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T20:27:16.764 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:27:16.960 INFO:teuthology.orchestra.run.smithi090.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-367-g9e2ac70b-1jammy [130 kB] 2024-09-20T20:27:16.962 INFO:teuthology.orchestra.run.smithi090.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-367-g9e2ac70b-1jammy [39.0 kB] 2024-09-20T20:27:16.964 INFO:teuthology.orchestra.run.smithi090.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-367-g9e2ac70b-1jammy [13.6 MB] 2024-09-20T20:27:16.980 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T20:27:17.006 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T20:27:17.047 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:27:17.213 INFO:teuthology.orchestra.run.smithi090.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/9e2ac70bb7aea67d34f0d50002344abbe7803736/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-367-g9e2ac70b-1jammy [91.4 kB] 2024-09-20T20:27:17.300 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T20:27:17.315 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T20:27:17.326 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T20:27:17.341 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:17.358 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:27:17.375 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T20:27:17.397 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T20:27:17.426 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:17.442 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:27:17.753 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 181 MB in 11s (16.5 MB/s) 2024-09-20T20:27:17.787 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T20:27:17.813 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:17.828 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T20:27:17.829 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T20:27:17.854 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:17.855 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:17.861 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:17.895 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:17.903 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:17.915 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-20T20:27:18.015 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-20T20:27:18.020 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-20T20:27:18.105 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:27:18.198 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T20:27:18.224 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:18.256 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T20:27:18.300 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:18.323 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T20:27:18.340 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:18.349 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:18.413 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:18.443 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-20T20:27:18.469 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-20T20:27:18.511 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:27:18.609 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T20:27:18.635 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T20:27:18.643 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T20:27:18.670 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:18.675 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:27:18.710 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:18.760 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T20:27:18.786 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:18.826 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:18.831 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-20T20:27:18.858 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-20T20:27:18.898 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:27:18.987 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2024-09-20T20:27:19.013 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:19.053 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:19.054 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T20:27:19.081 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T20:27:19.122 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:27:19.163 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T20:27:19.189 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T20:27:19.229 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:27:19.327 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-20T20:27:19.353 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:19.402 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:19.441 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librados2. 2024-09-20T20:27:19.468 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:19.481 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2024-09-20T20:27:19.507 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:19.508 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:19.523 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librados2. 2024-09-20T20:27:19.548 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:19.550 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:19.590 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:19.815 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-20T20:27:19.841 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:19.881 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:19.902 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librbd1. 2024-09-20T20:27:19.917 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:19.952 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:19.992 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T20:27:20.021 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:20.035 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librbd1. 2024-09-20T20:27:20.059 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:20.061 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:20.101 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:20.210 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-20T20:27:20.236 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-20T20:27:20.276 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:27:20.345 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2024-09-20T20:27:20.371 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:20.411 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:20.430 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T20:27:20.457 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:20.496 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:20.521 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T20:27:20.547 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:20.579 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:20.631 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-20T20:27:20.646 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-20T20:27:20.689 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:27:20.706 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T20:27:20.721 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:20.749 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rados. 2024-09-20T20:27:20.755 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:20.765 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:20.799 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:20.898 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2024-09-20T20:27:20.913 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:20.956 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:20.984 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librados2. 2024-09-20T20:27:20.999 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../007-librados2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:21.000 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T20:27:21.015 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:21.034 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:21.058 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:21.094 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T20:27:21.120 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:21.160 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:21.377 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T20:27:21.403 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:21.413 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T20:27:21.440 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:21.444 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:21.451 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T20:27:21.477 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:21.479 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:21.518 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:21.521 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librbd1. 2024-09-20T20:27:21.547 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../008-librbd1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:21.588 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:21.736 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T20:27:21.753 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:21.772 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T20:27:21.791 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T20:27:21.795 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:21.798 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T20:27:21.817 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:21.838 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:27:21.857 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:22.017 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs2. 2024-09-20T20:27:22.043 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:22.092 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:22.097 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T20:27:22.122 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:22.124 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T20:27:22.151 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T20:27:22.164 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T20:27:22.183 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T20:27:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T20:27:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:27:22.484 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T20:27:22.493 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rados. 2024-09-20T20:27:22.511 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T20:27:22.519 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../010-python3-rados_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:22.551 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:27:22.830 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T20:27:22.857 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T20:27:22.858 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:22.870 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T20:27:22.896 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T20:27:22.897 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T20:27:22.936 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T20:27:22.936 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T20:27:22.962 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:23.002 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:23.158 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T20:27:23.180 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T20:27:23.184 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:23.195 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:23.224 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:23.230 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:23.355 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T20:27:23.381 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T20:27:23.422 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:27:23.508 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-20T20:27:23.534 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:23.575 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:23.575 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T20:27:23.602 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T20:27:23.602 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T20:27:23.628 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T20:27:23.642 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:27:23.669 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:27:23.708 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T20:27:23.723 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T20:27:23.766 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:27:23.819 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cephfs. 2024-09-20T20:27:23.845 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:23.886 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:23.919 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T20:27:23.935 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T20:27:23.955 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T20:27:23.978 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:27:23.981 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T20:27:24.021 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:27:24.035 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T20:27:24.050 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T20:27:24.085 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:27:24.189 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-20T20:27:24.215 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:24.256 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:24.288 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T20:27:24.304 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T20:27:24.341 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T20:27:24.347 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:27:24.356 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T20:27:24.391 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:27:24.430 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua5.1. 2024-09-20T20:27:24.457 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T20:27:24.497 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:27:24.560 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-20T20:27:24.587 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-20T20:27:24.627 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:27:24.692 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua5.1. 2024-09-20T20:27:24.703 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua5.1. 2024-09-20T20:27:24.718 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T20:27:24.729 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T20:27:24.759 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:27:24.769 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:27:24.825 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-any. 2024-09-20T20:27:24.840 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T20:27:24.883 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T20:27:24.930 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-prettytable. 2024-09-20T20:27:24.956 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-20T20:27:24.997 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-20T20:27:25.078 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-any. 2024-09-20T20:27:25.089 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-any. 2024-09-20T20:27:25.104 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T20:27:25.110 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package zip. 2024-09-20T20:27:25.116 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T20:27:25.126 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T20:27:25.145 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T20:27:25.156 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T20:27:25.160 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T20:27:25.241 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rbd. 2024-09-20T20:27:25.256 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:25.301 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:25.383 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package zip. 2024-09-20T20:27:25.389 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package zip. 2024-09-20T20:27:25.399 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T20:27:25.404 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T20:27:25.439 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T20:27:25.442 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T20:27:25.474 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package unzip. 2024-09-20T20:27:25.501 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T20:27:25.540 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:27:25.646 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-20T20:27:25.672 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-20T20:27:25.712 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:27:25.728 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package unzip. 2024-09-20T20:27:25.751 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package unzip. 2024-09-20T20:27:25.755 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T20:27:25.777 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T20:27:25.795 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:27:25.817 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:27:25.944 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package luarocks. 2024-09-20T20:27:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T20:27:25.982 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-20T20:27:25.997 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-20T20:27:26.011 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:27:26.032 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:27:26.174 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package luarocks. 2024-09-20T20:27:26.201 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T20:27:26.221 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package luarocks. 2024-09-20T20:27:26.240 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:27:26.247 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T20:27:26.287 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:27:26.345 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-20T20:27:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2024-09-20T20:27:26.371 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-20T20:27:26.386 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:26.412 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:27:26.418 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:26.632 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librgw2. 2024-09-20T20:27:26.659 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:26.698 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:26.766 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package lua5.1. 2024-09-20T20:27:26.792 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-20T20:27:26.820 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2024-09-20T20:27:26.832 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:27:26.846 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:26.886 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:26.954 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T20:27:26.980 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:27.020 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:27.129 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package lua-any. 2024-09-20T20:27:27.155 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-20T20:27:27.195 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-20T20:27:27.218 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T20:27:27.233 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:27.268 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:27.373 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T20:27:27.400 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T20:27:27.405 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T20:27:27.421 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:27.423 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package zip. 2024-09-20T20:27:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:27:27.449 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-20T20:27:27.455 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:27.490 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking zip (3.0-12build2) ... 2024-09-20T20:27:27.604 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T20:27:27.630 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T20:27:27.671 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:27:27.726 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T20:27:27.752 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:27.793 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:27.793 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package unzip. 2024-09-20T20:27:27.809 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-20T20:27:27.817 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T20:27:27.843 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T20:27:27.844 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:27:27.883 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:27:27.974 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T20:27:28.000 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:28.032 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:28.194 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T20:27:28.221 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:28.238 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2024-09-20T20:27:28.261 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:28.264 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:28.304 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:28.435 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-common. 2024-09-20T20:27:28.458 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package luarocks. 2024-09-20T20:27:28.462 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:28.484 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-20T20:27:28.502 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:28.524 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:27:28.614 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2024-09-20T20:27:28.641 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:28.672 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:28.901 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librgw2. 2024-09-20T20:27:28.945 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../025-librgw2_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:28.968 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:29.529 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rgw. 2024-09-20T20:27:29.544 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:29.587 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:29.876 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2024-09-20T20:27:29.891 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-base. 2024-09-20T20:27:29.902 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:29.908 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-20T20:27:29.917 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:29.924 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-20T20:27:29.960 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:29.967 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:29.967 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:27:30.238 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2024-09-20T20:27:30.265 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:30.270 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libradosstriper1. 2024-09-20T20:27:30.296 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:30.315 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:30.337 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:30.537 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T20:27:30.563 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T20:27:30.603 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:27:30.622 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T20:27:30.648 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T20:27:30.697 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:27:30.757 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-common. 2024-09-20T20:27:30.784 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../029-ceph-common_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:30.825 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:30.882 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T20:27:30.908 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T20:27:30.926 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T20:27:30.948 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:27:30.953 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T20:27:31.000 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T20:27:31.001 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:27:31.026 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T20:27:31.066 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:27:31.271 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T20:27:31.276 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T20:27:31.298 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T20:27:31.302 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T20:27:31.337 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:27:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:27:31.394 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T20:27:31.420 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T20:27:31.460 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:27:31.629 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T20:27:31.655 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T20:27:31.666 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T20:27:31.693 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T20:27:31.695 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:27:31.732 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:27:31.839 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T20:27:31.865 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T20:27:31.913 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:27:31.982 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T20:27:32.008 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T20:27:32.048 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:27:32.149 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-base. 2024-09-20T20:27:32.174 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../030-ceph-base_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:32.177 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T20:27:32.204 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T20:27:32.224 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:32.244 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:27:32.308 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T20:27:32.309 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T20:27:32.334 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T20:27:32.336 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T20:27:32.368 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T20:27:32.383 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:27:32.547 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T20:27:32.574 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T20:27:32.614 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:27:32.694 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T20:27:32.698 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-portend. 2024-09-20T20:27:32.720 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T20:27:32.725 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T20:27:32.761 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T20:27:32.812 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-20T20:27:32.839 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-20T20:27:32.867 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T20:27:32.871 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T20:27:32.879 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:27:32.894 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T20:27:32.933 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T20:27:33.140 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cheroot. 2024-09-20T20:27:33.155 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-20T20:27:33.182 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T20:27:33.190 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:27:33.208 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T20:27:33.237 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-portend. 2024-09-20T20:27:33.249 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T20:27:33.263 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T20:27:33.280 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2024-09-20T20:27:33.303 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T20:27:33.306 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T20:27:33.355 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T20:27:33.461 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-20T20:27:33.474 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-20T20:27:33.512 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:27:33.552 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T20:27:33.578 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T20:27:33.606 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T20:27:33.610 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:27:33.633 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T20:27:33.673 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T20:27:33.724 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T20:27:33.751 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T20:27:33.799 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T20:27:33.947 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T20:27:33.959 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T20:27:33.973 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T20:27:33.986 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T20:27:34.013 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T20:27:34.026 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:27:34.031 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-20T20:27:34.058 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-20T20:27:34.098 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:27:34.127 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T20:27:34.153 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T20:27:34.194 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:27:34.325 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T20:27:34.351 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T20:27:34.368 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-20T20:27:34.388 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T20:27:34.392 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T20:27:34.394 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-20T20:27:34.415 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T20:27:34.426 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:27:34.455 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T20:27:34.556 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T20:27:34.582 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T20:27:34.622 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T20:27:34.703 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T20:27:34.706 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-tempora. 2024-09-20T20:27:34.729 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T20:27:34.732 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-20T20:27:34.742 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T20:27:34.769 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T20:27:34.769 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:27:34.772 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-20T20:27:34.808 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T20:27:34.934 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T20:27:34.960 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T20:27:35.000 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T20:27:35.039 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-mako. 2024-09-20T20:27:35.066 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T20:27:35.067 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-portend. 2024-09-20T20:27:35.094 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-20T20:27:35.106 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:27:35.120 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T20:27:35.134 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-20T20:27:35.146 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T20:27:35.186 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:27:35.261 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T20:27:35.288 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T20:27:35.319 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:27:35.405 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-20T20:27:35.426 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T20:27:35.431 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-20T20:27:35.452 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T20:27:35.463 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-20T20:27:35.490 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-mako. 2024-09-20T20:27:35.492 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:27:35.516 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T20:27:35.565 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:27:35.631 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2024-09-20T20:27:35.657 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T20:27:35.706 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:27:35.742 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-20T20:27:35.768 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-20T20:27:35.770 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T20:27:35.797 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T20:27:35.808 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:27:35.829 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:27:35.885 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T20:27:35.911 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T20:27:35.952 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:27:36.067 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T20:27:36.094 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T20:27:36.134 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:27:36.140 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webob. 2024-09-20T20:27:36.146 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-natsort. 2024-09-20T20:27:36.166 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T20:27:36.172 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-20T20:27:36.207 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:27:36.221 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-20T20:27:36.221 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T20:27:36.248 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T20:27:36.279 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:27:36.436 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T20:27:36.463 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T20:27:36.503 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:27:36.526 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-logutils. 2024-09-20T20:27:36.552 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T20:27:36.552 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-20T20:27:36.578 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T20:27:36.582 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webob. 2024-09-20T20:27:36.592 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-20T20:27:36.609 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T20:27:36.621 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:27:36.649 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:27:36.772 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2024-09-20T20:27:36.788 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T20:27:36.822 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:27:36.895 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-20T20:27:36.922 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-20T20:27:36.938 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T20:27:36.962 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:27:36.964 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T20:27:37.004 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:27:37.027 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T20:27:37.054 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T20:27:37.098 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:27:37.109 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T20:27:37.135 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T20:27:37.179 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:27:37.258 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-mako. 2024-09-20T20:27:37.285 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-20T20:27:37.291 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-paste. 2024-09-20T20:27:37.317 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T20:27:37.325 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:27:37.349 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:27:37.389 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T20:27:37.416 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T20:27:37.455 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:27:37.734 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-paste. 2024-09-20T20:27:37.760 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T20:27:37.792 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:27:38.095 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T20:27:38.111 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T20:27:38.154 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:27:38.362 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T20:27:38.389 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T20:27:38.429 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:27:38.465 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T20:27:38.492 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T20:27:38.520 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T20:27:38.531 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:27:38.535 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T20:27:38.570 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:27:38.613 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-20T20:27:38.639 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-20T20:27:38.680 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:27:38.732 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2024-09-20T20:27:38.758 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T20:27:38.793 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T20:27:38.798 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:27:38.820 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T20:27:38.847 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T20:27:38.851 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T20:27:38.874 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T20:27:38.914 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:27:38.984 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-20T20:27:39.010 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-20T20:27:39.051 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:27:39.113 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T20:27:39.118 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T20:27:39.134 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T20:27:39.140 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T20:27:39.176 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:27:39.180 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:27:39.209 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T20:27:39.236 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T20:27:39.309 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T20:27:39.337 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webob. 2024-09-20T20:27:39.364 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-20T20:27:39.404 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:27:39.479 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T20:27:39.505 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T20:27:39.545 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:27:39.587 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T20:27:39.613 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T20:27:39.645 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:27:39.741 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-waitress. 2024-09-20T20:27:39.767 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-20T20:27:39.810 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:27:39.848 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T20:27:39.864 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T20:27:39.898 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T20:27:39.958 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T20:27:39.985 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T20:27:40.025 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T20:27:40.112 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-tempita. 2024-09-20T20:27:40.138 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-20T20:27:40.143 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T20:27:40.166 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T20:27:40.178 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:27:40.209 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:27:40.327 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T20:27:40.355 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T20:27:40.361 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-idna. 2024-09-20T20:27:40.388 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T20:27:40.394 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T20:27:40.428 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:27:40.465 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-paste. 2024-09-20T20:27:40.491 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-20T20:27:40.532 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:27:40.556 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T20:27:40.582 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T20:27:40.622 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T20:27:40.706 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T20:27:40.722 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-idna. 2024-09-20T20:27:40.732 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T20:27:40.750 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T20:27:40.764 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:27:40.788 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:27:40.828 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-20T20:27:40.855 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-20T20:27:40.895 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:27:40.942 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2024-09-20T20:27:40.968 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T20:27:41.008 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:27:41.075 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T20:27:41.076 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests. 2024-09-20T20:27:41.091 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T20:27:41.102 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T20:27:41.125 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:27:41.133 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:27:41.198 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-20T20:27:41.224 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-20T20:27:41.265 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:27:41.328 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T20:27:41.354 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T20:27:41.394 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:27:41.429 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests. 2024-09-20T20:27:41.429 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T20:27:41.455 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T20:27:41.455 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T20:27:41.487 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:27:41.495 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:27:41.526 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webtest. 2024-09-20T20:27:41.553 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-20T20:27:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-20T20:27:41.723 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2024-09-20T20:27:41.749 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T20:27:41.782 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T20:27:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T20:27:41.789 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:27:41.808 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:41.808 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T20:27:41.848 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:27:41.848 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:41.915 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pecan. 2024-09-20T20:27:41.941 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-20T20:27:41.981 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:27:42.067 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T20:27:42.082 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T20:27:42.116 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:27:42.118 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T20:27:42.133 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:42.168 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:42.228 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T20:27:42.255 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:42.294 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:42.337 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-certifi. 2024-09-20T20:27:42.363 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-20T20:27:42.403 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T20:27:42.403 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-20T20:27:42.418 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:42.461 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:42.606 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T20:27:42.621 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T20:27:42.656 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:27:42.665 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T20:27:42.692 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:42.708 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-idna. 2024-09-20T20:27:42.731 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:42.734 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-20T20:27:42.774 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:27:42.883 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T20:27:42.909 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:42.958 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:43.060 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T20:27:43.087 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T20:27:43.093 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T20:27:43.102 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-urllib3. 2024-09-20T20:27:43.118 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:27:43.122 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T20:27:43.129 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-20T20:27:43.169 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:27:43.184 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T20:27:43.336 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T20:27:43.362 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T20:27:43.404 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T20:27:43.410 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:27:43.431 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T20:27:43.457 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-requests. 2024-09-20T20:27:43.471 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T20:27:43.484 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-20T20:27:43.524 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:27:43.545 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T20:27:43.572 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:43.612 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:43.808 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T20:27:43.834 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:43.836 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-20T20:27:43.862 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-20T20:27:43.874 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:43.902 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:27:43.955 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T20:27:43.981 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T20:27:43.990 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T20:27:44.018 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:44.021 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T20:27:44.048 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:44.189 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-20T20:27:44.215 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:44.236 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T20:27:44.262 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:44.265 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:44.303 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:44.374 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T20:27:44.401 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:44.441 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:44.644 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T20:27:44.671 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-20T20:27:44.672 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:44.698 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:44.710 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:44.737 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:44.882 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T20:27:44.894 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T20:27:44.908 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:44.920 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:44.948 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:44.968 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:45.050 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-20T20:27:45.077 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-20T20:27:45.125 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:27:45.420 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-openssl. 2024-09-20T20:27:45.446 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-20T20:27:45.486 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-20T20:27:45.672 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T20:27:45.699 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:45.739 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:45.755 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph. 2024-09-20T20:27:45.782 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:45.822 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:45.832 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr. 2024-09-20T20:27:45.859 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:45.898 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:45.985 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2024-09-20T20:27:46.000 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:46.066 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:46.135 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T20:27:46.161 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:46.201 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:46.278 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mon. 2024-09-20T20:27:46.294 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:46.328 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:46.371 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T20:27:46.397 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:46.429 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:46.571 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T20:27:46.598 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:46.637 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:46.766 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T20:27:46.766 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2024-09-20T20:27:46.793 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:46.793 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:46.832 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:46.833 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:46.991 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-osd. 2024-09-20T20:27:47.018 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:47.032 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephadm. 2024-09-20T20:27:47.056 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:47.057 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:47.090 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:47.203 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T20:27:47.229 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:47.236 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephadm. 2024-09-20T20:27:47.262 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:47.277 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:47.302 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:47.393 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T20:27:47.420 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T20:27:47.460 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T20:27:47.703 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T20:27:47.730 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T20:27:47.739 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T20:27:47.754 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T20:27:47.763 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T20:27:47.766 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:47.770 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:27:47.804 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:27:47.814 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:48.066 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T20:27:48.079 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph. 2024-09-20T20:27:48.082 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:27:48.094 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../066-ceph_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:48.125 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:27:48.137 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:48.192 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2024-09-20T20:27:48.218 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:48.258 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:48.407 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-fuse. 2024-09-20T20:27:48.434 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:48.473 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:48.578 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T20:27:48.604 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T20:27:48.661 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T20:27:48.809 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-babel. 2024-09-20T20:27:48.835 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:27:48.877 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mds. 2024-09-20T20:27:48.883 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:27:48.905 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:48.946 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:49.155 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-babel. 2024-09-20T20:27:49.155 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T20:27:49.182 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:27:49.182 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:27:49.203 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T20:27:49.221 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:27:49.222 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:27:49.230 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T20:27:49.269 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:27:49.533 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T20:27:49.560 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T20:27:49.589 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T20:27:49.599 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:27:49.616 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:49.624 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephadm. 2024-09-20T20:27:49.647 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:49.650 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../069-cephadm_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:27:49.698 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:49.945 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T20:27:49.972 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:49.984 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T20:27:50.002 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-20T20:27:50.011 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:50.011 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T20:27:50.031 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-20T20:27:50.042 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T20:27:50.068 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-20T20:27:50.185 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2024-09-20T20:27:50.212 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:27:50.243 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:27:50.331 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T20:27:50.347 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T20:27:50.361 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-routes. 2024-09-20T20:27:50.381 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-20T20:27:50.381 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T20:27:50.388 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T20:27:50.407 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:27:50.428 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:27:50.447 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:27:50.563 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T20:27:50.578 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T20:27:50.621 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:27:50.668 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-routes. 2024-09-20T20:27:50.695 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T20:27:50.723 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T20:27:50.734 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:27:50.736 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:50.764 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:50.958 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T20:27:50.984 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:50.988 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T20:27:51.014 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:51.024 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:51.046 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:51.369 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T20:27:51.396 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T20:27:51.435 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T20:27:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2024-09-20T20:27:51.765 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T20:27:51.787 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-babel. 2024-09-20T20:27:51.805 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:27:51.814 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-20T20:27:51.853 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:27:51.978 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T20:27:51.994 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T20:27:52.036 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:27:52.150 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T20:27:52.176 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:52.200 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jinja2. 2024-09-20T20:27:52.216 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:52.227 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-20T20:27:52.266 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:27:52.326 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T20:27:52.342 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T20:27:52.385 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:27:52.539 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T20:27:52.566 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T20:27:52.603 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-20T20:27:52.606 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:27:52.630 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:52.669 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:52.951 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T20:27:52.978 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T20:27:53.008 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-20T20:27:53.013 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T20:27:53.017 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:27:53.029 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T20:27:53.035 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-20T20:27:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:27:53.074 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-20T20:27:53.320 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T20:27:53.348 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T20:27:53.378 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-routes. 2024-09-20T20:27:53.394 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:27:53.405 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-20T20:27:53.409 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T20:27:53.436 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T20:27:53.444 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:27:53.467 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:27:53.497 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T20:27:53.513 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T20:27:53.554 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:27:53.765 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-20T20:27:53.791 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:53.804 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T20:27:53.831 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T20:27:53.831 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:53.871 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:27:54.058 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T20:27:54.085 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T20:27:54.125 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:27:54.213 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T20:27:54.240 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:54.365 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:54.503 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T20:27:54.535 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T20:27:54.569 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:27:54.638 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T20:27:54.667 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:54.791 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:54.847 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T20:27:54.874 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T20:27:54.905 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:27:55.285 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T20:27:55.312 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T20:27:55.339 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-20T20:27:55.351 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T20:27:55.366 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-20T20:27:55.405 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:27:55.596 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T20:27:55.611 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T20:27:55.639 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T20:27:55.645 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:27:55.666 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:55.799 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:55.885 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-joblib. 2024-09-20T20:27:55.901 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-20T20:27:55.928 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T20:27:55.944 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:27:55.956 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T20:27:55.966 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T20:27:55.993 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T20:27:55.994 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T20:27:56.032 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:27:56.281 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-20T20:27:56.298 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T20:27:56.310 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-20T20:27:56.325 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T20:27:56.347 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:27:56.352 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T20:27:56.364 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:27:56.379 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T20:27:56.418 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T20:27:56.634 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-sklearn. 2024-09-20T20:27:56.660 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-20T20:27:56.693 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T20:27:56.700 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:27:56.720 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T20:27:56.755 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T20:27:56.759 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:27:56.761 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T20:27:56.782 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T20:27:56.788 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T20:27:56.822 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T20:27:56.827 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T20:27:57.071 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T20:27:57.099 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T20:27:57.116 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T20:27:57.137 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T20:27:57.139 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T20:27:57.144 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T20:27:57.166 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T20:27:57.183 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:27:57.205 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:27:57.425 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T20:27:57.452 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T20:27:57.469 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T20:27:57.479 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-20T20:27:57.491 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T20:27:57.497 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T20:27:57.507 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:57.536 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T20:27:57.550 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T20:27:57.578 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T20:27:57.616 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:27:57.632 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:57.829 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T20:27:57.856 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T20:27:57.895 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:27:57.928 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T20:27:57.955 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T20:27:57.981 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T20:27:57.994 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T20:27:58.009 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T20:27:58.047 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:27:58.207 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T20:27:58.234 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T20:27:58.256 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T20:27:58.273 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T20:27:58.283 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T20:27:58.314 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T20:27:58.609 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T20:27:58.610 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T20:27:58.636 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T20:27:58.637 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T20:27:58.675 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:27:58.685 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:27:58.711 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T20:27:58.727 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:58.761 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:58.919 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cachetools. 2024-09-20T20:27:58.946 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-20T20:27:58.985 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-20T20:27:59.003 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T20:27:59.031 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T20:27:59.070 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T20:27:59.089 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T20:27:59.116 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T20:27:59.155 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:27:59.281 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-20T20:27:59.308 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-20T20:27:59.333 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T20:27:59.348 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:27:59.360 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:27:59.399 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:27:59.405 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T20:27:59.432 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T20:27:59.492 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T20:27:59.519 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:27:59.558 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:27:59.598 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:27:59.651 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-20T20:27:59.678 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-20T20:27:59.702 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T20:27:59.729 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T20:27:59.760 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:27:59.819 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package jq. 2024-09-20T20:27:59.835 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:27:59.877 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T20:27:59.970 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:28:00.081 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T20:28:00.108 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:28:00.139 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package socat. 2024-09-20T20:28:00.147 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:28:00.167 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T20:28:00.205 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:28:00.271 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rsa. 2024-09-20T20:28:00.298 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-20T20:28:00.304 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T20:28:00.331 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:28:00.337 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-20T20:28:00.370 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:00.401 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2024-09-20T20:28:00.427 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:28:00.466 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T20:28:00.516 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T20:28:00.533 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T20:28:00.575 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:28:00.643 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-google-auth. 2024-09-20T20:28:00.670 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-20T20:28:00.706 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T20:28:00.709 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-20T20:28:00.727 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2024-09-20T20:28:00.733 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T20:28:00.744 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T20:28:00.772 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:28:00.786 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:28:00.895 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-test. 2024-09-20T20:28:00.912 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:00.954 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:01.013 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-20T20:28:01.040 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-20T20:28:01.051 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T20:28:01.064 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T20:28:01.078 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:28:01.079 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:28:01.080 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T20:28:01.109 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:28:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:28:01.351 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-websocket. 2024-09-20T20:28:01.361 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2024-09-20T20:28:01.377 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:28:01.378 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-20T20:28:01.417 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-20T20:28:01.419 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T20:28:01.486 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2024-09-20T20:28:01.514 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:01.552 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:01.680 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2024-09-20T20:28:01.696 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T20:28:01.721 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-20T20:28:01.739 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:28:01.748 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-20T20:28:01.788 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:28:02.059 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T20:28:02.075 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T20:28:02.117 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:28:02.446 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2024-09-20T20:28:02.469 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:02.521 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:02.536 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-20T20:28:02.553 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:28:02.595 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:02.915 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-20T20:28:02.941 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-20T20:28:02.981 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:28:03.225 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T20:28:03.252 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:28:03.291 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:03.319 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-20T20:28:03.346 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:28:03.385 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:28:03.628 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T20:28:03.638 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package jq. 2024-09-20T20:28:03.645 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:03.654 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-20T20:28:03.688 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-20T20:28:03.895 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:03.925 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package socat. 2024-09-20T20:28:03.949 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T20:28:03.952 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-20T20:28:03.977 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:28:03.991 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:28:04.015 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:04.206 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T20:28:04.233 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T20:28:04.273 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:28:04.288 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package xmlstarlet. 2024-09-20T20:28:04.315 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-20T20:28:04.328 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T20:28:04.344 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:04.354 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:28:04.386 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:04.586 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T20:28:04.613 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T20:28:04.652 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:28:04.692 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-test. 2024-09-20T20:28:04.697 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T20:28:04.719 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../097-ceph-test_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:04.725 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T20:28:04.758 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:04.764 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:28:04.875 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T20:28:04.903 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:28:04.941 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:05.014 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T20:28:05.042 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T20:28:05.069 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T20:28:05.080 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:28:05.085 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T20:28:05.119 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:28:05.228 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T20:28:05.244 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:05.498 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T20:28:05.511 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package pkg-config. 2024-09-20T20:28:05.526 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T20:28:05.538 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T20:28:05.565 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:28:05.577 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:28:05.615 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T20:28:05.642 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T20:28:05.681 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:28:05.838 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T20:28:05.854 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T20:28:05.897 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:28:05.987 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package pkg-config. 2024-09-20T20:28:06.015 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T20:28:06.019 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T20:28:06.046 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T20:28:06.053 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:28:06.085 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:28:06.308 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T20:28:06.315 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T20:28:06.335 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T20:28:06.343 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T20:28:06.374 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T20:28:06.381 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:28:06.498 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T20:28:06.525 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T20:28:06.572 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:28:06.669 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T20:28:06.696 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T20:28:06.760 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T20:28:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T20:28:06.838 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T20:28:06.877 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T20:28:06.936 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pkg-config. 2024-09-20T20:28:06.963 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T20:28:07.002 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:28:07.080 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T20:28:07.108 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T20:28:07.138 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:28:07.163 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T20:28:07.191 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T20:28:07.230 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T20:28:07.249 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T20:28:07.265 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T20:28:07.307 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:28:07.432 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-volume. 2024-09-20T20:28:07.441 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T20:28:07.459 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-367-g9e2ac70b-1jammy_all.deb ... 2024-09-20T20:28:07.469 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T20:28:07.507 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:07.508 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T20:28:07.525 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T20:28:07.553 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T20:28:07.600 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:28:07.743 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T20:28:07.771 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T20:28:07.794 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-20T20:28:07.809 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T20:28:07.822 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:07.844 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-py. 2024-09-20T20:28:07.861 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:07.872 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T20:28:07.895 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T20:28:07.911 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T20:28:07.922 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T20:28:07.961 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T20:28:08.112 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T20:28:08.140 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T20:28:08.163 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T20:28:08.165 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-20T20:28:08.178 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T20:28:08.180 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T20:28:08.192 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-20T20:28:08.214 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:28:08.231 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:28:08.273 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-py. 2024-09-20T20:28:08.301 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T20:28:08.339 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T20:28:08.482 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T20:28:08.498 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T20:28:08.532 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:28:08.570 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-20T20:28:08.597 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-20T20:28:08.626 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T20:28:08.634 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T20:28:08.636 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:28:08.654 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T20:28:08.662 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T20:28:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:28:08.693 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:28:08.810 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T20:28:08.837 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T20:28:08.876 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T20:28:08.995 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-toml. 2024-09-20T20:28:09.017 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package nvme-cli. 2024-09-20T20:28:09.023 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T20:28:09.044 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-20T20:28:09.062 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T20:28:09.092 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:28:09.141 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T20:28:09.168 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T20:28:09.196 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2024-09-20T20:28:09.207 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:28:09.223 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T20:28:09.262 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T20:28:09.365 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T20:28:09.392 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T20:28:09.431 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:28:09.489 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package pkg-config. 2024-09-20T20:28:09.517 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-20T20:28:09.518 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-toml. 2024-09-20T20:28:09.546 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T20:28:09.549 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T20:28:09.564 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:28:09.564 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T20:28:09.585 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T20:28:09.598 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:28:09.777 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T20:28:09.804 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T20:28:09.818 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-20T20:28:09.834 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-20T20:28:09.843 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:28:09.868 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:28:09.896 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T20:28:09.924 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T20:28:09.963 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:28:10.061 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T20:28:10.089 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T20:28:10.120 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T20:28:10.127 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:28:10.136 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T20:28:10.178 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:28:10.280 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-20T20:28:10.308 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-20T20:28:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T20:28:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T20:28:10.346 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-20T20:28:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:28:10.472 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2024-09-20T20:28:10.499 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T20:28:10.538 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T20:28:10.643 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pastescript. 2024-09-20T20:28:10.669 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T20:28:10.670 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-20T20:28:10.697 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T20:28:10.709 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-20T20:28:10.736 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:28:10.824 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T20:28:10.840 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T20:28:10.874 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:28:10.907 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package radosgw. 2024-09-20T20:28:10.935 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:10.974 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:11.013 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pluggy. 2024-09-20T20:28:11.040 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-20T20:28:11.079 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:28:11.211 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T20:28:11.238 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T20:28:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:28:11.383 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-psutil. 2024-09-20T20:28:11.410 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-20T20:28:11.449 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-20T20:28:11.482 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2024-09-20T20:28:11.510 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T20:28:11.548 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T20:28:11.629 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:28:11.804 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-py. 2024-09-20T20:28:11.831 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-20T20:28:11.851 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T20:28:11.870 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:11.871 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-20T20:28:11.910 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:12.191 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pygments. 2024-09-20T20:28:12.214 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T20:28:12.218 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-20T20:28:12.257 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:28:12.360 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T20:28:12.376 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:12.384 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2024-09-20T20:28:12.410 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:12.411 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:12.450 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:12.456 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:28:12.582 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:28:12.699 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T20:28:12.755 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-20T20:28:12.782 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-20T20:28:12.821 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:28:12.848 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T20:28:12.949 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:28:13.075 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:28:13.132 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-toml. 2024-09-20T20:28:13.160 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-20T20:28:13.173 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T20:28:13.199 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-20T20:28:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T20:28:13.252 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:13.285 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:13.334 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T20:28:13.477 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pytest. 2024-09-20T20:28:13.506 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-20T20:28:13.543 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:28:13.581 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T20:28:13.616 INFO:teuthology.orchestra.run.smithi187.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T20:28:13.691 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T20:28:13.727 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:13.832 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:28:13.882 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-simplejson. 2024-09-20T20:28:13.909 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-20T20:28:13.948 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:28:13.958 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:28:14.119 INFO:teuthology.orchestra.run.smithi079.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T20:28:14.194 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:14.216 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T20:28:14.218 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-20T20:28:14.234 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-20T20:28:14.276 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:28:14.537 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T20:28:14.711 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user cephadm....done 2024-09-20T20:28:14.824 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user cephadm....done 2024-09-20T20:28:14.867 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:28:14.948 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T20:28:15.015 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package radosgw. 2024-09-20T20:28:15.042 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:28:15.043 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../116-radosgw_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:15.077 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:15.082 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:15.135 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:28:15.367 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:28:15.445 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:28:15.560 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2024-09-20T20:28:15.571 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:28:15.618 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:28:15.744 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:28:15.809 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:28:15.823 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T20:28:16.004 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T20:28:16.082 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:28:16.152 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package rbd-fuse. 2024-09-20T20:28:16.179 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-367-g9e2ac70b-1jammy_amd64.deb ... 2024-09-20T20:28:16.205 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:28:16.208 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T20:28:16.227 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:28:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T20:28:16.517 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-20T20:28:16.546 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:28:16.594 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:28:16.640 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:28:16.754 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:28:16.784 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-20T20:28:16.902 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-20T20:28:16.954 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T20:28:17.026 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T20:28:17.097 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T20:28:17.139 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-20T20:28:17.214 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T20:28:17.285 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T20:28:17.381 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:28:17.457 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-20T20:28:17.482 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:28:17.507 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T20:28:17.561 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:28:17.733 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:28:17.809 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:28:17.866 INFO:teuthology.orchestra.run.smithi090.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-20T20:28:17.871 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:28:17.937 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:17.993 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:28:18.114 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:28:18.152 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T20:28:18.244 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:28:18.365 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:28:18.412 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T20:28:18.447 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user cephadm....done 2024-09-20T20:28:18.495 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:18.587 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-20T20:28:18.616 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:18.679 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:28:18.755 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:28:18.847 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-20T20:28:18.881 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:28:18.884 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:28:18.932 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:28:19.007 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:28:19.010 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:28:19.098 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-20T20:28:19.116 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:28:19.136 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:28:19.199 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:28:19.225 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-20T20:28:19.262 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:28:19.351 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:28:19.450 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:28:19.477 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-20T20:28:19.530 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:28:19.708 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T20:28:19.709 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:19.711 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-20T20:28:19.741 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T20:28:19.805 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:28:19.829 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-20T20:28:19.952 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:28:19.956 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T20:28:20.061 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:28:20.067 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T20:28:20.120 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T20:28:20.131 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-20T20:28:20.174 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:28:20.195 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:28:20.309 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T20:28:20.321 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:28:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:28:20.450 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T20:28:20.491 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-20T20:28:20.598 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:28:20.685 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:28:20.710 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:28:20.744 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-20T20:28:20.811 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T20:28:20.961 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:28:21.003 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-20T20:28:21.007 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T20:28:21.038 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T20:28:21.071 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:28:21.100 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:28:21.227 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T20:28:21.262 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T20:28:21.263 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-20T20:28:21.322 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:28:21.389 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:28:21.515 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-20T20:28:21.586 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:28:21.606 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T20:28:21.712 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T20:28:21.732 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:28:21.774 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-20T20:28:21.980 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:28:22.025 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-argparse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:22.041 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:28:22.256 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:28:22.278 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-20T20:28:22.283 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:28:22.384 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:28:22.387 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-20T20:28:22.459 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:28:22.513 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-20T20:28:22.519 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:28:22.557 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T20:28:22.640 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-20T20:28:22.683 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:28:22.719 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:28:22.812 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T20:28:22.845 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:28:22.891 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-20T20:28:22.971 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:28:23.188 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T20:28:23.288 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T20:28:23.358 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-20T20:28:23.385 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:28:23.389 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-20T20:28:23.440 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:28:23.454 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-20T20:28:23.555 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-20T20:28:23.627 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:28:23.690 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T20:28:23.753 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:28:23.817 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:28:23.879 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:28:23.923 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-20T20:28:23.924 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:28:24.049 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-20T20:28:24.110 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:28:24.256 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T20:28:24.309 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:28:24.343 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-20T20:28:24.478 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:28:24.602 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-20T20:28:24.610 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:28:24.649 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T20:28:24.713 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:28:24.839 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:24.896 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up zip (3.0-12build2) ... 2024-09-20T20:28:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:28:24.962 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:28:25.022 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-20T20:28:25.140 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:28:25.196 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:28:25.276 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:28:25.322 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:25.458 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:28:25.560 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:28:25.607 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:28:25.733 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-20T20:28:25.912 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:28:25.933 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:28:25.993 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-20T20:28:26.119 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-20T20:28:26.163 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:28:26.228 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-20T20:28:26.289 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:26.506 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-20T20:28:26.590 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:28:26.648 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:28:26.882 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-20T20:28:26.891 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:28:26.899 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:27.033 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T20:28:27.113 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:28:27.125 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-20T20:28:27.293 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:28:27.356 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:27.419 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:28:27.491 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T20:28:27.502 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-20T20:28:27.545 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:28:27.767 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:28:27.795 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-20T20:28:27.847 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:28:27.893 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:28:28.019 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:28:28.038 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:28:28.098 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T20:28:28.138 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-20T20:28:28.298 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:28.312 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:28:28.349 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:28.382 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-20T20:28:28.424 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T20:28:28.475 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:28:28.509 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:28.563 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T20:28:28.675 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:28:28.777 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:28:28.784 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:28:28.797 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:28.810 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-20T20:28:28.894 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:28:28.907 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:28:29.028 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T20:28:29.128 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-20T20:28:29.195 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:28:29.210 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:28:29.321 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T20:28:29.455 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T20:28:29.462 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T20:28:29.680 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:28:29.706 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:29.721 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T20:28:29.815 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:28:30.124 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T20:28:30.133 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:28:30.261 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-20T20:28:30.313 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:28:30.383 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:28:30.392 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T20:28:30.509 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T20:28:30.521 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:30.556 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T20:28:30.630 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-20T20:28:30.660 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T20:28:30.785 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:28:30.849 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:28:30.873 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-20T20:28:30.895 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:28:30.928 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:28:30.975 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T20:28:31.179 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T20:28:31.213 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:28:31.276 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:28:31.350 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-20T20:28:31.402 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:28:31.447 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:28:31.477 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-20T20:28:31.531 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:28:31.573 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T20:28:31.695 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:28:31.770 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-20T20:28:31.790 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:28:31.849 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:28:31.916 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:28:31.950 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:28:31.971 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:28:32.004 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-20T20:28:32.042 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:28:32.156 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T20:28:32.214 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:28:32.226 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:28:32.231 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:32.323 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:28:32.357 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-20T20:28:32.386 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:28:32.449 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:28:32.510 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:28:32.512 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:28:32.564 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T20:28:32.659 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-20T20:28:32.778 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:28:32.809 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:28:32.904 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:28:32.911 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-20T20:28:32.913 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:28:32.944 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:28:33.038 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:28:33.127 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T20:28:33.173 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T20:28:33.187 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-20T20:28:33.299 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T20:28:33.350 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:28:33.356 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:28:33.422 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-20T20:28:33.507 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:28:33.542 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:33.605 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T20:28:33.648 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-20T20:28:33.660 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:28:33.714 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T20:28:33.892 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:28:33.908 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-20T20:28:33.965 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:33.986 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:28:34.034 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-20T20:28:34.091 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:28:34.151 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T20:28:34.278 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T20:28:34.279 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:28:34.311 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-20T20:28:34.410 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:28:34.413 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-20T20:28:34.545 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:34.547 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T20:28:34.673 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T20:28:34.680 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:28:34.697 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-20T20:28:34.718 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:28:34.958 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T20:28:34.973 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-20T20:28:35.006 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:28:35.053 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T20:28:35.171 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T20:28:35.217 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-20T20:28:35.234 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:28:35.298 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:28:35.342 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-20T20:28:35.421 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T20:28:35.469 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-20T20:28:35.558 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-20T20:28:35.566 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T20:28:35.579 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:28:35.674 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:28:35.692 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T20:28:35.789 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-20T20:28:35.915 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-20T20:28:35.956 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T20:28:35.968 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T20:28:36.018 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:28:36.236 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:28:36.249 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:28:36.292 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-20T20:28:36.436 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T20:28:36.602 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:28:36.606 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:28:36.720 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:36.721 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:28:36.768 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-20T20:28:36.863 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:36.894 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-20T20:28:36.982 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T20:28:36.989 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:28:37.048 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:28:37.145 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-20T20:28:37.174 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.272 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:28:37.272 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-20T20:28:37.300 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.326 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.426 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:28:37.443 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.561 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T20:28:37.590 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-20T20:28:37.636 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:28:37.729 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.762 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.830 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.838 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.888 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:37.892 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-20T20:28:37.939 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T20:28:37.964 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.014 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:28:38.090 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.176 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-20T20:28:38.216 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.300 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T20:28:38.300 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T20:28:38.302 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-20T20:28:38.342 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.358 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.467 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.484 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.570 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-20T20:28:38.577 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T20:28:38.697 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T20:28:38.698 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T20:28:38.767 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.822 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-20T20:28:38.853 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.885 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:38.988 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:39.114 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:39.137 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:28:39.168 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-20T20:28:39.186 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:39.314 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:39.327 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T20:28:39.327 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T20:28:39.463 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:39.537 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-20T20:28:39.589 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:28:39.822 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-20T20:28:39.831 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:39.932 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.058 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.159 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-20T20:28:40.159 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:28:40.285 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librados2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.341 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.411 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libsqlite3-mod-ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.467 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.538 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-20T20:28:40.593 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.695 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.796 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.817 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.849 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.952 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:40.976 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libradosstriper1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.070 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.102 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-20T20:28:41.170 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.272 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.346 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.379 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librbd1 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2024-09-20T20:28:41.464 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.505 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-modules-core (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.573 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.632 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.674 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.758 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2024-09-20T20:28:41.790 INFO:teuthology.orchestra.run.smithi187.stdout:Adding group ceph....done 2024-09-20T20:28:41.800 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:41.863 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T20:28:41.863 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-20T20:28:41.884 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2024-09-20T20:28:41.902 INFO:teuthology.orchestra.run.smithi079.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T20:28:42.040 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T20:28:42.132 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user ceph....done 2024-09-20T20:28:42.301 INFO:teuthology.orchestra.run.smithi187.stdout:Setting system user ceph properties....done 2024-09-20T20:28:42.314 INFO:teuthology.orchestra.run.smithi187.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T20:28:42.350 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs-dev (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:42.351 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2024-09-20T20:28:42.378 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T20:28:42.449 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T20:28:42.460 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rados (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:42.595 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librgw2 (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:42.721 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-20T20:28:42.727 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2024-09-20T20:28:42.762 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T20:28:42.823 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:42.896 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2024-09-20T20:28:42.914 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T20:28:42.949 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:43.053 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T20:28:43.239 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:43.379 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T20:28:43.380 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T20:28:43.390 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:43.392 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T20:28:43.835 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:43.844 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T20:28:43.844 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T20:28:43.851 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:43.892 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rbd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:43.977 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:44.018 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up rbd-fuse (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:44.145 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:44.185 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T20:28:44.263 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cephfs (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:44.276 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:44.364 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-common (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:44.437 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T20:28:44.437 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T20:28:44.628 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:44.641 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T20:28:44.849 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T20:28:44.849 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T20:28:44.895 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:44.899 INFO:teuthology.orchestra.run.smithi090.stdout:Adding group ceph....done 2024-09-20T20:28:45.111 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:45.261 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user ceph....done 2024-09-20T20:28:45.272 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T20:28:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T20:28:45.405 INFO:teuthology.orchestra.run.smithi090.stdout:Setting system user ceph properties....done 2024-09-20T20:28:45.411 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T20:28:45.418 INFO:teuthology.orchestra.run.smithi090.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-20T20:28:45.485 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T20:28:45.485 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T20:28:45.551 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-20T20:28:45.821 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:45.860 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-20T20:28:45.878 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:45.932 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:46.048 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T20:28:46.049 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T20:28:46.113 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T20:28:46.113 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T20:28:46.181 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T20:28:46.181 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T20:28:46.309 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-test (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:46.436 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up radosgw (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:46.530 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:46.591 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:46.700 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:46.808 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T20:28:46.808 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T20:28:46.835 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:46.845 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T20:28:46.845 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T20:28:46.986 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:47.068 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T20:28:47.069 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-20T20:28:47.198 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T20:28:47.199 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T20:28:47.283 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:47.332 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:47.475 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:47.514 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-base (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:47.562 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T20:28:47.563 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T20:28:47.626 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:47.679 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:47.822 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:47.840 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T20:28:47.840 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T20:28:47.863 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-20T20:28:47.939 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.027 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.091 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.152 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.312 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.344 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.383 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mds (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.443 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T20:28:48.478 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.533 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T20:28:48.533 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T20:28:48.553 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T20:28:48.579 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:48.640 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T20:28:48.640 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-20T20:28:48.689 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T20:28:48.714 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:49.013 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:49.058 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T20:28:49.126 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:49.147 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:49.167 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T20:28:49.248 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:49.311 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T20:28:49.311 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-20T20:28:49.328 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T20:28:49.383 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:49.735 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T20:28:49.762 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-osd (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:49.816 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T20:28:49.853 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T20:28:50.005 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T20:28:50.037 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T20:28:50.037 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-20T20:28:50.378 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T20:28:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T20:28:50.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-20T20:28:50.465 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-k8sevents (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:50.542 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-20T20:28:50.591 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:50.742 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mon (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:50.754 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-20T20:28:50.755 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-20T20:28:50.952 INFO:teuthology.orchestra.run.smithi079.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-20T20:28:50.952 INFO:teuthology.orchestra.run.smithi079.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-20T20:28:50.952 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:28:50.952 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:28:50.953 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:28:50.953 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:28:50.953 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:28:50.953 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:28:50.953 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:28:50.954 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T20:28:50.954 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-20T20:28:50.954 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-20T20:28:50.954 INFO:teuthology.orchestra.run.smithi079.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-20T20:28:50.955 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-20T20:28:50.955 INFO:teuthology.orchestra.run.smithi079.stdout: bison-doc flex-doc libssl-doc 2024-09-20T20:28:50.984 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-20T20:28:50.985 INFO:teuthology.orchestra.run.smithi079.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-20T20:28:50.986 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2024-09-20T20:28:50.987 INFO:teuthology.orchestra.run.smithi079.stdout: libssl3 libuuid1 uuid-dev 2024-09-20T20:28:51.067 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T20:28:51.070 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-20T20:28:51.128 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-20T20:28:51.166 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 7 newly installed, 0 to remove and 329 not upgraded. 2024-09-20T20:28:51.166 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 5,494 kB of archives. 2024-09-20T20:28:51.166 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-20T20:28:51.166 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-20T20:28:51.314 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T20:28:51.339 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-20T20:28:51.340 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-20T20:28:51.394 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-cephadm (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:51.520 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:51.538 INFO:teuthology.orchestra.run.smithi187.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-20T20:28:51.538 INFO:teuthology.orchestra.run.smithi187.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-20T20:28:51.538 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:28:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:28:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:28:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:28:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:28:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:28:51.539 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:28:51.539 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-20T20:28:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-20T20:28:51.541 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-20T20:28:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: bison-doc flex-doc libssl-doc 2024-09-20T20:28:51.571 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-20T20:28:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-20T20:28:51.574 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2024-09-20T20:28:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: libssl3 libuuid1 uuid-dev 2024-09-20T20:28:51.626 INFO:teuthology.orchestra.run.smithi187.stdout:3 upgraded, 7 newly installed, 0 to remove and 329 not upgraded. 2024-09-20T20:28:51.626 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 5,494 kB of archives. 2024-09-20T20:28:51.626 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-20T20:28:51.626 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-20T20:28:51.637 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-20T20:28:51.646 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-dashboard (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:51.729 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-20T20:28:51.788 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-volume (19.1.1-367-g9e2ac70b-1jammy) ... 2024-09-20T20:28:51.791 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-20T20:28:51.792 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-20T20:28:51.793 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-20T20:28:51.807 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-20T20:28:51.807 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-20T20:28:51.808 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-20T20:28:51.809 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-20T20:28:51.809 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-20T20:28:51.893 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-20T20:28:51.894 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-20T20:28:51.895 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-20T20:28:51.928 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-20T20:28:51.929 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-20T20:28:51.931 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-20T20:28:51.932 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-20T20:28:51.932 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-20T20:28:52.012 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T20:28:52.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-20T20:28:52.076 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-20T20:28:52.127 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-20T20:28:52.181 INFO:teuthology.orchestra.run.smithi187.stdout:Preconfiguring packages ... 2024-09-20T20:28:52.244 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T20:28:52.275 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 5,494 kB in 0s (21.3 MB/s) 2024-09-20T20:28:52.287 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-20T20:28:52.288 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-20T20:28:52.346 INFO:teuthology.orchestra.run.smithi079.stdout:Preconfiguring packages ... 2024-09-20T20:28:52.397 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T20:28:52.417 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package flex. 2024-09-20T20:28:52.454 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 5,494 kB in 1s (5,438 kB/s) 2024-09-20T20:28:52.487 INFO:teuthology.orchestra.run.smithi070.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-20T20:28:52.487 INFO:teuthology.orchestra.run.smithi070.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-20T20:28:52.487 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:28:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:28:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:28:52.487 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:28:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:28:52.488 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:28:52.488 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:28:52.488 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-20T20:28:52.489 INFO:teuthology.orchestra.run.smithi070.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-20T20:28:52.491 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-20T20:28:52.491 INFO:teuthology.orchestra.run.smithi070.stdout: bison-doc flex-doc libssl-doc 2024-09-20T20:28:52.511 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-20T20:28:52.517 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:52.520 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-20T20:28:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-20T20:28:52.522 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-09-20T20:28:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: libssl3 libuuid1 uuid-dev 2024-09-20T20:28:52.557 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-20T20:28:52.588 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package flex. 2024-09-20T20:28:52.679 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-20T20:28:52.685 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:52.702 INFO:teuthology.orchestra.run.smithi070.stdout:3 upgraded, 7 newly installed, 0 to remove and 329 not upgraded. 2024-09-20T20:28:52.702 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 5,494 kB of archives. 2024-09-20T20:28:52.702 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-20T20:28:52.703 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-20T20:28:52.737 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-20T20:28:53.082 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T20:28:53.230 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-20T20:28:53.259 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-20T20:28:53.295 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T20:28:53.468 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-20T20:28:53.516 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-20T20:28:53.518 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-20T20:28:53.519 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-20T20:28:53.541 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T20:28:53.554 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-20T20:28:53.555 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-20T20:28:53.558 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-20T20:28:53.559 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-20T20:28:53.559 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-20T20:28:53.650 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:28:53.897 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:28:53.960 INFO:teuthology.orchestra.run.smithi070.stdout:Preconfiguring packages ... 2024-09-20T20:28:54.068 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 5,494 kB in 1s (5,005 kB/s) 2024-09-20T20:28:54.219 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package flex. 2024-09-20T20:28:54.252 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T20:28:54.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-20T20:28:54.295 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T20:28:54.301 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T20:28:54.311 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2024-09-20T20:28:54.316 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-20T20:28:54.322 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:54.376 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-20T20:28:54.389 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T20:28:54.395 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T20:28:54.421 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T20:28:54.512 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2024-09-20T20:28:54.512 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2024-09-20T20:28:54.526 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T20:28:54.695 INFO:teuthology.orchestra.run.smithi090.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-20T20:28:54.696 INFO:teuthology.orchestra.run.smithi090.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-20T20:28:54.696 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2024-09-20T20:28:54.696 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-20T20:28:54.696 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-20T20:28:54.696 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-20T20:28:54.696 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-20T20:28:54.696 INFO:teuthology.orchestra.run.smithi090.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-20T20:28:54.697 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-20T20:28:54.697 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2024-09-20T20:28:54.698 INFO:teuthology.orchestra.run.smithi090.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-20T20:28:54.699 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2024-09-20T20:28:54.699 INFO:teuthology.orchestra.run.smithi090.stdout: bison-doc flex-doc libssl-doc 2024-09-20T20:28:54.729 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2024-09-20T20:28:54.730 INFO:teuthology.orchestra.run.smithi090.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-20T20:28:54.731 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2024-09-20T20:28:54.732 INFO:teuthology.orchestra.run.smithi090.stdout: libssl3 libuuid1 uuid-dev 2024-09-20T20:28:54.782 INFO:teuthology.orchestra.run.smithi090.stdout:3 upgraded, 7 newly installed, 0 to remove and 329 not upgraded. 2024-09-20T20:28:54.783 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 5,494 kB of archives. 2024-09-20T20:28:54.783 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-20T20:28:54.783 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-20T20:28:54.838 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T20:28:54.883 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-20T20:28:54.943 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-20T20:28:54.944 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-20T20:28:54.944 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T20:28:54.945 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-20T20:28:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-20T20:28:54.959 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-20T20:28:54.960 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-20T20:28:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-20T20:28:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-20T20:28:54.977 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T20:28:55.042 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T20:28:55.084 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T20:28:55.232 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-20T20:28:55.296 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T20:28:55.324 INFO:teuthology.orchestra.run.smithi090.stdout:Preconfiguring packages ... 2024-09-20T20:28:55.413 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T20:28:55.420 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 5,494 kB in 0s (21.8 MB/s) 2024-09-20T20:28:55.558 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package flex. 2024-09-20T20:28:55.651 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:28:55.658 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-20T20:28:55.663 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:55.714 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-20T20:28:55.754 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package bison. 2024-09-20T20:28:55.860 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T20:28:55.866 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-20T20:28:55.869 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package bison. 2024-09-20T20:28:55.906 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T20:28:55.974 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T20:28:55.980 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-20T20:28:56.014 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T20:28:56.207 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-20T20:28:56.222 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-20T20:28:56.224 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T20:28:56.256 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T20:28:56.263 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T20:28:56.268 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T20:28:56.339 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-20T20:28:56.367 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-20T20:28:56.380 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-20T20:28:56.406 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T20:28:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T20:28:56.526 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-20T20:28:56.543 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-20T20:28:56.585 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T20:28:56.660 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-20T20:28:56.688 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-20T20:28:56.752 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T20:28:56.808 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:28:56.916 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T20:28:56.930 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-20T20:28:56.957 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:56.996 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:57.089 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-20T20:28:57.096 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T20:28:57.117 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:57.155 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:57.249 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-20T20:28:57.265 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:57.298 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:57.383 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-20T20:28:57.399 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:57.433 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:57.460 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T20:28:57.465 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T20:28:57.473 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T20:28:57.534 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-20T20:28:57.551 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T20:28:57.591 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T20:28:57.592 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:28:57.679 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-20T20:28:57.696 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T20:28:57.738 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:28:57.891 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package bison. 2024-09-20T20:28:57.997 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T20:28:58.002 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-20T20:28:58.010 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-20T20:28:58.050 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T20:28:58.079 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-20T20:28:58.149 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-20T20:28:58.189 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T20:28:58.190 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-20T20:28:58.315 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T20:28:58.317 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T20:28:58.393 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-20T20:28:58.409 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-20T20:28:58.418 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T20:28:58.441 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:28:58.443 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T20:28:58.485 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T20:28:58.519 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:28:58.567 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T20:28:58.645 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T20:28:58.693 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:58.705 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-20T20:28:58.734 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-20T20:28:58.771 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:58.772 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T20:28:58.819 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T20:28:58.885 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package bison. 2024-09-20T20:28:58.897 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T20:28:58.908 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-20T20:28:58.970 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:58.987 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-20T20:28:58.989 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-20T20:28:58.995 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-20T20:28:59.037 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T20:28:59.057 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:59.097 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T20:28:59.117 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-20T20:28:59.145 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:59.184 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:59.184 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T20:28:59.224 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T20:28:59.319 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T20:28:59.355 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-20T20:28:59.371 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-20T20:28:59.405 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T20:28:59.411 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-20T20:28:59.424 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-20T20:28:59.453 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T20:28:59.668 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-20T20:28:59.685 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-20T20:28:59.689 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-20T20:28:59.705 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T20:28:59.726 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T20:28:59.747 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:29:00.064 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-20T20:29:00.092 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-20T20:29:00.138 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T20:29:00.192 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-20T20:29:00.344 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T20:29:00.383 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-20T20:29:00.399 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-20T20:29:00.442 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T20:29:00.449 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T20:29:00.470 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T20:29:00.596 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:29:00.687 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-20T20:29:00.703 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-20T20:29:00.714 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T20:29:00.715 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T20:29:00.737 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:29:00.815 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T20:29:00.931 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T20:29:00.936 DEBUG:teuthology.parallel:result is None 2024-09-20T20:29:00.940 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T20:29:01.030 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-20T20:29:01.092 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T20:29:01.219 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T20:29:01.232 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-20T20:29:01.342 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-20T20:29:01.354 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T20:29:01.432 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T20:29:01.437 DEBUG:teuthology.parallel:result is None 2024-09-20T20:29:01.469 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-20T20:29:01.595 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-20T20:29:01.722 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-20T20:29:01.848 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-20T20:29:01.974 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-20T20:29:02.054 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-20T20:29:02.117 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-20T20:29:02.372 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-20T20:29:02.524 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-20T20:29:02.907 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T20:29:03.430 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T20:29:03.434 DEBUG:teuthology.parallel:result is None 2024-09-20T20:29:03.744 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-20T20:29:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-20T20:29:04.248 DEBUG:teuthology.parallel:result is None 2024-09-20T20:29:04.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:29:04.398 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2024-09-20T20:29:04.417 INFO:teuthology.orchestra.run.smithi070.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:29:04.417 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:29:04.418 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T20:29:04.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:29:04.571 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2024-09-20T20:29:04.590 INFO:teuthology.orchestra.run.smithi079.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:29:04.590 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:29:04.590 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T20:29:04.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:29:04.731 DEBUG:teuthology.orchestra.run.smithi090:> dpkg-query -W -f '${Version}' ceph 2024-09-20T20:29:04.750 INFO:teuthology.orchestra.run.smithi090.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:29:04.750 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:29:04.750 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T20:29:04.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9e2ac70bb7aea67d34f0d50002344abbe7803736 2024-09-20T20:29:04.891 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-query -W -f '${Version}' ceph 2024-09-20T20:29:04.910 INFO:teuthology.orchestra.run.smithi187.stdout:19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:29:04.910 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-367-g9e2ac70b-1jammy 2024-09-20T20:29:04.910 INFO:teuthology.task.install:The correct ceph version 19.1.1-367-g9e2ac70b-1jammy is installed. 2024-09-20T20:29:04.912 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-20T20:29:04.913 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:04.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T20:29:04.926 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:04.926 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T20:29:04.941 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:04.941 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T20:29:04.956 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:04.956 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T20:29:04.969 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-20T20:29:04.969 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:04.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T20:29:04.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T20:29:05.039 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:05.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T20:29:05.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T20:29:05.105 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:05.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T20:29:05.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T20:29:05.173 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:05.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T20:29:05.186 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T20:29:05.242 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-20T20:29:05.243 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:05.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T20:29:05.256 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T20:29:05.312 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:05.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T20:29:05.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T20:29:05.382 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:05.382 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T20:29:05.395 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T20:29:05.448 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:05.448 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T20:29:05.462 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T20:29:05.514 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-20T20:29:05.514 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:05.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T20:29:05.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T20:29:05.583 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:05.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T20:29:05.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T20:29:05.650 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:05.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T20:29:05.664 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T20:29:05.716 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:05.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T20:29:05.730 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T20:29:05.787 INFO:teuthology.run_tasks:Running task ceph... 2024-09-20T20:29:05.872 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-20T20:29:05.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-09-20T20:29:05.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2024-09-20T20:29:05.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2024-09-20T20:29:05.879 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2024-09-20T20:29:05.892 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-20T20:29:05.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-20T20:29:05.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-20T20:29:05.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-20T20:29:05.934 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-20T20:29:05.946 INFO:tasks.ceph:Creating extra log directories... 2024-09-20T20:29:05.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-20T20:29:05.981 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-20T20:29:05.987 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-20T20:29:05.990 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-20T20:29:06.011 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-20T20:29:06.011 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-20T20:29:06.012 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7912567', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ed8ee0f26ef720e6504cefa8be1a2d0872192de7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 8245, 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ed8ee0f26ef720e6504cefa8be1a2d0872192de7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ed8ee0f26ef720e6504cefa8be1a2d0872192de7', 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG0WZ87tzrBXLRXhjU66VQ7bzGt8XYXzv1vdjsPvb/K+8XyVzgmv+DXr2+zuUBw0M5jbfMJ7eb23nWOxxZitccI=', 'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRVLRuqwNfROdj5LGz8me/CuxOgkzeKd8xbxDS1TJUqNfoupYNFr/YqlnfWQoVDCpIl2X/Bowl6wZojVlnQ76k=', 'smithi090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPf4H0Ogwo97VFOYLlUdqX2F13gQ1BQMPXtjEzXRxbXeTPRG1cHQWZY+mElLxNDHVj/WTXo69F7MEK0cZPELN4E=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZInyGv8pz68ABUmDV1uMheqsGKhQU3IDBAZq6d4invMTHzdZeJqSVgruyudeN47ff6Qy+vrzs4MHnyk4NzWaw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-19_21:32:06', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-20T20:29:06.012 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-20T20:29:06.037 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-20T20:29:06.043 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-20T20:29:06.046 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-20T20:29:06.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T20:29:06.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T20:29:06.091 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T20:29:06.094 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T20:29:06.110 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:06.111 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T20:29:06.150 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T20:29:06.151 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-09-20T20:29:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T20:29:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-20T20:29:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-20 20:23:15.751208932 +0000 2024-09-20T20:29:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-20 20:23:15.511211077 +0000 2024-09-20T20:29:06.200 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-20 20:23:15.511211077 +0000 2024-09-20T20:29:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-20T20:29:06.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T20:29:06.253 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-20T20:29:06.253 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-20T20:29:06.253 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000427087 s, 1.2 MB/s 2024-09-20T20:29:06.254 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T20:29:06.303 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-09-20T20:29:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T20:29:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:06.350 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-20T20:29:06.350 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:06.350 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-20 20:23:16.231204646 +0000 2024-09-20T20:29:06.351 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-20 20:23:15.967207004 +0000 2024-09-20T20:29:06.351 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-20 20:23:15.967207004 +0000 2024-09-20T20:29:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-20T20:29:06.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T20:29:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-20T20:29:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-20T20:29:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000324952 s, 1.6 MB/s 2024-09-20T20:29:06.407 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T20:29:06.455 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-09-20T20:29:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T20:29:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:06.502 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-20T20:29:06.502 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:06.502 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-20 20:23:16.471202502 +0000 2024-09-20T20:29:06.502 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-20 20:23:16.467202537 +0000 2024-09-20T20:29:06.502 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-20 20:23:16.467202537 +0000 2024-09-20T20:29:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-20T20:29:06.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T20:29:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-20T20:29:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-20T20:29:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000438353 s, 1.2 MB/s 2024-09-20T20:29:06.558 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T20:29:06.607 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-09-20T20:29:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T20:29:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:06.654 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-20T20:29:06.654 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:06.654 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-20 20:23:16.963198107 +0000 2024-09-20T20:29:06.654 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-20 20:23:16.959198143 +0000 2024-09-20T20:29:06.654 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-20 20:23:16.959198143 +0000 2024-09-20T20:29:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-20T20:29:06.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T20:29:06.710 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-20T20:29:06.710 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-20T20:29:06.710 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000374711 s, 1.4 MB/s 2024-09-20T20:29:06.711 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T20:29:06.759 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-20T20:29:06.759 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:06.759 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T20:29:06.765 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T20:29:06.765 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-09-20T20:29:06.813 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T20:29:06.813 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-20T20:29:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:06.813 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-20 20:23:21.091793378 +0000 2024-09-20T20:29:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-20 20:23:20.819795807 +0000 2024-09-20T20:29:06.814 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-20 20:23:20.819795807 +0000 2024-09-20T20:29:06.814 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2024-09-20T20:29:06.814 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T20:29:06.867 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-20T20:29:06.867 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-20T20:29:06.868 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000441797 s, 1.2 MB/s 2024-09-20T20:29:06.869 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T20:29:06.918 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-09-20T20:29:06.965 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T20:29:06.965 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:06.965 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-09-20T20:29:06.965 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:06.965 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-20 20:23:21.603788804 +0000 2024-09-20T20:29:06.966 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-20 20:23:21.335791199 +0000 2024-09-20T20:29:06.966 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-20 20:23:21.335791199 +0000 2024-09-20T20:29:06.966 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2024-09-20T20:29:06.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T20:29:07.019 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-20T20:29:07.019 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-20T20:29:07.020 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.00041931 s, 1.2 MB/s 2024-09-20T20:29:07.021 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T20:29:07.070 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-09-20T20:29:07.117 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T20:29:07.117 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:07.117 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-09-20T20:29:07.117 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:07.117 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-20 20:23:22.079784554 +0000 2024-09-20T20:29:07.117 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-20 20:23:21.823786839 +0000 2024-09-20T20:29:07.117 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-20 20:23:21.823786839 +0000 2024-09-20T20:29:07.118 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2024-09-20T20:29:07.118 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T20:29:07.171 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-20T20:29:07.171 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-20T20:29:07.171 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.00044054 s, 1.2 MB/s 2024-09-20T20:29:07.172 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T20:29:07.222 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-09-20T20:29:07.269 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T20:29:07.269 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:07.269 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-20T20:29:07.269 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:07.269 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-20 20:23:22.563780230 +0000 2024-09-20T20:29:07.269 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-20 20:23:22.315782445 +0000 2024-09-20T20:29:07.269 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-20 20:23:22.315782445 +0000 2024-09-20T20:29:07.269 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2024-09-20T20:29:07.269 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T20:29:07.324 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-20T20:29:07.324 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-20T20:29:07.324 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000390293 s, 1.3 MB/s 2024-09-20T20:29:07.325 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T20:29:07.374 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-20T20:29:07.374 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:07.374 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T20:29:07.380 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T20:29:07.380 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-09-20T20:29:07.427 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T20:29:07.427 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:07.428 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-09-20T20:29:07.428 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:07.428 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-20 20:23:00.157716556 +0000 2024-09-20T20:29:07.428 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-20 20:22:59.889718950 +0000 2024-09-20T20:29:07.428 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-20 20:22:59.889718950 +0000 2024-09-20T20:29:07.428 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-20T20:29:07.428 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T20:29:07.482 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-20T20:29:07.482 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-20T20:29:07.482 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000445224 s, 1.1 MB/s 2024-09-20T20:29:07.484 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T20:29:07.532 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-09-20T20:29:07.579 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T20:29:07.579 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:07.579 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-20T20:29:07.579 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:07.579 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-20 20:23:00.633712303 +0000 2024-09-20T20:29:07.579 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-20 20:23:00.393714448 +0000 2024-09-20T20:29:07.579 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-20 20:23:00.393714448 +0000 2024-09-20T20:29:07.579 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-20T20:29:07.579 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T20:29:07.633 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-20T20:29:07.633 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-20T20:29:07.633 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000412697 s, 1.2 MB/s 2024-09-20T20:29:07.634 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T20:29:07.684 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-09-20T20:29:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T20:29:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:07.732 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-09-20T20:29:07.732 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:07.732 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-20 20:23:01.141707766 +0000 2024-09-20T20:29:07.732 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-20 20:23:00.877710124 +0000 2024-09-20T20:29:07.732 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-20 20:23:00.877710124 +0000 2024-09-20T20:29:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-20T20:29:07.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T20:29:07.785 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-20T20:29:07.785 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-20T20:29:07.786 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000362929 s, 1.4 MB/s 2024-09-20T20:29:07.787 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T20:29:07.836 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-09-20T20:29:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T20:29:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T20:29:07.883 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-09-20T20:29:07.883 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:29:07.883 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-20 20:23:01.605703622 +0000 2024-09-20T20:29:07.883 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-20 20:23:01.353705873 +0000 2024-09-20T20:29:07.883 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-20 20:23:01.353705873 +0000 2024-09-20T20:29:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-20T20:29:07.884 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T20:29:07.937 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-20T20:29:07.938 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-20T20:29:07.938 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000389066 s, 1.3 MB/s 2024-09-20T20:29:07.939 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T20:29:07.988 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-20T20:29:07.988 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-20T20:29:07.988 INFO:tasks.ceph:Generating config... 2024-09-20T20:29:07.989 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-20T20:29:07.990 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-20T20:29:07.990 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-20T20:29:07.990 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-20T20:29:07.990 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-20T20:29:07.990 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-20T20:29:07.990 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-09-20T20:29:07.990 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-20T20:29:07.990 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-20T20:29:07.990 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-20T20:29:07.990 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-20T20:29:07.990 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-20T20:29:07.990 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-20T20:29:07.991 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-20T20:29:07.991 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-20T20:29:07.991 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-20T20:29:07.991 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-20T20:29:07.991 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-20T20:29:07.991 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-20T20:29:07.991 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-20T20:29:07.991 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-20T20:29:07.991 INFO:tasks.ceph:Setting up mon.a... 2024-09-20T20:29:07.991 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-20T20:29:08.025 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2024-09-20T20:29:08.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-20T20:29:08.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T20:29:08.166 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70'), ('mon.b', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]'), ('mon.c', '[v2:172.21.15.70:3302,v1:172.21.15.70:6791]')] 2024-09-20T20:29:08.166 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-09-20T20:29:08.167 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:08.167 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-20T20:29:08.212 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --addv b '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --addv c '[v2:172.21.15.70:3302,v1:172.21.15.70:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid 49cfe37c-8fc4-44b8-a85f-d53d77eb9d19 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 49cfe37c-8fc4-44b8-a85f-d53d77eb9d19 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2024-09-20T20:29:08.302655+0000 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-20T20:29:08.302655+0000 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 17 (quincy) 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:1: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.b 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:2: [v2:172.21.15.70:3302/0,v1:172.21.15.70:6791/0] mon.c 2024-09-20T20:29:08.300 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-20T20:29:08.301 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-20T20:29:08.349 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 49cfe37c-8fc4-44b8-a85f-d53d77eb9d19... 2024-09-20T20:29:08.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-20T20:29:08.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-20T20:29:08.396 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-20T20:29:08.398 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-20T20:29:08.421 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-20T20:29:08.421 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-09-20T20:29:08.421 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-20T20:29:08.421 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-09-20T20:29:08.422 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-20T20:29:08.423 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]" 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 49cfe37c-8fc4-44b8-a85f-d53d77eb9d19 2024-09-20T20:29:08.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-09-20T20:29:08.425 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.426 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore compression algorithm = lz4 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore compression mode = aggressive 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: osd blocked scrub grace period = 3600 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-09-20T20:29:08.427 INFO:teuthology.orchestra.run.smithi070.stdout: osd max markdown count = 1000 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-20T20:29:08.428 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.429 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-20T20:29:08.430 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-20T20:29:08.431 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-09-20T20:29:08.431 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-09-20T20:29:08.431 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-09-20T20:29:08.431 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-09-20T20:29:08.431 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2024-09-20T20:29:08.431 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2024-09-20T20:29:08.432 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2024-09-20T20:29:08.433 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2024-09-20T20:29:08.434 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]" 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = 49cfe37c-8fc4-44b8-a85f-d53d77eb9d19 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2024-09-20T20:29:08.435 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug trim objects = true 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.436 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore compression algorithm = lz4 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore compression mode = aggressive 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 1/20 2024-09-20T20:29:08.437 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 1/20 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 4/10 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: osd blocked scrub grace period = 3600 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: osd max markdown count = 1000 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-20T20:29:08.438 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2024-09-20T20:29:08.439 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.440 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2024-09-20T20:29:08.441 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-09-20T20:29:08.442 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.443 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-20T20:29:08.444 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]" 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 49cfe37c-8fc4-44b8-a85f-d53d77eb9d19 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.445 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-09-20T20:29:08.446 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-09-20T20:29:08.447 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore compression algorithm = lz4 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore compression mode = aggressive 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: osd blocked scrub grace period = 3600 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: osd max markdown count = 1000 2024-09-20T20:29:08.448 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-09-20T20:29:08.449 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-09-20T20:29:08.450 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-09-20T20:29:08.451 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-09-20T20:29:08.453 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-09-20T20:29:08.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]" 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 49cfe37c-8fc4-44b8-a85f-d53d77eb9d19 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.455 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.456 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore compression algorithm = lz4 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore compression mode = aggressive 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-20T20:29:08.457 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: osd blocked scrub grace period = 3600 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: osd max markdown count = 1000 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-09-20T20:29:08.458 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-09-20T20:29:08.459 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.460 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-09-20T20:29:08.461 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-09-20T20:29:08.463 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-20T20:29:08.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-20T20:29:08.554 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-20T20:29:08.555 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:08.555 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-20T20:29:08.560 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:08.560 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-20T20:29:08.608 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-09-20T20:29:08.609 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:08.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-20T20:29:08.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T20:29:08.673 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:08.673 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:08.720 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:29:08.721 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:08.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-20T20:29:08.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T20:29:08.743 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:08.743 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:08.791 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2024-09-20T20:29:08.791 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:08.791 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-20T20:29:08.791 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T20:29:08.814 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:08.814 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:08.861 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2024-09-20T20:29:08.861 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:08.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-20T20:29:08.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-20T20:29:08.883 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:08.884 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:08.931 INFO:tasks.ceph:Setting up mon nodes... 2024-09-20T20:29:08.931 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-20T20:29:08.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-20T20:29:08.975 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-20T20:29:08.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-20T20:29:09.057 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-20T20:29:09.060 INFO:tasks.ceph:Setting up mds nodes... 2024-09-20T20:29:09.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-20T20:29:09.142 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-20T20:29:09.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-20T20:29:09.199 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-20T20:29:09.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-20T20:29:09.279 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-20T20:29:09.290 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-20T20:29:09.290 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-20T20:29:09.290 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-20T20:29:09.304 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-20T20:29:09.304 INFO:tasks.ceph:role: osd.0 2024-09-20T20:29:09.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:29:09.304 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-20T20:29:09.365 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-20T20:29:09.825 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-20T20:29:09.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-20T20:29:09.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-20T20:29:09.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-20T20:29:09.988 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-20T20:29:09.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:29:09.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:10.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-20T20:29:10.089+0000 7f80afd9d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-20T20:29:10.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-20T20:29:10.093+0000 7f80afd9d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-20T20:29:10.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-20T20:29:10.093+0000 7f80afd9d7c0 -1 bdev(0x56247ffa1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-20T20:29:10.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-20T20:29:10.093+0000 7f80afd9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-20T20:29:13.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T20:29:13.252 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-20T20:29:13.266 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-20T20:29:13.266 INFO:tasks.ceph:role: osd.1 2024-09-20T20:29:13.266 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-20T20:29:13.266 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-20T20:29:13.328 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-20T20:29:13.328 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-20T20:29:13.328 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-20T20:29:13.328 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-20T20:29:13.328 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-20T20:29:13.328 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-09-20T20:29:13.328 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-20T20:29:13.328 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-20T20:29:13.329 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-20T20:29:13.329 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-20T20:29:13.782 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-09-20T20:29:13.784 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-09-20T20:29:13.784 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-20T20:29:13.887 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-20T20:29:13.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:29:13.897 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2024-09-20T20:29:13.898 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:14.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-20T20:29:14.014+0000 7f70df1d37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-20T20:29:14.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-20T20:29:14.018+0000 7f70df1d37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-20T20:29:14.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-20T20:29:14.018+0000 7f70df1d37c0 -1 bdev(0x55cd82533800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-20T20:29:14.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-20T20:29:14.018+0000 7f70df1d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-20T20:29:17.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T20:29:17.198 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-20T20:29:17.213 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-20T20:29:17.213 INFO:tasks.ceph:role: osd.2 2024-09-20T20:29:17.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-20T20:29:17.213 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-20T20:29:17.274 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-20T20:29:17.746 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-20T20:29:17.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-20T20:29:17.748 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-20T20:29:17.903 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-20T20:29:17.915 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-20T20:29:17.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:29:17.916 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:18.035 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-20T20:29:18.034+0000 7fb2084507c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-20T20:29:18.039 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-20T20:29:18.038+0000 7fb2084507c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-20T20:29:18.039 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-20T20:29:18.038+0000 7fb2084507c0 -1 bdev(0x55aa92017800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-20T20:29:18.039 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-20T20:29:18.038+0000 7fb2084507c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-20T20:29:21.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T20:29:21.205 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-20T20:29:21.205 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:21.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-20T20:29:21.219 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:21.220 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-20T20:29:21.275 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:21.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-20T20:29:21.326 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:21.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-20T20:29:21.341 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:21.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-20T20:29:21.355 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:21.355 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-20T20:29:21.368 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:29:21.368 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-20T20:29:21.374 INFO:tasks.ceph:Adding keys to all mons... 2024-09-20T20:29:21.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAU2+1m1qNVOhAA0satHCdU61iSRQ8x/my5+g== 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAV2+1mfkWeAxAAc51u1Rt3ZG67eovnzNwkiA== 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAV2+1mV5SqCBAAZX/LNtLCJY7+rwqVEfm6/w== 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAW2+1m4ASDBRAAYKqOk9uNNiJV3WTef91ARw== 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-09-20T20:29:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAa2+1muxk3ARAAJKyWKuuk6hfDPV7N5M2lyA== 2024-09-20T20:29:21.427 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-09-20T20:29:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAe2+1mVB4XAhAAJY3OldK2zjE9SpJyAu1bVg== 2024-09-20T20:29:21.427 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-20T20:29:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAV2+1mo77OEBAAYhroim0doy3H1gnIDFKECw== 2024-09-20T20:29:21.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-20T20:29:21.516 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-20T20:29:21.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-20T20:29:21.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-20T20:29:21.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-20T20:29:21.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-20T20:29:21.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-20T20:29:21.986 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-20T20:29:21.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-20T20:29:21.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-20T20:29:22.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-20T20:29:22.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-20T20:29:22.161 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-20T20:29:22.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-20T20:29:22.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-20T20:29:22.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-20T20:29:22.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-20T20:29:22.414 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-20T20:29:22.459 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-20T20:29:22.459 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-20T20:29:22.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-20T20:29:22.503 INFO:tasks.ceph.mon.a:Started 2024-09-20T20:29:22.503 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-20T20:29:22.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-20T20:29:22.505 INFO:tasks.ceph.mon.b:Started 2024-09-20T20:29:22.505 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-20T20:29:22.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-20T20:29:22.507 INFO:tasks.ceph.mon.c:Started 2024-09-20T20:29:22.507 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-20T20:29:22.507 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-20T20:29:22.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-20T20:29:22.509 INFO:tasks.ceph.mgr.x:Started 2024-09-20T20:29:22.509 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-20T20:29:22.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-20T20:29:22.511 INFO:tasks.ceph.mgr.y:Started 2024-09-20T20:29:22.511 INFO:tasks.ceph:Setting crush tunables to default 2024-09-20T20:29:22.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2024-09-20T20:29:33.058 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:33.054+0000 7f3623c5f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T20:29:33.058 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:33.054+0000 7f2fabbec180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-20T20:29:33.147 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-20T20:29:33.167 INFO:tasks.ceph:check_enable_crimson: False 2024-09-20T20:29:33.167 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-20T20:29:33.167 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-20T20:29:33.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-20T20:29:33.182 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-20T20:29:33.182 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-20T20:29:33.196 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-20T20:29:33.197 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-20T20:29:33.212 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 1faec90a-457d-4941-a408-c3a5b5f8e2f1 0 2024-09-20T20:29:33.475 INFO:teuthology.orchestra.run.smithi187.stdout:0 2024-09-20T20:29:33.493 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 99ce4df8-04c8-4992-9306-22ca73b3e744 1 2024-09-20T20:29:33.560 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:33.558+0000 7f3623c5f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T20:29:33.564 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:33.562+0000 7f2fabbec180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-20T20:29:33.702 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-20T20:29:33.720 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 9427eb75-9576-46b8-9123-f40e3ad555fc 2 2024-09-20T20:29:33.765 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:33.762+0000 7f2fabbec180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T20:29:33.767 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:33.762+0000 7f3623c5f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-20T20:29:33.925 INFO:teuthology.orchestra.run.smithi187.stdout:2 2024-09-20T20:29:33.942 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-20T20:29:33.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-20T20:29:33.945 INFO:tasks.ceph.osd.0:Started 2024-09-20T20:29:33.945 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-20T20:29:33.945 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-20T20:29:33.947 INFO:tasks.ceph.osd.1:Started 2024-09-20T20:29:33.947 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-20T20:29:33.948 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-20T20:29:33.950 INFO:tasks.ceph.osd.2:Started 2024-09-20T20:29:33.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:29:34.140 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:34.140 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:33.925164+0000","last_up_change":"0.000000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:29:34.156 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-20T20:29:34.156 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-20T20:29:34.355 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.354+0000 7f2fabbec180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T20:29:34.356 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.354+0000 7f3623c5f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-20T20:29:34.410 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.406+0000 7f2fabbec180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T20:29:34.410 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.406+0000 7f3623c5f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-20T20:29:34.458 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-20T20:29:34.463 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.462+0000 7f2fabbec180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T20:29:34.464 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.462+0000 7f3623c5f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-20T20:29:34.546 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.542+0000 7f2fabbec180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T20:29:34.546 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.542+0000 7f3623c5f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-20T20:29:34.602 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.598+0000 7f2fabbec180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T20:29:34.614 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.610+0000 7f3623c5f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-20T20:29:34.650 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-20T20:29:34.651 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":5,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:33.925164+0000","last_up_change":"0.000000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:29:34.666 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-20T20:29:34.684 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.682+0000 7f2fabbec180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T20:29:34.691 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.690+0000 7f3623c5f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-20T20:29:34.738 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.734+0000 7f2fabbec180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T20:29:34.742 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.738+0000 7f3623c5f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-20T20:29:34.893 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.890+0000 7f2fabbec180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T20:29:34.893 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.890+0000 7f3623c5f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-20T20:29:34.955 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:34.954+0000 7f3623c5f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T20:29:34.956 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:34.954+0000 7f2fabbec180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-20T20:29:35.012 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:29:35.009+0000 7fcfead0c7c0 -1 Falling back to public interface 2024-09-20T20:29:35.015 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:29:35.013+0000 7fc7712ab7c0 -1 Falling back to public interface 2024-09-20T20:29:35.018 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:29:35.014+0000 7f07f53317c0 -1 Falling back to public interface 2024-09-20T20:29:35.675 INFO:tasks.ceph.mgr.x.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-20T20:29:35.676 INFO:tasks.ceph.mgr.x.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-20T20:29:35.676 INFO:tasks.ceph.mgr.x.smithi070.stderr: from numpy import show_config as show_numpy_config 2024-09-20T20:29:35.676 INFO:tasks.ceph.mgr.y.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-20T20:29:35.676 INFO:tasks.ceph.mgr.y.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-20T20:29:35.676 INFO:tasks.ceph.mgr.y.smithi070.stderr: from numpy import show_config as show_numpy_config 2024-09-20T20:29:35.752 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:35.754+0000 7f3623c5f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T20:29:35.753 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:35.754+0000 7f2fabbec180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-20T20:29:35.932 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:35.934+0000 7f2fabbec180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T20:29:35.938 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:35.938+0000 7f3623c5f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-20T20:29:36.086 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:36.086+0000 7f2fabbec180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T20:29:36.087 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:36.090+0000 7f3623c5f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-20T20:29:36.150 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:36.150+0000 7f2fabbec180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T20:29:36.153 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:36.154+0000 7f3623c5f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-20T20:29:36.287 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:36.286+0000 7f2fabbec180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T20:29:36.295 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:36.294+0000 7f3623c5f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-20T20:29:36.899 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:36.898+0000 7f3623c5f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T20:29:36.900 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:36.902+0000 7f2fabbec180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-20T20:29:36.975 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:36.978+0000 7f3623c5f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T20:29:36.976 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:36.978+0000 7f2fabbec180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-20T20:29:37.161 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:37.162+0000 7f2fabbec180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T20:29:37.161 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:37.162+0000 7f3623c5f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-20T20:29:37.235 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:37.238+0000 7f3623c5f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T20:29:37.236 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:37.238+0000 7f2fabbec180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-20T20:29:37.527 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:37.526+0000 7f3623c5f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T20:29:37.527 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:37.526+0000 7f2fabbec180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-20T20:29:37.590 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-20T20:29:37.590+0000 7f2fabbec180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T20:29:37.590 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:37.590+0000 7f3623c5f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-20T20:29:38.621 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:38.622+0000 7f35ca898640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-20T20:29:38.621 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-09-20T20:29:38.622+0000 7f35ca898640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-20T20:29:38.828 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:29:38.826+0000 7f07f53317c0 -1 osd.1 0 log_to_monitors true 2024-09-20T20:29:39.078 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:29:39.073+0000 7fcfead0c7c0 -1 osd.2 0 log_to_monitors true 2024-09-20T20:29:39.079 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:29:39.076+0000 7fc7712ab7c0 -1 osd.0 0 log_to_monitors true 2024-09-20T20:29:40.969 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-20T20:29:41.288 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-20T20:29:41.289 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":7,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:40.662404+0000","last_up_change":"0.000000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:29:41.306 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-20T20:29:41.463 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:29:41.458+0000 7f07f1aec640 -1 osd.1 0 waiting for initial osdmap 2024-09-20T20:29:41.464 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:29:41.460+0000 7fc76d254640 -1 osd.0 0 waiting for initial osdmap 2024-09-20T20:29:41.489 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:29:41.486+0000 7f07e910f640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T20:29:41.490 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:29:41.488+0000 7fc765089640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T20:29:41.492 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:29:41.489+0000 7fcfe74c7640 -1 osd.2 0 waiting for initial osdmap 2024-09-20T20:29:41.511 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:29:41.509+0000 7fcfdeaea640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T20:29:47.608 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-20T20:29:47.912 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-20T20:29:47.912 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":11,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:45.701559+0000","last_up_change":"2024-09-20T20:29:42.497975+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6801","nonce":367188288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6803","nonce":367188288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6807","nonce":367188288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6805","nonce":367188288}]},"public_addr":"172.21.15.79:6801/367188288","cluster_addr":"172.21.15.79:6803/367188288","heartbeat_back_addr":"172.21.15.79:6807/367188288","heartbeat_front_addr":"172.21.15.79:6805/367188288","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:29:47.929 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-20T20:29:47.930 INFO:tasks.ceph:Creating RBD pool 2024-09-20T20:29:47.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-20T20:29:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'rbd' created 2024-09-20T20:29:48.831 DEBUG:teuthology.orchestra.run.smithi070:> rbd --cluster ceph pool init rbd 2024-09-20T20:29:51.853 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-20T20:29:51.854 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-20T20:29:51.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-20T20:29:51.856 INFO:tasks.ceph.mds.a:Started 2024-09-20T20:29:51.857 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-20T20:29:51.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T20:29:51.938 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2024-09-20T20:29:52.188 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:52.188 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"btime":"2024-09-20T20:29:51:963406+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6803/89722736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":89722736},{"type":"v1","addr":"172.21.15.70:6803","nonce":89722736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-20T20:29:52.188 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2024-09-20T20:29:52.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-20T20:29:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:52.498 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2024-09-20T20:29:52.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:29:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2024-09-20T20:29:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2024-09-20T20:29:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:29:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:29:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 2, 2024-09-20T20:29:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": "rbd" 2024-09-20T20:29:52.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:29:52.499 INFO:teuthology.orchestra.run.smithi070.stdout:] 2024-09-20T20:29:52.515 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-20T20:29:52.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-20T20:29:52.969 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2024-09-20T20:29:52.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-20T20:29:53.981 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2024-09-20T20:29:54.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-20T20:29:54.981 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 3 and data pool 4 2024-09-20T20:29:55.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:29:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:55.299 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:54.341213+0000","last_up_change":"2024-09-20T20:29:42.497975+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6801","nonce":367188288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6803","nonce":367188288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6807","nonce":367188288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6805","nonce":367188288}]},"public_addr":"172.21.15.79:6801/367188288","cluster_addr":"172.21.15.79:6803/367188288","heartbeat_back_addr":"172.21.15.79:6807/367188288","heartbeat_front_addr":"172.21.15.79:6805/367188288","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:29:55.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:29:55.584 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:55.584 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:54.341213+0000","last_up_change":"2024-09-20T20:29:42.497975+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6801","nonce":367188288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6803","nonce":367188288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6807","nonce":367188288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6805","nonce":367188288}]},"public_addr":"172.21.15.79:6801/367188288","cluster_addr":"172.21.15.79:6803/367188288","heartbeat_back_addr":"172.21.15.79:6807/367188288","heartbeat_front_addr":"172.21.15.79:6805/367188288","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:29:55.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-20T20:29:56.015 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-20T20:29:56.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-20T20:29:56.967 INFO:tasks.ceph.mds.a.smithi070.stderr:2024-09-20T20:29:56.966+0000 7f644fc2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-20T20:29:57.025 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-20T20:29:57.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T20:29:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:57.345 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T20:29:54.341626+0000","modified":"2024-09-20T20:29:56.333455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.70:6803/89722736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":89722736},{"type":"v1","addr":"172.21.15.70:6803","nonce":89722736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-09-20T20:29:57.345 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-09-20T20:29:57.362 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:29:57.644 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:57.644 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:57.587557+0000","last_up_change":"2024-09-20T20:29:42.497975+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6801","nonce":367188288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6803","nonce":367188288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6807","nonce":367188288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6805","nonce":367188288}]},"public_addr":"172.21.15.79:6801/367188288","cluster_addr":"172.21.15.79:6803/367188288","heartbeat_back_addr":"172.21.15.79:6807/367188288","heartbeat_front_addr":"172.21.15.79:6805/367188288","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:29:57.661 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-20T20:29:57.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:29:57.951 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:57.953 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:29:57.966 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-20T20:29:57.605791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81616,"kb_used_data":512,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033904,"statfs":{"total":289910292480,"available":289826717696,"internally_reserved":0,"allocated":524288,"data_stored":1302559,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.832803+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:51.832803+0000","last_peered":"2024-09-20T20:29:51.832803+0000","last_clean":"2024-09-20T20:29:51.832803+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:51.832803+0000","last_undegraded":"2024-09-20T20:29:51.832803+0000","last_fullsized":"2024-09-20T20:29:51.832803+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834512+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:51.834512+0000","last_peered":"2024-09-20T20:29:51.834512+0000","last_clean":"2024-09-20T20:29:51.834512+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:51.834512+0000","last_undegraded":"2024-09-20T20:29:51.834512+0000","last_fullsized":"2024-09-20T20:29:51.834512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.833773+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:51.833773+0000","last_peered":"2024-09-20T20:29:51.833773+0000","last_clean":"2024-09-20T20:29:51.833773+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:51.833773+0000","last_undegraded":"2024-09-20T20:29:51.833773+0000","last_fullsized":"2024-09-20T20:29:51.833773+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831509+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:51.831509+0000","last_peered":"2024-09-20T20:29:51.831509+0000","last_clean":"2024-09-20T20:29:51.831509+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:51.831509+0000","last_undegraded":"2024-09-20T20:29:51.831509+0000","last_fullsized":"2024-09-20T20:29:51.831509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.841267+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:51.841267+0000","last_peered":"2024-09-20T20:29:51.841267+0000","last_clean":"2024-09-20T20:29:51.841267+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:51.841267+0000","last_undegraded":"2024-09-20T20:29:51.841267+0000","last_fullsized":"2024-09-20T20:29:51.841267+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831417+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:51.831417+0000","last_peered":"2024-09-20T20:29:51.831417+0000","last_clean":"2024-09-20T20:29:51.831417+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:51.831417+0000","last_undegraded":"2024-09-20T20:29:51.831417+0000","last_fullsized":"2024-09-20T20:29:51.831417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834038+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:51.834038+0000","last_peered":"2024-09-20T20:29:51.834038+0000","last_clean":"2024-09-20T20:29:51.834038+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:51.834038+0000","last_undegraded":"2024-09-20T20:29:51.834038+0000","last_fullsized":"2024-09-20T20:29:51.834038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831917+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:51.831917+0000","last_peered":"2024-09-20T20:29:51.831917+0000","last_clean":"2024-09-20T20:29:51.831917+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:51.831917+0000","last_undegraded":"2024-09-20T20:29:51.831917+0000","last_fullsized":"2024-09-20T20:29:51.831917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834507+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:51.834507+0000","last_peered":"2024-09-20T20:29:51.834507+0000","last_clean":"2024-09-20T20:29:51.834507+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:51.834507+0000","last_undegraded":"2024-09-20T20:29:51.834507+0000","last_fullsized":"2024-09-20T20:29:51.834507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":40614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":630963,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":196608,"data_stored":630982,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:29:57.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:29:58.322 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:29:58.341 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-20T20:29:57.605791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81616,"kb_used_data":512,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033904,"statfs":{"total":289910292480,"available":289826717696,"internally_reserved":0,"allocated":524288,"data_stored":1302559,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.832803+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:51.832803+0000","last_peered":"2024-09-20T20:29:51.832803+0000","last_clean":"2024-09-20T20:29:51.832803+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:51.832803+0000","last_undegraded":"2024-09-20T20:29:51.832803+0000","last_fullsized":"2024-09-20T20:29:51.832803+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834512+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:51.834512+0000","last_peered":"2024-09-20T20:29:51.834512+0000","last_clean":"2024-09-20T20:29:51.834512+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:51.834512+0000","last_undegraded":"2024-09-20T20:29:51.834512+0000","last_fullsized":"2024-09-20T20:29:51.834512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.833773+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:51.833773+0000","last_peered":"2024-09-20T20:29:51.833773+0000","last_clean":"2024-09-20T20:29:51.833773+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:51.833773+0000","last_undegraded":"2024-09-20T20:29:51.833773+0000","last_fullsized":"2024-09-20T20:29:51.833773+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831509+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:51.831509+0000","last_peered":"2024-09-20T20:29:51.831509+0000","last_clean":"2024-09-20T20:29:51.831509+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:51.831509+0000","last_undegraded":"2024-09-20T20:29:51.831509+0000","last_fullsized":"2024-09-20T20:29:51.831509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.841267+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:51.841267+0000","last_peered":"2024-09-20T20:29:51.841267+0000","last_clean":"2024-09-20T20:29:51.841267+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:51.841267+0000","last_undegraded":"2024-09-20T20:29:51.841267+0000","last_fullsized":"2024-09-20T20:29:51.841267+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831417+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:51.831417+0000","last_peered":"2024-09-20T20:29:51.831417+0000","last_clean":"2024-09-20T20:29:51.831417+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:51.831417+0000","last_undegraded":"2024-09-20T20:29:51.831417+0000","last_fullsized":"2024-09-20T20:29:51.831417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834038+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:51.834038+0000","last_peered":"2024-09-20T20:29:51.834038+0000","last_clean":"2024-09-20T20:29:51.834038+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:51.834038+0000","last_undegraded":"2024-09-20T20:29:51.834038+0000","last_fullsized":"2024-09-20T20:29:51.834038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831917+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:51.831917+0000","last_peered":"2024-09-20T20:29:51.831917+0000","last_clean":"2024-09-20T20:29:51.831917+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:51.831917+0000","last_undegraded":"2024-09-20T20:29:51.831917+0000","last_fullsized":"2024-09-20T20:29:51.831917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834507+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:51.834507+0000","last_peered":"2024-09-20T20:29:51.834507+0000","last_clean":"2024-09-20T20:29:51.834507+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:51.834507+0000","last_undegraded":"2024-09-20T20:29:51.834507+0000","last_fullsized":"2024-09-20T20:29:51.834507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":40614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":630963,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":196608,"data_stored":630982,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:29:58.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:29:58.693 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:58.694 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:29:58.711 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-20T20:29:57.605791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81616,"kb_used_data":512,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033904,"statfs":{"total":289910292480,"available":289826717696,"internally_reserved":0,"allocated":524288,"data_stored":1302559,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.832803+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:51.832803+0000","last_peered":"2024-09-20T20:29:51.832803+0000","last_clean":"2024-09-20T20:29:51.832803+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:51.832803+0000","last_undegraded":"2024-09-20T20:29:51.832803+0000","last_fullsized":"2024-09-20T20:29:51.832803+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834512+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:51.834512+0000","last_peered":"2024-09-20T20:29:51.834512+0000","last_clean":"2024-09-20T20:29:51.834512+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:51.834512+0000","last_undegraded":"2024-09-20T20:29:51.834512+0000","last_fullsized":"2024-09-20T20:29:51.834512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.833773+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:51.833773+0000","last_peered":"2024-09-20T20:29:51.833773+0000","last_clean":"2024-09-20T20:29:51.833773+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:51.833773+0000","last_undegraded":"2024-09-20T20:29:51.833773+0000","last_fullsized":"2024-09-20T20:29:51.833773+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831509+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:51.831509+0000","last_peered":"2024-09-20T20:29:51.831509+0000","last_clean":"2024-09-20T20:29:51.831509+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:51.831509+0000","last_undegraded":"2024-09-20T20:29:51.831509+0000","last_fullsized":"2024-09-20T20:29:51.831509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.841267+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:51.841267+0000","last_peered":"2024-09-20T20:29:51.841267+0000","last_clean":"2024-09-20T20:29:51.841267+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:51.841267+0000","last_undegraded":"2024-09-20T20:29:51.841267+0000","last_fullsized":"2024-09-20T20:29:51.841267+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831417+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:51.831417+0000","last_peered":"2024-09-20T20:29:51.831417+0000","last_clean":"2024-09-20T20:29:51.831417+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:51.831417+0000","last_undegraded":"2024-09-20T20:29:51.831417+0000","last_fullsized":"2024-09-20T20:29:51.831417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834038+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:51.834038+0000","last_peered":"2024-09-20T20:29:51.834038+0000","last_clean":"2024-09-20T20:29:51.834038+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:51.834038+0000","last_undegraded":"2024-09-20T20:29:51.834038+0000","last_fullsized":"2024-09-20T20:29:51.834038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831917+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:51.831917+0000","last_peered":"2024-09-20T20:29:51.831917+0000","last_clean":"2024-09-20T20:29:51.831917+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:51.831917+0000","last_undegraded":"2024-09-20T20:29:51.831917+0000","last_fullsized":"2024-09-20T20:29:51.831917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834507+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:51.834507+0000","last_peered":"2024-09-20T20:29:51.834507+0000","last_clean":"2024-09-20T20:29:51.834507+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:51.834507+0000","last_undegraded":"2024-09-20T20:29:51.834507+0000","last_fullsized":"2024-09-20T20:29:51.834507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":40614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":630963,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":196608,"data_stored":630982,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:29:58.715 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-09-20T20:29:58.715 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.715 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-09-20T20:29:58.715 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.715 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3d is not active+clean 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3c is not active+clean 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3a is not active+clean 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:PG 4.39 is not active+clean 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:PG 4.38 is not active+clean 2024-09-20T20:29:58.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:PG 4.37 is not active+clean 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:PG 4.35 is not active+clean 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:PG 4.32 is not active+clean 2024-09-20T20:29:58.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:PG 4.31 is not active+clean 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:PG 4.30 is not active+clean 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2f is not active+clean 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2d is not active+clean 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.718 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2c is not active+clean 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2b is not active+clean 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:PG 4.29 is not active+clean 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.719 INFO:tasks.ceph.ceph_manager.ceph:PG 4.26 is not active+clean 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:PG 4.25 is not active+clean 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:PG 4.23 is not active+clean 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:PG 4.21 is not active+clean 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.720 INFO:tasks.ceph.ceph_manager.ceph:PG 4.20 is not active+clean 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.721 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-20T20:29:58.722 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-20T20:29:58.723 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-20T20:29:58.724 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.725 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-20T20:29:58.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-20T20:29:58.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.728 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-20T20:29:58.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.729 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-20T20:29:58.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.729 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-20T20:29:58.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.729 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-20T20:29:58.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.729 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-20T20:29:58.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-20T20:29:58.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:53.967579+0000', 'last_change': '2024-09-20T20:29:53.967579+0000', 'last_active': '2024-09-20T20:29:53.967579+0000', 'last_peered': '2024-09-20T20:29:53.967579+0000', 'last_clean': '2024-09-20T20:29:53.967579+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:53.967579+0000', 'last_undegraded': '2024-09-20T20:29:53.967579+0000', 'last_fullsized': '2024-09-20T20:29:53.967579+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:53.967579+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-20T20:29:58.732 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-20T20:29:52.964383+0000', 'last_change': '2024-09-20T20:29:52.964383+0000', 'last_active': '2024-09-20T20:29:52.964383+0000', 'last_peered': '2024-09-20T20:29:52.964383+0000', 'last_clean': '2024-09-20T20:29:52.964383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-20T20:29:52.964383+0000', 'last_undegraded': '2024-09-20T20:29:52.964383+0000', 'last_fullsized': '2024-09-20T20:29:52.964383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'last_clean_scrub_stamp': '2024-09-20T20:29:52.964383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-20T20:29:58.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-20T20:29:59.091 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:59.091 INFO:teuthology.orchestra.run.smithi070.stdout:{"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":3,"num_up_osds":3,"osd_up_since":1726864182,"num_in_osds":3,"osd_in_since":1726864173,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":4,"data_bytes":590387,"bytes_used":83574784,"bytes_avail":289826717696,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-20T20:29:32.711788+0000","services":{}},"progress_events":{}} 2024-09-20T20:29:59.109 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-20T20:29:59.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:29:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:29:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:29:59.415 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-20T20:29:57.605791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81616,"kb_used_data":512,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033904,"statfs":{"total":289910292480,"available":289826717696,"internally_reserved":0,"allocated":524288,"data_stored":1302559,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.832803+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:51.832803+0000","last_peered":"2024-09-20T20:29:51.832803+0000","last_clean":"2024-09-20T20:29:51.832803+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:51.832803+0000","last_undegraded":"2024-09-20T20:29:51.832803+0000","last_fullsized":"2024-09-20T20:29:51.832803+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834512+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:51.834512+0000","last_peered":"2024-09-20T20:29:51.834512+0000","last_clean":"2024-09-20T20:29:51.834512+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:51.834512+0000","last_undegraded":"2024-09-20T20:29:51.834512+0000","last_fullsized":"2024-09-20T20:29:51.834512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.833773+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:51.833773+0000","last_peered":"2024-09-20T20:29:51.833773+0000","last_clean":"2024-09-20T20:29:51.833773+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:51.833773+0000","last_undegraded":"2024-09-20T20:29:51.833773+0000","last_fullsized":"2024-09-20T20:29:51.833773+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831509+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:51.831509+0000","last_peered":"2024-09-20T20:29:51.831509+0000","last_clean":"2024-09-20T20:29:51.831509+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:51.831509+0000","last_undegraded":"2024-09-20T20:29:51.831509+0000","last_fullsized":"2024-09-20T20:29:51.831509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.841267+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:51.841267+0000","last_peered":"2024-09-20T20:29:51.841267+0000","last_clean":"2024-09-20T20:29:51.841267+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:51.841267+0000","last_undegraded":"2024-09-20T20:29:51.841267+0000","last_fullsized":"2024-09-20T20:29:51.841267+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831417+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:51.831417+0000","last_peered":"2024-09-20T20:29:51.831417+0000","last_clean":"2024-09-20T20:29:51.831417+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:51.831417+0000","last_undegraded":"2024-09-20T20:29:51.831417+0000","last_fullsized":"2024-09-20T20:29:51.831417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834038+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:51.834038+0000","last_peered":"2024-09-20T20:29:51.834038+0000","last_clean":"2024-09-20T20:29:51.834038+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:51.834038+0000","last_undegraded":"2024-09-20T20:29:51.834038+0000","last_fullsized":"2024-09-20T20:29:51.834038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.831917+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:51.831917+0000","last_peered":"2024-09-20T20:29:51.831917+0000","last_clean":"2024-09-20T20:29:51.831917+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:51.831917+0000","last_undegraded":"2024-09-20T20:29:51.831917+0000","last_fullsized":"2024-09-20T20:29:51.831917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-20T20:29:51.834507+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:51.834507+0000","last_peered":"2024-09-20T20:29:51.834507+0000","last_clean":"2024-09-20T20:29:51.834507+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:51.834507+0000","last_undegraded":"2024-09-20T20:29:51.834507+0000","last_fullsized":"2024-09-20T20:29:51.834507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:53.967579+0000","last_change":"2024-09-20T20:29:53.967579+0000","last_active":"2024-09-20T20:29:53.967579+0000","last_peered":"2024-09-20T20:29:53.967579+0000","last_clean":"2024-09-20T20:29:53.967579+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:53.967579+0000","last_undegraded":"2024-09-20T20:29:53.967579+0000","last_fullsized":"2024-09-20T20:29:53.967579+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-20T20:29:52.964383+0000","last_change":"2024-09-20T20:29:52.964383+0000","last_active":"2024-09-20T20:29:52.964383+0000","last_peered":"2024-09-20T20:29:52.964383+0000","last_clean":"2024-09-20T20:29:52.964383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-20T20:29:52.964383+0000","last_undegraded":"2024-09-20T20:29:52.964383+0000","last_fullsized":"2024-09-20T20:29:52.964383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":40614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":192512,"data_stored":630963,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":196608,"data_stored":630982,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:30:02.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:30:02.749 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:02.751 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:30:02.767 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-20T20:30:01.607043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90088,"kb_used_data":672,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025432,"statfs":{"total":289910292480,"available":289818042368,"internally_reserved":0,"allocated":688128,"data_stored":1362612,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.625468"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594390+0000","last_change":"2024-09-20T20:29:55.007075+0000","last_active":"2024-09-20T20:29:57.594390+0000","last_peered":"2024-09-20T20:29:57.594390+0000","last_clean":"2024-09-20T20:29:57.594390+0000","last_became_active":"2024-09-20T20:29:55.005105+0000","last_became_peered":"2024-09-20T20:29:55.005105+0000","last_unstale":"2024-09-20T20:29:57.594390+0000","last_undegraded":"2024-09-20T20:29:57.594390+0000","last_fullsized":"2024-09-20T20:29:57.594390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593823+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:29:57.593823+0000","last_peered":"2024-09-20T20:29:57.593823+0000","last_clean":"2024-09-20T20:29:57.593823+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:29:57.593823+0000","last_undegraded":"2024-09-20T20:29:57.593823+0000","last_fullsized":"2024-09-20T20:29:57.593823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593699+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:29:57.593699+0000","last_peered":"2024-09-20T20:29:57.593699+0000","last_clean":"2024-09-20T20:29:57.593699+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:29:57.593699+0000","last_undegraded":"2024-09-20T20:29:57.593699+0000","last_fullsized":"2024-09-20T20:29:57.593699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593419+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:29:57.593419+0000","last_peered":"2024-09-20T20:29:57.593419+0000","last_clean":"2024-09-20T20:29:57.593419+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:29:57.593419+0000","last_undegraded":"2024-09-20T20:29:57.593419+0000","last_fullsized":"2024-09-20T20:29:57.593419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593304+0000","last_change":"2024-09-20T20:29:55.001482+0000","last_active":"2024-09-20T20:29:57.593304+0000","last_peered":"2024-09-20T20:29:57.593304+0000","last_clean":"2024-09-20T20:29:57.593304+0000","last_became_active":"2024-09-20T20:29:55.000290+0000","last_became_peered":"2024-09-20T20:29:55.000290+0000","last_unstale":"2024-09-20T20:29:57.593304+0000","last_undegraded":"2024-09-20T20:29:57.593304+0000","last_fullsized":"2024-09-20T20:29:57.593304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592133+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:29:57.592133+0000","last_peered":"2024-09-20T20:29:57.592133+0000","last_clean":"2024-09-20T20:29:57.592133+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:29:57.592133+0000","last_undegraded":"2024-09-20T20:29:57.592133+0000","last_fullsized":"2024-09-20T20:29:57.592133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592055+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:29:57.592055+0000","last_peered":"2024-09-20T20:29:57.592055+0000","last_clean":"2024-09-20T20:29:57.592055+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:29:57.592055+0000","last_undegraded":"2024-09-20T20:29:57.592055+0000","last_fullsized":"2024-09-20T20:29:57.592055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591525+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:29:57.591525+0000","last_peered":"2024-09-20T20:29:57.591525+0000","last_clean":"2024-09-20T20:29:57.591525+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:29:57.591525+0000","last_undegraded":"2024-09-20T20:29:57.591525+0000","last_fullsized":"2024-09-20T20:29:57.591525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591679+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:29:57.591679+0000","last_peered":"2024-09-20T20:29:57.591679+0000","last_clean":"2024-09-20T20:29:57.591679+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:29:57.591679+0000","last_undegraded":"2024-09-20T20:29:57.591679+0000","last_fullsized":"2024-09-20T20:29:57.591679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594009+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:29:57.594009+0000","last_peered":"2024-09-20T20:29:57.594009+0000","last_clean":"2024-09-20T20:29:57.594009+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:29:57.594009+0000","last_undegraded":"2024-09-20T20:29:57.594009+0000","last_fullsized":"2024-09-20T20:29:57.594009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593950+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:29:57.593950+0000","last_peered":"2024-09-20T20:29:57.593950+0000","last_clean":"2024-09-20T20:29:57.593950+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:29:57.593950+0000","last_undegraded":"2024-09-20T20:29:57.593950+0000","last_fullsized":"2024-09-20T20:29:57.593950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593395+0000","last_change":"2024-09-20T20:29:55.012467+0000","last_active":"2024-09-20T20:29:57.593395+0000","last_peered":"2024-09-20T20:29:57.593395+0000","last_clean":"2024-09-20T20:29:57.593395+0000","last_became_active":"2024-09-20T20:29:55.011686+0000","last_became_peered":"2024-09-20T20:29:55.011686+0000","last_unstale":"2024-09-20T20:29:57.593395+0000","last_undegraded":"2024-09-20T20:29:57.593395+0000","last_fullsized":"2024-09-20T20:29:57.593395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592940+0000","last_change":"2024-09-20T20:29:55.006208+0000","last_active":"2024-09-20T20:29:57.592940+0000","last_peered":"2024-09-20T20:29:57.592940+0000","last_clean":"2024-09-20T20:29:57.592940+0000","last_became_active":"2024-09-20T20:29:55.002864+0000","last_became_peered":"2024-09-20T20:29:55.002864+0000","last_unstale":"2024-09-20T20:29:57.592940+0000","last_undegraded":"2024-09-20T20:29:57.592940+0000","last_fullsized":"2024-09-20T20:29:57.592940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592235+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:29:57.592235+0000","last_peered":"2024-09-20T20:29:57.592235+0000","last_clean":"2024-09-20T20:29:57.592235+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:29:57.592235+0000","last_undegraded":"2024-09-20T20:29:57.592235+0000","last_fullsized":"2024-09-20T20:29:57.592235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592226+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:29:57.592226+0000","last_peered":"2024-09-20T20:29:57.592226+0000","last_clean":"2024-09-20T20:29:57.592226+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:29:57.592226+0000","last_undegraded":"2024-09-20T20:29:57.592226+0000","last_fullsized":"2024-09-20T20:29:57.592226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591482+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:29:57.591482+0000","last_peered":"2024-09-20T20:29:57.591482+0000","last_clean":"2024-09-20T20:29:57.591482+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:29:57.591482+0000","last_undegraded":"2024-09-20T20:29:57.591482+0000","last_fullsized":"2024-09-20T20:29:57.591482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592894+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:29:57.592894+0000","last_peered":"2024-09-20T20:29:57.592894+0000","last_clean":"2024-09-20T20:29:57.592894+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:29:57.592894+0000","last_undegraded":"2024-09-20T20:29:57.592894+0000","last_fullsized":"2024-09-20T20:29:57.592894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594068+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:29:57.594068+0000","last_peered":"2024-09-20T20:29:57.594068+0000","last_clean":"2024-09-20T20:29:57.594068+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:29:57.594068+0000","last_undegraded":"2024-09-20T20:29:57.594068+0000","last_fullsized":"2024-09-20T20:29:57.594068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591391+0000","last_change":"2024-09-20T20:29:54.999350+0000","last_active":"2024-09-20T20:29:57.591391+0000","last_peered":"2024-09-20T20:29:57.591391+0000","last_clean":"2024-09-20T20:29:57.591391+0000","last_became_active":"2024-09-20T20:29:54.998741+0000","last_became_peered":"2024-09-20T20:29:54.998741+0000","last_unstale":"2024-09-20T20:29:57.591391+0000","last_undegraded":"2024-09-20T20:29:57.591391+0000","last_fullsized":"2024-09-20T20:29:57.591391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593556+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:29:57.593556+0000","last_peered":"2024-09-20T20:29:57.593556+0000","last_clean":"2024-09-20T20:29:57.593556+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:29:57.593556+0000","last_undegraded":"2024-09-20T20:29:57.593556+0000","last_fullsized":"2024-09-20T20:29:57.593556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592975+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:29:57.592975+0000","last_peered":"2024-09-20T20:29:57.592975+0000","last_clean":"2024-09-20T20:29:57.592975+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:29:57.592975+0000","last_undegraded":"2024-09-20T20:29:57.592975+0000","last_fullsized":"2024-09-20T20:29:57.592975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592502+0000","last_change":"2024-09-20T20:29:55.015082+0000","last_active":"2024-09-20T20:29:57.592502+0000","last_peered":"2024-09-20T20:29:57.592502+0000","last_clean":"2024-09-20T20:29:57.592502+0000","last_became_active":"2024-09-20T20:29:55.012708+0000","last_became_peered":"2024-09-20T20:29:55.012708+0000","last_unstale":"2024-09-20T20:29:57.592502+0000","last_undegraded":"2024-09-20T20:29:57.592502+0000","last_fullsized":"2024-09-20T20:29:57.592502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:24.045731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590012+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:29:57.590012+0000","last_peered":"2024-09-20T20:29:57.590012+0000","last_clean":"2024-09-20T20:29:57.590012+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:29:57.590012+0000","last_undegraded":"2024-09-20T20:29:57.590012+0000","last_fullsized":"2024-09-20T20:29:57.590012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591951+0000","last_change":"2024-09-20T20:29:55.002784+0000","last_active":"2024-09-20T20:29:57.591951+0000","last_peered":"2024-09-20T20:29:57.591951+0000","last_clean":"2024-09-20T20:29:57.591951+0000","last_became_active":"2024-09-20T20:29:55.001575+0000","last_became_peered":"2024-09-20T20:29:55.001575+0000","last_unstale":"2024-09-20T20:29:57.591951+0000","last_undegraded":"2024-09-20T20:29:57.591951+0000","last_fullsized":"2024-09-20T20:29:57.591951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:45.086905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594645+0000","last_change":"2024-09-20T20:29:55.014653+0000","last_active":"2024-09-20T20:29:57.594645+0000","last_peered":"2024-09-20T20:29:57.594645+0000","last_clean":"2024-09-20T20:29:57.594645+0000","last_became_active":"2024-09-20T20:29:55.013806+0000","last_became_peered":"2024-09-20T20:29:55.013806+0000","last_unstale":"2024-09-20T20:29:57.594645+0000","last_undegraded":"2024-09-20T20:29:57.594645+0000","last_fullsized":"2024-09-20T20:29:57.594645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592032+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:29:57.592032+0000","last_peered":"2024-09-20T20:29:57.592032+0000","last_clean":"2024-09-20T20:29:57.592032+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:29:57.592032+0000","last_undegraded":"2024-09-20T20:29:57.592032+0000","last_fullsized":"2024-09-20T20:29:57.592032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594255+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:29:57.594255+0000","last_peered":"2024-09-20T20:29:57.594255+0000","last_clean":"2024-09-20T20:29:57.594255+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:29:57.594255+0000","last_undegraded":"2024-09-20T20:29:57.594255+0000","last_fullsized":"2024-09-20T20:29:57.594255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594065+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:29:57.594065+0000","last_peered":"2024-09-20T20:29:57.594065+0000","last_clean":"2024-09-20T20:29:57.594065+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:29:57.594065+0000","last_undegraded":"2024-09-20T20:29:57.594065+0000","last_fullsized":"2024-09-20T20:29:57.594065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591517+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:29:57.591517+0000","last_peered":"2024-09-20T20:29:57.591517+0000","last_clean":"2024-09-20T20:29:57.591517+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:29:57.591517+0000","last_undegraded":"2024-09-20T20:29:57.591517+0000","last_fullsized":"2024-09-20T20:29:57.591517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592863+0000","last_change":"2024-09-20T20:29:55.014505+0000","last_active":"2024-09-20T20:29:57.592863+0000","last_peered":"2024-09-20T20:29:57.592863+0000","last_clean":"2024-09-20T20:29:57.592863+0000","last_became_active":"2024-09-20T20:29:55.012721+0000","last_became_peered":"2024-09-20T20:29:55.012721+0000","last_unstale":"2024-09-20T20:29:57.592863+0000","last_undegraded":"2024-09-20T20:29:57.592863+0000","last_fullsized":"2024-09-20T20:29:57.592863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590169+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:29:57.590169+0000","last_peered":"2024-09-20T20:29:57.590169+0000","last_clean":"2024-09-20T20:29:57.590169+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:29:57.590169+0000","last_undegraded":"2024-09-20T20:29:57.590169+0000","last_fullsized":"2024-09-20T20:29:57.590169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591691+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:29:57.591691+0000","last_peered":"2024-09-20T20:29:57.591691+0000","last_clean":"2024-09-20T20:29:57.591691+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:29:57.591691+0000","last_undegraded":"2024-09-20T20:29:57.591691+0000","last_fullsized":"2024-09-20T20:29:57.591691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594004+0000","last_change":"2024-09-20T20:29:55.001960+0000","last_active":"2024-09-20T20:29:57.594004+0000","last_peered":"2024-09-20T20:29:57.594004+0000","last_clean":"2024-09-20T20:29:57.594004+0000","last_became_active":"2024-09-20T20:29:55.001033+0000","last_became_peered":"2024-09-20T20:29:55.001033+0000","last_unstale":"2024-09-20T20:29:57.594004+0000","last_undegraded":"2024-09-20T20:29:57.594004+0000","last_fullsized":"2024-09-20T20:29:57.594004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593125+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:29:57.593125+0000","last_peered":"2024-09-20T20:29:57.593125+0000","last_clean":"2024-09-20T20:29:57.593125+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:29:57.593125+0000","last_undegraded":"2024-09-20T20:29:57.593125+0000","last_fullsized":"2024-09-20T20:29:57.593125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593494+0000","last_change":"2024-09-20T20:29:55.006411+0000","last_active":"2024-09-20T20:29:57.593494+0000","last_peered":"2024-09-20T20:29:57.593494+0000","last_clean":"2024-09-20T20:29:57.593494+0000","last_became_active":"2024-09-20T20:29:55.004960+0000","last_became_peered":"2024-09-20T20:29:55.004960+0000","last_unstale":"2024-09-20T20:29:57.593494+0000","last_undegraded":"2024-09-20T20:29:57.593494+0000","last_fullsized":"2024-09-20T20:29:57.593494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590823+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:29:57.590823+0000","last_peered":"2024-09-20T20:29:57.590823+0000","last_clean":"2024-09-20T20:29:57.590823+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:29:57.590823+0000","last_undegraded":"2024-09-20T20:29:57.590823+0000","last_fullsized":"2024-09-20T20:29:57.590823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592575+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:29:57.592575+0000","last_peered":"2024-09-20T20:29:57.592575+0000","last_clean":"2024-09-20T20:29:57.592575+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:29:57.592575+0000","last_undegraded":"2024-09-20T20:29:57.592575+0000","last_fullsized":"2024-09-20T20:29:57.592575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592468+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:29:57.592468+0000","last_peered":"2024-09-20T20:29:57.592468+0000","last_clean":"2024-09-20T20:29:57.592468+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:29:57.592468+0000","last_undegraded":"2024-09-20T20:29:57.592468+0000","last_fullsized":"2024-09-20T20:29:57.592468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592413+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:29:57.592413+0000","last_peered":"2024-09-20T20:29:57.592413+0000","last_clean":"2024-09-20T20:29:57.592413+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:29:57.592413+0000","last_undegraded":"2024-09-20T20:29:57.592413+0000","last_fullsized":"2024-09-20T20:29:57.592413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591791+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:29:57.591791+0000","last_peered":"2024-09-20T20:29:57.591791+0000","last_clean":"2024-09-20T20:29:57.591791+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:29:57.591791+0000","last_undegraded":"2024-09-20T20:29:57.591791+0000","last_fullsized":"2024-09-20T20:29:57.591791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594458+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:29:57.594458+0000","last_peered":"2024-09-20T20:29:57.594458+0000","last_clean":"2024-09-20T20:29:57.594458+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:29:57.594458+0000","last_undegraded":"2024-09-20T20:29:57.594458+0000","last_fullsized":"2024-09-20T20:29:57.594458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592083+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:29:57.592083+0000","last_peered":"2024-09-20T20:29:57.592083+0000","last_clean":"2024-09-20T20:29:57.592083+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:29:57.592083+0000","last_undegraded":"2024-09-20T20:29:57.592083+0000","last_fullsized":"2024-09-20T20:29:57.592083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594387+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:29:57.594387+0000","last_peered":"2024-09-20T20:29:57.594387+0000","last_clean":"2024-09-20T20:29:57.594387+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:29:57.594387+0000","last_undegraded":"2024-09-20T20:29:57.594387+0000","last_fullsized":"2024-09-20T20:29:57.594387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592138+0000","last_change":"2024-09-20T20:29:55.006455+0000","last_active":"2024-09-20T20:29:57.592138+0000","last_peered":"2024-09-20T20:29:57.592138+0000","last_clean":"2024-09-20T20:29:57.592138+0000","last_became_active":"2024-09-20T20:29:55.004010+0000","last_became_peered":"2024-09-20T20:29:55.004010+0000","last_unstale":"2024-09-20T20:29:57.592138+0000","last_undegraded":"2024-09-20T20:29:57.592138+0000","last_fullsized":"2024-09-20T20:29:57.592138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:20.842224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594769+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:29:57.594769+0000","last_peered":"2024-09-20T20:29:57.594769+0000","last_clean":"2024-09-20T20:29:57.594769+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:29:57.594769+0000","last_undegraded":"2024-09-20T20:29:57.594769+0000","last_fullsized":"2024-09-20T20:29:57.594769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592379+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:29:57.592379+0000","last_peered":"2024-09-20T20:29:57.592379+0000","last_clean":"2024-09-20T20:29:57.592379+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:29:57.592379+0000","last_undegraded":"2024-09-20T20:29:57.592379+0000","last_fullsized":"2024-09-20T20:29:57.592379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594413+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:29:57.594413+0000","last_peered":"2024-09-20T20:29:57.594413+0000","last_clean":"2024-09-20T20:29:57.594413+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:29:57.594413+0000","last_undegraded":"2024-09-20T20:29:57.594413+0000","last_fullsized":"2024-09-20T20:29:57.594413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591064+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:29:57.591064+0000","last_peered":"2024-09-20T20:29:57.591064+0000","last_clean":"2024-09-20T20:29:57.591064+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:29:57.591064+0000","last_undegraded":"2024-09-20T20:29:57.591064+0000","last_fullsized":"2024-09-20T20:29:57.591064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591558+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:29:57.591558+0000","last_peered":"2024-09-20T20:29:57.591558+0000","last_clean":"2024-09-20T20:29:57.591558+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:29:57.591558+0000","last_undegraded":"2024-09-20T20:29:57.591558+0000","last_fullsized":"2024-09-20T20:29:57.591558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594239+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:29:57.594239+0000","last_peered":"2024-09-20T20:29:57.594239+0000","last_clean":"2024-09-20T20:29:57.594239+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:29:57.594239+0000","last_undegraded":"2024-09-20T20:29:57.594239+0000","last_fullsized":"2024-09-20T20:29:57.594239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592628+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:29:57.592628+0000","last_peered":"2024-09-20T20:29:57.592628+0000","last_clean":"2024-09-20T20:29:57.592628+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:29:57.592628+0000","last_undegraded":"2024-09-20T20:29:57.592628+0000","last_fullsized":"2024-09-20T20:29:57.592628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594505+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:29:57.594505+0000","last_peered":"2024-09-20T20:29:57.594505+0000","last_clean":"2024-09-20T20:29:57.594505+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:29:57.594505+0000","last_undegraded":"2024-09-20T20:29:57.594505+0000","last_fullsized":"2024-09-20T20:29:57.594505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592805+0000","last_change":"2024-09-20T20:29:54.001861+0000","last_active":"2024-09-20T20:29:57.592805+0000","last_peered":"2024-09-20T20:29:57.592805+0000","last_clean":"2024-09-20T20:29:57.592805+0000","last_became_active":"2024-09-20T20:29:54.000965+0000","last_became_peered":"2024-09-20T20:29:54.000965+0000","last_unstale":"2024-09-20T20:29:57.592805+0000","last_undegraded":"2024-09-20T20:29:57.592805+0000","last_fullsized":"2024-09-20T20:29:57.592805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:28.103332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593778+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:29:57.593778+0000","last_peered":"2024-09-20T20:29:57.593778+0000","last_clean":"2024-09-20T20:29:57.593778+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:29:57.593778+0000","last_undegraded":"2024-09-20T20:29:57.593778+0000","last_fullsized":"2024-09-20T20:29:57.593778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592180+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:29:57.592180+0000","last_peered":"2024-09-20T20:29:57.592180+0000","last_clean":"2024-09-20T20:29:57.592180+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:29:57.592180+0000","last_undegraded":"2024-09-20T20:29:57.592180+0000","last_fullsized":"2024-09-20T20:29:57.592180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592009+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:29:57.592009+0000","last_peered":"2024-09-20T20:29:57.592009+0000","last_clean":"2024-09-20T20:29:57.592009+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:29:57.592009+0000","last_undegraded":"2024-09-20T20:29:57.592009+0000","last_fullsized":"2024-09-20T20:29:57.592009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592119+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:57.592119+0000","last_peered":"2024-09-20T20:29:57.592119+0000","last_clean":"2024-09-20T20:29:57.592119+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:57.592119+0000","last_undegraded":"2024-09-20T20:29:57.592119+0000","last_fullsized":"2024-09-20T20:29:57.592119+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593368+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:57.593368+0000","last_peered":"2024-09-20T20:29:57.593368+0000","last_clean":"2024-09-20T20:29:57.593368+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:57.593368+0000","last_undegraded":"2024-09-20T20:29:57.593368+0000","last_fullsized":"2024-09-20T20:29:57.593368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591134+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:29:57.591134+0000","last_peered":"2024-09-20T20:29:57.591134+0000","last_clean":"2024-09-20T20:29:57.591134+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:29:57.591134+0000","last_undegraded":"2024-09-20T20:29:57.591134+0000","last_fullsized":"2024-09-20T20:29:57.591134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594567+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:29:57.594567+0000","last_peered":"2024-09-20T20:29:57.594567+0000","last_clean":"2024-09-20T20:29:57.594567+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:29:57.594567+0000","last_undegraded":"2024-09-20T20:29:57.594567+0000","last_fullsized":"2024-09-20T20:29:57.594567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592052+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:57.592052+0000","last_peered":"2024-09-20T20:29:57.592052+0000","last_clean":"2024-09-20T20:29:57.592052+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:57.592052+0000","last_undegraded":"2024-09-20T20:29:57.592052+0000","last_fullsized":"2024-09-20T20:29:57.592052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590779+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:29:57.590779+0000","last_peered":"2024-09-20T20:29:57.590779+0000","last_clean":"2024-09-20T20:29:57.590779+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:29:57.590779+0000","last_undegraded":"2024-09-20T20:29:57.590779+0000","last_fullsized":"2024-09-20T20:29:57.590779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594373+0000","last_change":"2024-09-20T20:29:55.007379+0000","last_active":"2024-09-20T20:29:57.594373+0000","last_peered":"2024-09-20T20:29:57.594373+0000","last_clean":"2024-09-20T20:29:57.594373+0000","last_became_active":"2024-09-20T20:29:55.005006+0000","last_became_peered":"2024-09-20T20:29:55.005006+0000","last_unstale":"2024-09-20T20:29:57.594373+0000","last_undegraded":"2024-09-20T20:29:57.594373+0000","last_fullsized":"2024-09-20T20:29:57.594373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591245+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:57.591245+0000","last_peered":"2024-09-20T20:29:57.591245+0000","last_clean":"2024-09-20T20:29:57.591245+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:57.591245+0000","last_undegraded":"2024-09-20T20:29:57.591245+0000","last_fullsized":"2024-09-20T20:29:57.591245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:54.000434+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:53.999658+0000","last_became_peered":"2024-09-20T20:29:53.999658+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:31.923210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592275+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:29:57.592275+0000","last_peered":"2024-09-20T20:29:57.592275+0000","last_clean":"2024-09-20T20:29:57.592275+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:29:57.592275+0000","last_undegraded":"2024-09-20T20:29:57.592275+0000","last_fullsized":"2024-09-20T20:29:57.592275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592825+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:57.592825+0000","last_peered":"2024-09-20T20:29:57.592825+0000","last_clean":"2024-09-20T20:29:57.592825+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:57.592825+0000","last_undegraded":"2024-09-20T20:29:57.592825+0000","last_fullsized":"2024-09-20T20:29:57.592825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593206+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:29:57.593206+0000","last_peered":"2024-09-20T20:29:57.593206+0000","last_clean":"2024-09-20T20:29:57.593206+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:29:57.593206+0000","last_undegraded":"2024-09-20T20:29:57.593206+0000","last_fullsized":"2024-09-20T20:29:57.593206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591843+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:29:57.591843+0000","last_peered":"2024-09-20T20:29:57.591843+0000","last_clean":"2024-09-20T20:29:57.591843+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:29:57.591843+0000","last_undegraded":"2024-09-20T20:29:57.591843+0000","last_fullsized":"2024-09-20T20:29:57.591843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594707+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:29:57.594707+0000","last_peered":"2024-09-20T20:29:57.594707+0000","last_clean":"2024-09-20T20:29:57.594707+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:29:57.594707+0000","last_undegraded":"2024-09-20T20:29:57.594707+0000","last_fullsized":"2024-09-20T20:29:57.594707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593023+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:29:57.593023+0000","last_peered":"2024-09-20T20:29:57.593023+0000","last_clean":"2024-09-20T20:29:57.593023+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:29:57.593023+0000","last_undegraded":"2024-09-20T20:29:57.593023+0000","last_fullsized":"2024-09-20T20:29:57.593023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592094+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:29:57.592094+0000","last_peered":"2024-09-20T20:29:57.592094+0000","last_clean":"2024-09-20T20:29:57.592094+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:29:57.592094+0000","last_undegraded":"2024-09-20T20:29:57.592094+0000","last_fullsized":"2024-09-20T20:29:57.592094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594126+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:57.594126+0000","last_peered":"2024-09-20T20:29:57.594126+0000","last_clean":"2024-09-20T20:29:57.594126+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:57.594126+0000","last_undegraded":"2024-09-20T20:29:57.594126+0000","last_fullsized":"2024-09-20T20:29:57.594126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593059+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:29:57.593059+0000","last_peered":"2024-09-20T20:29:57.593059+0000","last_clean":"2024-09-20T20:29:57.593059+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:29:57.593059+0000","last_undegraded":"2024-09-20T20:29:57.593059+0000","last_fullsized":"2024-09-20T20:29:57.593059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593061+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:29:57.593061+0000","last_peered":"2024-09-20T20:29:57.593061+0000","last_clean":"2024-09-20T20:29:57.593061+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:29:57.593061+0000","last_undegraded":"2024-09-20T20:29:57.593061+0000","last_fullsized":"2024-09-20T20:29:57.593061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592854+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:57.592854+0000","last_peered":"2024-09-20T20:29:57.592854+0000","last_clean":"2024-09-20T20:29:57.592854+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:57.592854+0000","last_undegraded":"2024-09-20T20:29:57.592854+0000","last_fullsized":"2024-09-20T20:29:57.592854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590342+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:29:57.590342+0000","last_peered":"2024-09-20T20:29:57.590342+0000","last_clean":"2024-09-20T20:29:57.590342+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:29:57.590342+0000","last_undegraded":"2024-09-20T20:29:57.590342+0000","last_fullsized":"2024-09-20T20:29:57.590342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592849+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:29:57.592849+0000","last_peered":"2024-09-20T20:29:57.592849+0000","last_clean":"2024-09-20T20:29:57.592849+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:29:57.592849+0000","last_undegraded":"2024-09-20T20:29:57.592849+0000","last_fullsized":"2024-09-20T20:29:57.592849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594408+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:57.594408+0000","last_peered":"2024-09-20T20:29:57.594408+0000","last_clean":"2024-09-20T20:29:57.594408+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:57.594408+0000","last_undegraded":"2024-09-20T20:29:57.594408+0000","last_fullsized":"2024-09-20T20:29:57.594408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592661+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:29:57.592661+0000","last_peered":"2024-09-20T20:29:57.592661+0000","last_clean":"2024-09-20T20:29:57.592661+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:29:57.592661+0000","last_undegraded":"2024-09-20T20:29:57.592661+0000","last_fullsized":"2024-09-20T20:29:57.592661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592767+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:29:57.592767+0000","last_peered":"2024-09-20T20:29:57.592767+0000","last_clean":"2024-09-20T20:29:57.592767+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:29:57.592767+0000","last_undegraded":"2024-09-20T20:29:57.592767+0000","last_fullsized":"2024-09-20T20:29:57.592767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594136+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:29:57.594136+0000","last_peered":"2024-09-20T20:29:57.594136+0000","last_clean":"2024-09-20T20:29:57.594136+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:29:57.594136+0000","last_undegraded":"2024-09-20T20:29:57.594136+0000","last_fullsized":"2024-09-20T20:29:57.594136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590881+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:29:57.590881+0000","last_peered":"2024-09-20T20:29:57.590881+0000","last_clean":"2024-09-20T20:29:57.590881+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:29:57.590881+0000","last_undegraded":"2024-09-20T20:29:57.590881+0000","last_fullsized":"2024-09-20T20:29:57.590881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594037+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:29:57.594037+0000","last_peered":"2024-09-20T20:29:57.594037+0000","last_clean":"2024-09-20T20:29:57.594037+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:29:57.594037+0000","last_undegraded":"2024-09-20T20:29:57.594037+0000","last_fullsized":"2024-09-20T20:29:57.594037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594030+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:29:57.594030+0000","last_peered":"2024-09-20T20:29:57.594030+0000","last_clean":"2024-09-20T20:29:57.594030+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:29:57.594030+0000","last_undegraded":"2024-09-20T20:29:57.594030+0000","last_fullsized":"2024-09-20T20:29:57.594030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590305+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:29:57.590305+0000","last_peered":"2024-09-20T20:29:57.590305+0000","last_clean":"2024-09-20T20:29:57.590305+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:29:57.590305+0000","last_undegraded":"2024-09-20T20:29:57.590305+0000","last_fullsized":"2024-09-20T20:29:57.590305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592804+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:29:57.592804+0000","last_peered":"2024-09-20T20:29:57.592804+0000","last_clean":"2024-09-20T20:29:57.592804+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:29:57.592804+0000","last_undegraded":"2024-09-20T20:29:57.592804+0000","last_fullsized":"2024-09-20T20:29:57.592804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590221+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:29:57.590221+0000","last_peered":"2024-09-20T20:29:57.590221+0000","last_clean":"2024-09-20T20:29:57.590221+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:29:57.590221+0000","last_undegraded":"2024-09-20T20:29:57.590221+0000","last_fullsized":"2024-09-20T20:29:57.590221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594834+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:29:57.594834+0000","last_peered":"2024-09-20T20:29:57.594834+0000","last_clean":"2024-09-20T20:29:57.594834+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:29:57.594834+0000","last_undegraded":"2024-09-20T20:29:57.594834+0000","last_fullsized":"2024-09-20T20:29:57.594834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590499+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:29:57.590499+0000","last_peered":"2024-09-20T20:29:57.590499+0000","last_clean":"2024-09-20T20:29:57.590499+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:29:57.590499+0000","last_undegraded":"2024-09-20T20:29:57.590499+0000","last_fullsized":"2024-09-20T20:29:57.590499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592213+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:29:57.592213+0000","last_peered":"2024-09-20T20:29:57.592213+0000","last_clean":"2024-09-20T20:29:57.592213+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:29:57.592213+0000","last_undegraded":"2024-09-20T20:29:57.592213+0000","last_fullsized":"2024-09-20T20:29:57.592213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590675+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:29:57.590675+0000","last_peered":"2024-09-20T20:29:57.590675+0000","last_clean":"2024-09-20T20:29:57.590675+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:29:57.590675+0000","last_undegraded":"2024-09-20T20:29:57.590675+0000","last_fullsized":"2024-09-20T20:29:57.590675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593420+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:29:57.593420+0000","last_peered":"2024-09-20T20:29:57.593420+0000","last_clean":"2024-09-20T20:29:57.593420+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:29:57.593420+0000","last_undegraded":"2024-09-20T20:29:57.593420+0000","last_fullsized":"2024-09-20T20:29:57.593420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593148+0000","last_change":"2024-09-20T20:29:53.995769+0000","last_active":"2024-09-20T20:29:57.593148+0000","last_peered":"2024-09-20T20:29:57.593148+0000","last_clean":"2024-09-20T20:29:57.593148+0000","last_became_active":"2024-09-20T20:29:53.994788+0000","last_became_peered":"2024-09-20T20:29:53.994788+0000","last_unstale":"2024-09-20T20:29:57.593148+0000","last_undegraded":"2024-09-20T20:29:57.593148+0000","last_fullsized":"2024-09-20T20:29:57.593148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:58.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593654+0000","last_change":"2024-09-20T20:29:55.004166+0000","last_active":"2024-09-20T20:29:57.593654+0000","last_peered":"2024-09-20T20:29:57.593654+0000","last_clean":"2024-09-20T20:29:57.593654+0000","last_became_active":"2024-09-20T20:29:55.002511+0000","last_became_peered":"2024-09-20T20:29:55.002511+0000","last_unstale":"2024-09-20T20:29:57.593654+0000","last_undegraded":"2024-09-20T20:29:57.593654+0000","last_fullsized":"2024-09-20T20:29:57.593654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593507+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:29:57.593507+0000","last_peered":"2024-09-20T20:29:57.593507+0000","last_clean":"2024-09-20T20:29:57.593507+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:29:57.593507+0000","last_undegraded":"2024-09-20T20:29:57.593507+0000","last_fullsized":"2024-09-20T20:29:57.593507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592500+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:29:57.592500+0000","last_peered":"2024-09-20T20:29:57.592500+0000","last_clean":"2024-09-20T20:29:57.592500+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:29:57.592500+0000","last_undegraded":"2024-09-20T20:29:57.592500+0000","last_fullsized":"2024-09-20T20:29:57.592500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593828+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:29:57.593828+0000","last_peered":"2024-09-20T20:29:57.593828+0000","last_clean":"2024-09-20T20:29:57.593828+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:29:57.593828+0000","last_undegraded":"2024-09-20T20:29:57.593828+0000","last_fullsized":"2024-09-20T20:29:57.593828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592557+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:29:57.592557+0000","last_peered":"2024-09-20T20:29:57.592557+0000","last_clean":"2024-09-20T20:29:57.592557+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:29:57.592557+0000","last_undegraded":"2024-09-20T20:29:57.592557+0000","last_fullsized":"2024-09-20T20:29:57.592557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593691+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:29:57.593691+0000","last_peered":"2024-09-20T20:29:57.593691+0000","last_clean":"2024-09-20T20:29:57.593691+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:29:57.593691+0000","last_undegraded":"2024-09-20T20:29:57.593691+0000","last_fullsized":"2024-09-20T20:29:57.593691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593091+0000","last_change":"2024-09-20T20:29:55.001408+0000","last_active":"2024-09-20T20:29:57.593091+0000","last_peered":"2024-09-20T20:29:57.593091+0000","last_clean":"2024-09-20T20:29:57.593091+0000","last_became_active":"2024-09-20T20:29:55.000076+0000","last_became_peered":"2024-09-20T20:29:55.000076+0000","last_unstale":"2024-09-20T20:29:57.593091+0000","last_undegraded":"2024-09-20T20:29:57.593091+0000","last_fullsized":"2024-09-20T20:29:57.593091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592547+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:29:57.592547+0000","last_peered":"2024-09-20T20:29:57.592547+0000","last_clean":"2024-09-20T20:29:57.592547+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:29:57.592547+0000","last_undegraded":"2024-09-20T20:29:57.592547+0000","last_fullsized":"2024-09-20T20:29:57.592547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591986+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:29:57.591986+0000","last_peered":"2024-09-20T20:29:57.591986+0000","last_clean":"2024-09-20T20:29:57.591986+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:29:57.591986+0000","last_undegraded":"2024-09-20T20:29:57.591986+0000","last_fullsized":"2024-09-20T20:29:57.591986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592554+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:29:57.592554+0000","last_peered":"2024-09-20T20:29:57.592554+0000","last_clean":"2024-09-20T20:29:57.592554+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:29:57.592554+0000","last_undegraded":"2024-09-20T20:29:57.592554+0000","last_fullsized":"2024-09-20T20:29:57.592554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":249856,"data_stored":651168,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":651803,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:30:02.771 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-20T20:30:02.771 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-20T20:30:02.771 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-20T20:30:02.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-20T20:30:02.772 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-20T20:30:03.149 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:03.166 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":666546661},{"type":"v1","addr":"172.21.15.70:6801","nonce":666546661}]},"active_addr":"172.21.15.70:6801/666546661","active_change":"2024-09-20T20:29:37.595932+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3948605922}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3375055735}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":926221132}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":233748559}]}]} 2024-09-20T20:30:03.169 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-20T20:30:03.169 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-20T20:30:03.169 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:30:03.464 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:03.464 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:57.587557+0000","last_up_change":"2024-09-20T20:29:42.497975+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6801","nonce":367188288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6803","nonce":367188288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6807","nonce":367188288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6805","nonce":367188288}]},"public_addr":"172.21.15.79:6801/367188288","cluster_addr":"172.21.15.79:6803/367188288","heartbeat_back_addr":"172.21.15.79:6807/367188288","heartbeat_front_addr":"172.21.15.79:6805/367188288","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:30:03.482 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-20T20:30:03.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:30:03.774 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:03.774 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:57.587557+0000","last_up_change":"2024-09-20T20:29:42.497975+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6801","nonce":367188288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6803","nonce":367188288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6807","nonce":367188288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6805","nonce":367188288}]},"public_addr":"172.21.15.79:6801/367188288","cluster_addr":"172.21.15.79:6803/367188288","heartbeat_back_addr":"172.21.15.79:6807/367188288","heartbeat_front_addr":"172.21.15.79:6805/367188288","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:30:03.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-20T20:30:03.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-20T20:30:03.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-20T20:30:03.959 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2024-09-20T20:30:03.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T20:30:03.960 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2024-09-20T20:30:03.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T20:30:03.961 INFO:teuthology.orchestra.run.smithi070.stdout:34359738376 2024-09-20T20:30:03.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T20:30:04.241 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2024-09-20T20:30:04.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-09-20T20:30:04.302 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2024-09-20T20:30:04.318 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2024-09-20T20:30:04.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-09-20T20:30:04.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.1 2024-09-20T20:30:05.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T20:30:05.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T20:30:05.335 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T20:30:05.589 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2024-09-20T20:30:05.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-09-20T20:30:05.632 INFO:teuthology.orchestra.run.smithi070.stdout:34359738374 2024-09-20T20:30:05.647 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2024-09-20T20:30:05.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-09-20T20:30:05.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.1 2024-09-20T20:30:06.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T20:30:06.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T20:30:06.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T20:30:06.940 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2024-09-20T20:30:06.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-20T20:30:06.958 DEBUG:teuthology.parallel:result is None 2024-09-20T20:30:06.965 INFO:teuthology.orchestra.run.smithi070.stdout:34359738375 2024-09-20T20:30:06.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-09-20T20:30:06.988 DEBUG:teuthology.parallel:result is None 2024-09-20T20:30:07.039 INFO:teuthology.orchestra.run.smithi070.stdout:34359738376 2024-09-20T20:30:07.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.1 2024-09-20T20:30:07.056 DEBUG:teuthology.parallel:result is None 2024-09-20T20:30:07.056 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-20T20:30:07.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:30:07.328 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:07.330 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:30:07.343 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-20T20:30:05.608109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.611547"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594390+0000","last_change":"2024-09-20T20:29:55.007075+0000","last_active":"2024-09-20T20:29:57.594390+0000","last_peered":"2024-09-20T20:29:57.594390+0000","last_clean":"2024-09-20T20:29:57.594390+0000","last_became_active":"2024-09-20T20:29:55.005105+0000","last_became_peered":"2024-09-20T20:29:55.005105+0000","last_unstale":"2024-09-20T20:29:57.594390+0000","last_undegraded":"2024-09-20T20:29:57.594390+0000","last_fullsized":"2024-09-20T20:29:57.594390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593823+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:29:57.593823+0000","last_peered":"2024-09-20T20:29:57.593823+0000","last_clean":"2024-09-20T20:29:57.593823+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:29:57.593823+0000","last_undegraded":"2024-09-20T20:29:57.593823+0000","last_fullsized":"2024-09-20T20:29:57.593823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593699+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:29:57.593699+0000","last_peered":"2024-09-20T20:29:57.593699+0000","last_clean":"2024-09-20T20:29:57.593699+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:29:57.593699+0000","last_undegraded":"2024-09-20T20:29:57.593699+0000","last_fullsized":"2024-09-20T20:29:57.593699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593419+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:29:57.593419+0000","last_peered":"2024-09-20T20:29:57.593419+0000","last_clean":"2024-09-20T20:29:57.593419+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:29:57.593419+0000","last_undegraded":"2024-09-20T20:29:57.593419+0000","last_fullsized":"2024-09-20T20:29:57.593419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593304+0000","last_change":"2024-09-20T20:29:55.001482+0000","last_active":"2024-09-20T20:29:57.593304+0000","last_peered":"2024-09-20T20:29:57.593304+0000","last_clean":"2024-09-20T20:29:57.593304+0000","last_became_active":"2024-09-20T20:29:55.000290+0000","last_became_peered":"2024-09-20T20:29:55.000290+0000","last_unstale":"2024-09-20T20:29:57.593304+0000","last_undegraded":"2024-09-20T20:29:57.593304+0000","last_fullsized":"2024-09-20T20:29:57.593304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592133+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:29:57.592133+0000","last_peered":"2024-09-20T20:29:57.592133+0000","last_clean":"2024-09-20T20:29:57.592133+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:29:57.592133+0000","last_undegraded":"2024-09-20T20:29:57.592133+0000","last_fullsized":"2024-09-20T20:29:57.592133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592055+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:29:57.592055+0000","last_peered":"2024-09-20T20:29:57.592055+0000","last_clean":"2024-09-20T20:29:57.592055+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:29:57.592055+0000","last_undegraded":"2024-09-20T20:29:57.592055+0000","last_fullsized":"2024-09-20T20:29:57.592055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591525+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:29:57.591525+0000","last_peered":"2024-09-20T20:29:57.591525+0000","last_clean":"2024-09-20T20:29:57.591525+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:29:57.591525+0000","last_undegraded":"2024-09-20T20:29:57.591525+0000","last_fullsized":"2024-09-20T20:29:57.591525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591679+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:29:57.591679+0000","last_peered":"2024-09-20T20:29:57.591679+0000","last_clean":"2024-09-20T20:29:57.591679+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:29:57.591679+0000","last_undegraded":"2024-09-20T20:29:57.591679+0000","last_fullsized":"2024-09-20T20:29:57.591679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594009+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:29:57.594009+0000","last_peered":"2024-09-20T20:29:57.594009+0000","last_clean":"2024-09-20T20:29:57.594009+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:29:57.594009+0000","last_undegraded":"2024-09-20T20:29:57.594009+0000","last_fullsized":"2024-09-20T20:29:57.594009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593950+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:29:57.593950+0000","last_peered":"2024-09-20T20:29:57.593950+0000","last_clean":"2024-09-20T20:29:57.593950+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:29:57.593950+0000","last_undegraded":"2024-09-20T20:29:57.593950+0000","last_fullsized":"2024-09-20T20:29:57.593950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593395+0000","last_change":"2024-09-20T20:29:55.012467+0000","last_active":"2024-09-20T20:29:57.593395+0000","last_peered":"2024-09-20T20:29:57.593395+0000","last_clean":"2024-09-20T20:29:57.593395+0000","last_became_active":"2024-09-20T20:29:55.011686+0000","last_became_peered":"2024-09-20T20:29:55.011686+0000","last_unstale":"2024-09-20T20:29:57.593395+0000","last_undegraded":"2024-09-20T20:29:57.593395+0000","last_fullsized":"2024-09-20T20:29:57.593395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592940+0000","last_change":"2024-09-20T20:29:55.006208+0000","last_active":"2024-09-20T20:29:57.592940+0000","last_peered":"2024-09-20T20:29:57.592940+0000","last_clean":"2024-09-20T20:29:57.592940+0000","last_became_active":"2024-09-20T20:29:55.002864+0000","last_became_peered":"2024-09-20T20:29:55.002864+0000","last_unstale":"2024-09-20T20:29:57.592940+0000","last_undegraded":"2024-09-20T20:29:57.592940+0000","last_fullsized":"2024-09-20T20:29:57.592940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592235+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:29:57.592235+0000","last_peered":"2024-09-20T20:29:57.592235+0000","last_clean":"2024-09-20T20:29:57.592235+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:29:57.592235+0000","last_undegraded":"2024-09-20T20:29:57.592235+0000","last_fullsized":"2024-09-20T20:29:57.592235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592226+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:29:57.592226+0000","last_peered":"2024-09-20T20:29:57.592226+0000","last_clean":"2024-09-20T20:29:57.592226+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:29:57.592226+0000","last_undegraded":"2024-09-20T20:29:57.592226+0000","last_fullsized":"2024-09-20T20:29:57.592226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591482+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:29:57.591482+0000","last_peered":"2024-09-20T20:29:57.591482+0000","last_clean":"2024-09-20T20:29:57.591482+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:29:57.591482+0000","last_undegraded":"2024-09-20T20:29:57.591482+0000","last_fullsized":"2024-09-20T20:29:57.591482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592894+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:29:57.592894+0000","last_peered":"2024-09-20T20:29:57.592894+0000","last_clean":"2024-09-20T20:29:57.592894+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:29:57.592894+0000","last_undegraded":"2024-09-20T20:29:57.592894+0000","last_fullsized":"2024-09-20T20:29:57.592894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594068+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:29:57.594068+0000","last_peered":"2024-09-20T20:29:57.594068+0000","last_clean":"2024-09-20T20:29:57.594068+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:29:57.594068+0000","last_undegraded":"2024-09-20T20:29:57.594068+0000","last_fullsized":"2024-09-20T20:29:57.594068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591391+0000","last_change":"2024-09-20T20:29:54.999350+0000","last_active":"2024-09-20T20:29:57.591391+0000","last_peered":"2024-09-20T20:29:57.591391+0000","last_clean":"2024-09-20T20:29:57.591391+0000","last_became_active":"2024-09-20T20:29:54.998741+0000","last_became_peered":"2024-09-20T20:29:54.998741+0000","last_unstale":"2024-09-20T20:29:57.591391+0000","last_undegraded":"2024-09-20T20:29:57.591391+0000","last_fullsized":"2024-09-20T20:29:57.591391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593556+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:29:57.593556+0000","last_peered":"2024-09-20T20:29:57.593556+0000","last_clean":"2024-09-20T20:29:57.593556+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:29:57.593556+0000","last_undegraded":"2024-09-20T20:29:57.593556+0000","last_fullsized":"2024-09-20T20:29:57.593556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592975+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:29:57.592975+0000","last_peered":"2024-09-20T20:29:57.592975+0000","last_clean":"2024-09-20T20:29:57.592975+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:29:57.592975+0000","last_undegraded":"2024-09-20T20:29:57.592975+0000","last_fullsized":"2024-09-20T20:29:57.592975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592502+0000","last_change":"2024-09-20T20:29:55.015082+0000","last_active":"2024-09-20T20:29:57.592502+0000","last_peered":"2024-09-20T20:29:57.592502+0000","last_clean":"2024-09-20T20:29:57.592502+0000","last_became_active":"2024-09-20T20:29:55.012708+0000","last_became_peered":"2024-09-20T20:29:55.012708+0000","last_unstale":"2024-09-20T20:29:57.592502+0000","last_undegraded":"2024-09-20T20:29:57.592502+0000","last_fullsized":"2024-09-20T20:29:57.592502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:24.045731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590012+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:29:57.590012+0000","last_peered":"2024-09-20T20:29:57.590012+0000","last_clean":"2024-09-20T20:29:57.590012+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:29:57.590012+0000","last_undegraded":"2024-09-20T20:29:57.590012+0000","last_fullsized":"2024-09-20T20:29:57.590012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591951+0000","last_change":"2024-09-20T20:29:55.002784+0000","last_active":"2024-09-20T20:29:57.591951+0000","last_peered":"2024-09-20T20:29:57.591951+0000","last_clean":"2024-09-20T20:29:57.591951+0000","last_became_active":"2024-09-20T20:29:55.001575+0000","last_became_peered":"2024-09-20T20:29:55.001575+0000","last_unstale":"2024-09-20T20:29:57.591951+0000","last_undegraded":"2024-09-20T20:29:57.591951+0000","last_fullsized":"2024-09-20T20:29:57.591951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:45.086905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594645+0000","last_change":"2024-09-20T20:29:55.014653+0000","last_active":"2024-09-20T20:29:57.594645+0000","last_peered":"2024-09-20T20:29:57.594645+0000","last_clean":"2024-09-20T20:29:57.594645+0000","last_became_active":"2024-09-20T20:29:55.013806+0000","last_became_peered":"2024-09-20T20:29:55.013806+0000","last_unstale":"2024-09-20T20:29:57.594645+0000","last_undegraded":"2024-09-20T20:29:57.594645+0000","last_fullsized":"2024-09-20T20:29:57.594645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592032+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:29:57.592032+0000","last_peered":"2024-09-20T20:29:57.592032+0000","last_clean":"2024-09-20T20:29:57.592032+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:29:57.592032+0000","last_undegraded":"2024-09-20T20:29:57.592032+0000","last_fullsized":"2024-09-20T20:29:57.592032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594255+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:29:57.594255+0000","last_peered":"2024-09-20T20:29:57.594255+0000","last_clean":"2024-09-20T20:29:57.594255+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:29:57.594255+0000","last_undegraded":"2024-09-20T20:29:57.594255+0000","last_fullsized":"2024-09-20T20:29:57.594255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594065+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:29:57.594065+0000","last_peered":"2024-09-20T20:29:57.594065+0000","last_clean":"2024-09-20T20:29:57.594065+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:29:57.594065+0000","last_undegraded":"2024-09-20T20:29:57.594065+0000","last_fullsized":"2024-09-20T20:29:57.594065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591517+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:29:57.591517+0000","last_peered":"2024-09-20T20:29:57.591517+0000","last_clean":"2024-09-20T20:29:57.591517+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:29:57.591517+0000","last_undegraded":"2024-09-20T20:29:57.591517+0000","last_fullsized":"2024-09-20T20:29:57.591517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592863+0000","last_change":"2024-09-20T20:29:55.014505+0000","last_active":"2024-09-20T20:29:57.592863+0000","last_peered":"2024-09-20T20:29:57.592863+0000","last_clean":"2024-09-20T20:29:57.592863+0000","last_became_active":"2024-09-20T20:29:55.012721+0000","last_became_peered":"2024-09-20T20:29:55.012721+0000","last_unstale":"2024-09-20T20:29:57.592863+0000","last_undegraded":"2024-09-20T20:29:57.592863+0000","last_fullsized":"2024-09-20T20:29:57.592863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590169+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:29:57.590169+0000","last_peered":"2024-09-20T20:29:57.590169+0000","last_clean":"2024-09-20T20:29:57.590169+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:29:57.590169+0000","last_undegraded":"2024-09-20T20:29:57.590169+0000","last_fullsized":"2024-09-20T20:29:57.590169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591691+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:29:57.591691+0000","last_peered":"2024-09-20T20:29:57.591691+0000","last_clean":"2024-09-20T20:29:57.591691+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:29:57.591691+0000","last_undegraded":"2024-09-20T20:29:57.591691+0000","last_fullsized":"2024-09-20T20:29:57.591691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594004+0000","last_change":"2024-09-20T20:29:55.001960+0000","last_active":"2024-09-20T20:29:57.594004+0000","last_peered":"2024-09-20T20:29:57.594004+0000","last_clean":"2024-09-20T20:29:57.594004+0000","last_became_active":"2024-09-20T20:29:55.001033+0000","last_became_peered":"2024-09-20T20:29:55.001033+0000","last_unstale":"2024-09-20T20:29:57.594004+0000","last_undegraded":"2024-09-20T20:29:57.594004+0000","last_fullsized":"2024-09-20T20:29:57.594004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593125+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:29:57.593125+0000","last_peered":"2024-09-20T20:29:57.593125+0000","last_clean":"2024-09-20T20:29:57.593125+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:29:57.593125+0000","last_undegraded":"2024-09-20T20:29:57.593125+0000","last_fullsized":"2024-09-20T20:29:57.593125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593494+0000","last_change":"2024-09-20T20:29:55.006411+0000","last_active":"2024-09-20T20:29:57.593494+0000","last_peered":"2024-09-20T20:29:57.593494+0000","last_clean":"2024-09-20T20:29:57.593494+0000","last_became_active":"2024-09-20T20:29:55.004960+0000","last_became_peered":"2024-09-20T20:29:55.004960+0000","last_unstale":"2024-09-20T20:29:57.593494+0000","last_undegraded":"2024-09-20T20:29:57.593494+0000","last_fullsized":"2024-09-20T20:29:57.593494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590823+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:29:57.590823+0000","last_peered":"2024-09-20T20:29:57.590823+0000","last_clean":"2024-09-20T20:29:57.590823+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:29:57.590823+0000","last_undegraded":"2024-09-20T20:29:57.590823+0000","last_fullsized":"2024-09-20T20:29:57.590823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592575+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:29:57.592575+0000","last_peered":"2024-09-20T20:29:57.592575+0000","last_clean":"2024-09-20T20:29:57.592575+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:29:57.592575+0000","last_undegraded":"2024-09-20T20:29:57.592575+0000","last_fullsized":"2024-09-20T20:29:57.592575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592468+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:29:57.592468+0000","last_peered":"2024-09-20T20:29:57.592468+0000","last_clean":"2024-09-20T20:29:57.592468+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:29:57.592468+0000","last_undegraded":"2024-09-20T20:29:57.592468+0000","last_fullsized":"2024-09-20T20:29:57.592468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592413+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:29:57.592413+0000","last_peered":"2024-09-20T20:29:57.592413+0000","last_clean":"2024-09-20T20:29:57.592413+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:29:57.592413+0000","last_undegraded":"2024-09-20T20:29:57.592413+0000","last_fullsized":"2024-09-20T20:29:57.592413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591791+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:29:57.591791+0000","last_peered":"2024-09-20T20:29:57.591791+0000","last_clean":"2024-09-20T20:29:57.591791+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:29:57.591791+0000","last_undegraded":"2024-09-20T20:29:57.591791+0000","last_fullsized":"2024-09-20T20:29:57.591791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594458+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:29:57.594458+0000","last_peered":"2024-09-20T20:29:57.594458+0000","last_clean":"2024-09-20T20:29:57.594458+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:29:57.594458+0000","last_undegraded":"2024-09-20T20:29:57.594458+0000","last_fullsized":"2024-09-20T20:29:57.594458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592083+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:29:57.592083+0000","last_peered":"2024-09-20T20:29:57.592083+0000","last_clean":"2024-09-20T20:29:57.592083+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:29:57.592083+0000","last_undegraded":"2024-09-20T20:29:57.592083+0000","last_fullsized":"2024-09-20T20:29:57.592083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594387+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:29:57.594387+0000","last_peered":"2024-09-20T20:29:57.594387+0000","last_clean":"2024-09-20T20:29:57.594387+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:29:57.594387+0000","last_undegraded":"2024-09-20T20:29:57.594387+0000","last_fullsized":"2024-09-20T20:29:57.594387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592138+0000","last_change":"2024-09-20T20:29:55.006455+0000","last_active":"2024-09-20T20:29:57.592138+0000","last_peered":"2024-09-20T20:29:57.592138+0000","last_clean":"2024-09-20T20:29:57.592138+0000","last_became_active":"2024-09-20T20:29:55.004010+0000","last_became_peered":"2024-09-20T20:29:55.004010+0000","last_unstale":"2024-09-20T20:29:57.592138+0000","last_undegraded":"2024-09-20T20:29:57.592138+0000","last_fullsized":"2024-09-20T20:29:57.592138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:20.842224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594769+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:29:57.594769+0000","last_peered":"2024-09-20T20:29:57.594769+0000","last_clean":"2024-09-20T20:29:57.594769+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:29:57.594769+0000","last_undegraded":"2024-09-20T20:29:57.594769+0000","last_fullsized":"2024-09-20T20:29:57.594769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592379+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:29:57.592379+0000","last_peered":"2024-09-20T20:29:57.592379+0000","last_clean":"2024-09-20T20:29:57.592379+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:29:57.592379+0000","last_undegraded":"2024-09-20T20:29:57.592379+0000","last_fullsized":"2024-09-20T20:29:57.592379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594413+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:29:57.594413+0000","last_peered":"2024-09-20T20:29:57.594413+0000","last_clean":"2024-09-20T20:29:57.594413+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:29:57.594413+0000","last_undegraded":"2024-09-20T20:29:57.594413+0000","last_fullsized":"2024-09-20T20:29:57.594413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591064+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:29:57.591064+0000","last_peered":"2024-09-20T20:29:57.591064+0000","last_clean":"2024-09-20T20:29:57.591064+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:29:57.591064+0000","last_undegraded":"2024-09-20T20:29:57.591064+0000","last_fullsized":"2024-09-20T20:29:57.591064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591558+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:29:57.591558+0000","last_peered":"2024-09-20T20:29:57.591558+0000","last_clean":"2024-09-20T20:29:57.591558+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:29:57.591558+0000","last_undegraded":"2024-09-20T20:29:57.591558+0000","last_fullsized":"2024-09-20T20:29:57.591558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594239+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:29:57.594239+0000","last_peered":"2024-09-20T20:29:57.594239+0000","last_clean":"2024-09-20T20:29:57.594239+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:29:57.594239+0000","last_undegraded":"2024-09-20T20:29:57.594239+0000","last_fullsized":"2024-09-20T20:29:57.594239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592628+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:29:57.592628+0000","last_peered":"2024-09-20T20:29:57.592628+0000","last_clean":"2024-09-20T20:29:57.592628+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:29:57.592628+0000","last_undegraded":"2024-09-20T20:29:57.592628+0000","last_fullsized":"2024-09-20T20:29:57.592628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594505+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:29:57.594505+0000","last_peered":"2024-09-20T20:29:57.594505+0000","last_clean":"2024-09-20T20:29:57.594505+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:29:57.594505+0000","last_undegraded":"2024-09-20T20:29:57.594505+0000","last_fullsized":"2024-09-20T20:29:57.594505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592805+0000","last_change":"2024-09-20T20:29:54.001861+0000","last_active":"2024-09-20T20:29:57.592805+0000","last_peered":"2024-09-20T20:29:57.592805+0000","last_clean":"2024-09-20T20:29:57.592805+0000","last_became_active":"2024-09-20T20:29:54.000965+0000","last_became_peered":"2024-09-20T20:29:54.000965+0000","last_unstale":"2024-09-20T20:29:57.592805+0000","last_undegraded":"2024-09-20T20:29:57.592805+0000","last_fullsized":"2024-09-20T20:29:57.592805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:28.103332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593778+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:29:57.593778+0000","last_peered":"2024-09-20T20:29:57.593778+0000","last_clean":"2024-09-20T20:29:57.593778+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:29:57.593778+0000","last_undegraded":"2024-09-20T20:29:57.593778+0000","last_fullsized":"2024-09-20T20:29:57.593778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592180+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:29:57.592180+0000","last_peered":"2024-09-20T20:29:57.592180+0000","last_clean":"2024-09-20T20:29:57.592180+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:29:57.592180+0000","last_undegraded":"2024-09-20T20:29:57.592180+0000","last_fullsized":"2024-09-20T20:29:57.592180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592009+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:29:57.592009+0000","last_peered":"2024-09-20T20:29:57.592009+0000","last_clean":"2024-09-20T20:29:57.592009+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:29:57.592009+0000","last_undegraded":"2024-09-20T20:29:57.592009+0000","last_fullsized":"2024-09-20T20:29:57.592009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592119+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:57.592119+0000","last_peered":"2024-09-20T20:29:57.592119+0000","last_clean":"2024-09-20T20:29:57.592119+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:57.592119+0000","last_undegraded":"2024-09-20T20:29:57.592119+0000","last_fullsized":"2024-09-20T20:29:57.592119+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593368+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:57.593368+0000","last_peered":"2024-09-20T20:29:57.593368+0000","last_clean":"2024-09-20T20:29:57.593368+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:57.593368+0000","last_undegraded":"2024-09-20T20:29:57.593368+0000","last_fullsized":"2024-09-20T20:29:57.593368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591134+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:29:57.591134+0000","last_peered":"2024-09-20T20:29:57.591134+0000","last_clean":"2024-09-20T20:29:57.591134+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:29:57.591134+0000","last_undegraded":"2024-09-20T20:29:57.591134+0000","last_fullsized":"2024-09-20T20:29:57.591134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594567+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:29:57.594567+0000","last_peered":"2024-09-20T20:29:57.594567+0000","last_clean":"2024-09-20T20:29:57.594567+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:29:57.594567+0000","last_undegraded":"2024-09-20T20:29:57.594567+0000","last_fullsized":"2024-09-20T20:29:57.594567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592052+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:57.592052+0000","last_peered":"2024-09-20T20:29:57.592052+0000","last_clean":"2024-09-20T20:29:57.592052+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:57.592052+0000","last_undegraded":"2024-09-20T20:29:57.592052+0000","last_fullsized":"2024-09-20T20:29:57.592052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590779+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:29:57.590779+0000","last_peered":"2024-09-20T20:29:57.590779+0000","last_clean":"2024-09-20T20:29:57.590779+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:29:57.590779+0000","last_undegraded":"2024-09-20T20:29:57.590779+0000","last_fullsized":"2024-09-20T20:29:57.590779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594373+0000","last_change":"2024-09-20T20:29:55.007379+0000","last_active":"2024-09-20T20:29:57.594373+0000","last_peered":"2024-09-20T20:29:57.594373+0000","last_clean":"2024-09-20T20:29:57.594373+0000","last_became_active":"2024-09-20T20:29:55.005006+0000","last_became_peered":"2024-09-20T20:29:55.005006+0000","last_unstale":"2024-09-20T20:29:57.594373+0000","last_undegraded":"2024-09-20T20:29:57.594373+0000","last_fullsized":"2024-09-20T20:29:57.594373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591245+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:57.591245+0000","last_peered":"2024-09-20T20:29:57.591245+0000","last_clean":"2024-09-20T20:29:57.591245+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:57.591245+0000","last_undegraded":"2024-09-20T20:29:57.591245+0000","last_fullsized":"2024-09-20T20:29:57.591245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:54.000434+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:53.999658+0000","last_became_peered":"2024-09-20T20:29:53.999658+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:31.923210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592275+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:29:57.592275+0000","last_peered":"2024-09-20T20:29:57.592275+0000","last_clean":"2024-09-20T20:29:57.592275+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:29:57.592275+0000","last_undegraded":"2024-09-20T20:29:57.592275+0000","last_fullsized":"2024-09-20T20:29:57.592275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592825+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:57.592825+0000","last_peered":"2024-09-20T20:29:57.592825+0000","last_clean":"2024-09-20T20:29:57.592825+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:57.592825+0000","last_undegraded":"2024-09-20T20:29:57.592825+0000","last_fullsized":"2024-09-20T20:29:57.592825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593206+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:29:57.593206+0000","last_peered":"2024-09-20T20:29:57.593206+0000","last_clean":"2024-09-20T20:29:57.593206+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:29:57.593206+0000","last_undegraded":"2024-09-20T20:29:57.593206+0000","last_fullsized":"2024-09-20T20:29:57.593206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591843+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:29:57.591843+0000","last_peered":"2024-09-20T20:29:57.591843+0000","last_clean":"2024-09-20T20:29:57.591843+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:29:57.591843+0000","last_undegraded":"2024-09-20T20:29:57.591843+0000","last_fullsized":"2024-09-20T20:29:57.591843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594707+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:29:57.594707+0000","last_peered":"2024-09-20T20:29:57.594707+0000","last_clean":"2024-09-20T20:29:57.594707+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:29:57.594707+0000","last_undegraded":"2024-09-20T20:29:57.594707+0000","last_fullsized":"2024-09-20T20:29:57.594707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593023+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:29:57.593023+0000","last_peered":"2024-09-20T20:29:57.593023+0000","last_clean":"2024-09-20T20:29:57.593023+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:29:57.593023+0000","last_undegraded":"2024-09-20T20:29:57.593023+0000","last_fullsized":"2024-09-20T20:29:57.593023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592094+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:29:57.592094+0000","last_peered":"2024-09-20T20:29:57.592094+0000","last_clean":"2024-09-20T20:29:57.592094+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:29:57.592094+0000","last_undegraded":"2024-09-20T20:29:57.592094+0000","last_fullsized":"2024-09-20T20:29:57.592094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594126+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:57.594126+0000","last_peered":"2024-09-20T20:29:57.594126+0000","last_clean":"2024-09-20T20:29:57.594126+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:57.594126+0000","last_undegraded":"2024-09-20T20:29:57.594126+0000","last_fullsized":"2024-09-20T20:29:57.594126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593059+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:29:57.593059+0000","last_peered":"2024-09-20T20:29:57.593059+0000","last_clean":"2024-09-20T20:29:57.593059+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:29:57.593059+0000","last_undegraded":"2024-09-20T20:29:57.593059+0000","last_fullsized":"2024-09-20T20:29:57.593059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593061+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:29:57.593061+0000","last_peered":"2024-09-20T20:29:57.593061+0000","last_clean":"2024-09-20T20:29:57.593061+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:29:57.593061+0000","last_undegraded":"2024-09-20T20:29:57.593061+0000","last_fullsized":"2024-09-20T20:29:57.593061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592854+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:57.592854+0000","last_peered":"2024-09-20T20:29:57.592854+0000","last_clean":"2024-09-20T20:29:57.592854+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:57.592854+0000","last_undegraded":"2024-09-20T20:29:57.592854+0000","last_fullsized":"2024-09-20T20:29:57.592854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590342+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:29:57.590342+0000","last_peered":"2024-09-20T20:29:57.590342+0000","last_clean":"2024-09-20T20:29:57.590342+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:29:57.590342+0000","last_undegraded":"2024-09-20T20:29:57.590342+0000","last_fullsized":"2024-09-20T20:29:57.590342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592849+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:29:57.592849+0000","last_peered":"2024-09-20T20:29:57.592849+0000","last_clean":"2024-09-20T20:29:57.592849+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:29:57.592849+0000","last_undegraded":"2024-09-20T20:29:57.592849+0000","last_fullsized":"2024-09-20T20:29:57.592849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594408+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:57.594408+0000","last_peered":"2024-09-20T20:29:57.594408+0000","last_clean":"2024-09-20T20:29:57.594408+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:57.594408+0000","last_undegraded":"2024-09-20T20:29:57.594408+0000","last_fullsized":"2024-09-20T20:29:57.594408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592661+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:29:57.592661+0000","last_peered":"2024-09-20T20:29:57.592661+0000","last_clean":"2024-09-20T20:29:57.592661+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:29:57.592661+0000","last_undegraded":"2024-09-20T20:29:57.592661+0000","last_fullsized":"2024-09-20T20:29:57.592661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592767+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:29:57.592767+0000","last_peered":"2024-09-20T20:29:57.592767+0000","last_clean":"2024-09-20T20:29:57.592767+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:29:57.592767+0000","last_undegraded":"2024-09-20T20:29:57.592767+0000","last_fullsized":"2024-09-20T20:29:57.592767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594136+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:29:57.594136+0000","last_peered":"2024-09-20T20:29:57.594136+0000","last_clean":"2024-09-20T20:29:57.594136+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:29:57.594136+0000","last_undegraded":"2024-09-20T20:29:57.594136+0000","last_fullsized":"2024-09-20T20:29:57.594136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590881+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:29:57.590881+0000","last_peered":"2024-09-20T20:29:57.590881+0000","last_clean":"2024-09-20T20:29:57.590881+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:29:57.590881+0000","last_undegraded":"2024-09-20T20:29:57.590881+0000","last_fullsized":"2024-09-20T20:29:57.590881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594037+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:29:57.594037+0000","last_peered":"2024-09-20T20:29:57.594037+0000","last_clean":"2024-09-20T20:29:57.594037+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:29:57.594037+0000","last_undegraded":"2024-09-20T20:29:57.594037+0000","last_fullsized":"2024-09-20T20:29:57.594037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594030+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:29:57.594030+0000","last_peered":"2024-09-20T20:29:57.594030+0000","last_clean":"2024-09-20T20:29:57.594030+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:29:57.594030+0000","last_undegraded":"2024-09-20T20:29:57.594030+0000","last_fullsized":"2024-09-20T20:29:57.594030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590305+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:29:57.590305+0000","last_peered":"2024-09-20T20:29:57.590305+0000","last_clean":"2024-09-20T20:29:57.590305+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:29:57.590305+0000","last_undegraded":"2024-09-20T20:29:57.590305+0000","last_fullsized":"2024-09-20T20:29:57.590305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592804+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:29:57.592804+0000","last_peered":"2024-09-20T20:29:57.592804+0000","last_clean":"2024-09-20T20:29:57.592804+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:29:57.592804+0000","last_undegraded":"2024-09-20T20:29:57.592804+0000","last_fullsized":"2024-09-20T20:29:57.592804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590221+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:29:57.590221+0000","last_peered":"2024-09-20T20:29:57.590221+0000","last_clean":"2024-09-20T20:29:57.590221+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:29:57.590221+0000","last_undegraded":"2024-09-20T20:29:57.590221+0000","last_fullsized":"2024-09-20T20:29:57.590221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594834+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:29:57.594834+0000","last_peered":"2024-09-20T20:29:57.594834+0000","last_clean":"2024-09-20T20:29:57.594834+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:29:57.594834+0000","last_undegraded":"2024-09-20T20:29:57.594834+0000","last_fullsized":"2024-09-20T20:29:57.594834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590499+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:29:57.590499+0000","last_peered":"2024-09-20T20:29:57.590499+0000","last_clean":"2024-09-20T20:29:57.590499+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:29:57.590499+0000","last_undegraded":"2024-09-20T20:29:57.590499+0000","last_fullsized":"2024-09-20T20:29:57.590499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592213+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:29:57.592213+0000","last_peered":"2024-09-20T20:29:57.592213+0000","last_clean":"2024-09-20T20:29:57.592213+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:29:57.592213+0000","last_undegraded":"2024-09-20T20:29:57.592213+0000","last_fullsized":"2024-09-20T20:29:57.592213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590675+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:29:57.590675+0000","last_peered":"2024-09-20T20:29:57.590675+0000","last_clean":"2024-09-20T20:29:57.590675+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:29:57.590675+0000","last_undegraded":"2024-09-20T20:29:57.590675+0000","last_fullsized":"2024-09-20T20:29:57.590675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593420+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:29:57.593420+0000","last_peered":"2024-09-20T20:29:57.593420+0000","last_clean":"2024-09-20T20:29:57.593420+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:29:57.593420+0000","last_undegraded":"2024-09-20T20:29:57.593420+0000","last_fullsized":"2024-09-20T20:29:57.593420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593148+0000","last_change":"2024-09-20T20:29:53.995769+0000","last_active":"2024-09-20T20:29:57.593148+0000","last_peered":"2024-09-20T20:29:57.593148+0000","last_clean":"2024-09-20T20:29:57.593148+0000","last_became_active":"2024-09-20T20:29:53.994788+0000","last_became_peered":"2024-09-20T20:29:53.994788+0000","last_unstale":"2024-09-20T20:29:57.593148+0000","last_undegraded":"2024-09-20T20:29:57.593148+0000","last_fullsized":"2024-09-20T20:29:57.593148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:58.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593654+0000","last_change":"2024-09-20T20:29:55.004166+0000","last_active":"2024-09-20T20:29:57.593654+0000","last_peered":"2024-09-20T20:29:57.593654+0000","last_clean":"2024-09-20T20:29:57.593654+0000","last_became_active":"2024-09-20T20:29:55.002511+0000","last_became_peered":"2024-09-20T20:29:55.002511+0000","last_unstale":"2024-09-20T20:29:57.593654+0000","last_undegraded":"2024-09-20T20:29:57.593654+0000","last_fullsized":"2024-09-20T20:29:57.593654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593507+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:29:57.593507+0000","last_peered":"2024-09-20T20:29:57.593507+0000","last_clean":"2024-09-20T20:29:57.593507+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:29:57.593507+0000","last_undegraded":"2024-09-20T20:29:57.593507+0000","last_fullsized":"2024-09-20T20:29:57.593507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592500+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:29:57.592500+0000","last_peered":"2024-09-20T20:29:57.592500+0000","last_clean":"2024-09-20T20:29:57.592500+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:29:57.592500+0000","last_undegraded":"2024-09-20T20:29:57.592500+0000","last_fullsized":"2024-09-20T20:29:57.592500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593828+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:29:57.593828+0000","last_peered":"2024-09-20T20:29:57.593828+0000","last_clean":"2024-09-20T20:29:57.593828+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:29:57.593828+0000","last_undegraded":"2024-09-20T20:29:57.593828+0000","last_fullsized":"2024-09-20T20:29:57.593828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592557+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:29:57.592557+0000","last_peered":"2024-09-20T20:29:57.592557+0000","last_clean":"2024-09-20T20:29:57.592557+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:29:57.592557+0000","last_undegraded":"2024-09-20T20:29:57.592557+0000","last_fullsized":"2024-09-20T20:29:57.592557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593691+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:29:57.593691+0000","last_peered":"2024-09-20T20:29:57.593691+0000","last_clean":"2024-09-20T20:29:57.593691+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:29:57.593691+0000","last_undegraded":"2024-09-20T20:29:57.593691+0000","last_fullsized":"2024-09-20T20:29:57.593691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593091+0000","last_change":"2024-09-20T20:29:55.001408+0000","last_active":"2024-09-20T20:29:57.593091+0000","last_peered":"2024-09-20T20:29:57.593091+0000","last_clean":"2024-09-20T20:29:57.593091+0000","last_became_active":"2024-09-20T20:29:55.000076+0000","last_became_peered":"2024-09-20T20:29:55.000076+0000","last_unstale":"2024-09-20T20:29:57.593091+0000","last_undegraded":"2024-09-20T20:29:57.593091+0000","last_fullsized":"2024-09-20T20:29:57.593091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592547+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:29:57.592547+0000","last_peered":"2024-09-20T20:29:57.592547+0000","last_clean":"2024-09-20T20:29:57.592547+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:29:57.592547+0000","last_undegraded":"2024-09-20T20:29:57.592547+0000","last_fullsized":"2024-09-20T20:29:57.592547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591986+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:29:57.591986+0000","last_peered":"2024-09-20T20:29:57.591986+0000","last_clean":"2024-09-20T20:29:57.591986+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:29:57.591986+0000","last_undegraded":"2024-09-20T20:29:57.591986+0000","last_fullsized":"2024-09-20T20:29:57.591986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592554+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:29:57.592554+0000","last_peered":"2024-09-20T20:29:57.592554+0000","last_clean":"2024-09-20T20:29:57.592554+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:29:57.592554+0000","last_undegraded":"2024-09-20T20:29:57.592554+0000","last_fullsized":"2024-09-20T20:29:57.592554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:30:07.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:07.688 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:30:07.702 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-20T20:30:07.608704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.017407"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594390+0000","last_change":"2024-09-20T20:29:55.007075+0000","last_active":"2024-09-20T20:29:57.594390+0000","last_peered":"2024-09-20T20:29:57.594390+0000","last_clean":"2024-09-20T20:29:57.594390+0000","last_became_active":"2024-09-20T20:29:55.005105+0000","last_became_peered":"2024-09-20T20:29:55.005105+0000","last_unstale":"2024-09-20T20:29:57.594390+0000","last_undegraded":"2024-09-20T20:29:57.594390+0000","last_fullsized":"2024-09-20T20:29:57.594390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593823+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:29:57.593823+0000","last_peered":"2024-09-20T20:29:57.593823+0000","last_clean":"2024-09-20T20:29:57.593823+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:29:57.593823+0000","last_undegraded":"2024-09-20T20:29:57.593823+0000","last_fullsized":"2024-09-20T20:29:57.593823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593699+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:29:57.593699+0000","last_peered":"2024-09-20T20:29:57.593699+0000","last_clean":"2024-09-20T20:29:57.593699+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:29:57.593699+0000","last_undegraded":"2024-09-20T20:29:57.593699+0000","last_fullsized":"2024-09-20T20:29:57.593699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593419+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:29:57.593419+0000","last_peered":"2024-09-20T20:29:57.593419+0000","last_clean":"2024-09-20T20:29:57.593419+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:29:57.593419+0000","last_undegraded":"2024-09-20T20:29:57.593419+0000","last_fullsized":"2024-09-20T20:29:57.593419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593304+0000","last_change":"2024-09-20T20:29:55.001482+0000","last_active":"2024-09-20T20:29:57.593304+0000","last_peered":"2024-09-20T20:29:57.593304+0000","last_clean":"2024-09-20T20:29:57.593304+0000","last_became_active":"2024-09-20T20:29:55.000290+0000","last_became_peered":"2024-09-20T20:29:55.000290+0000","last_unstale":"2024-09-20T20:29:57.593304+0000","last_undegraded":"2024-09-20T20:29:57.593304+0000","last_fullsized":"2024-09-20T20:29:57.593304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592133+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:29:57.592133+0000","last_peered":"2024-09-20T20:29:57.592133+0000","last_clean":"2024-09-20T20:29:57.592133+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:29:57.592133+0000","last_undegraded":"2024-09-20T20:29:57.592133+0000","last_fullsized":"2024-09-20T20:29:57.592133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592055+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:29:57.592055+0000","last_peered":"2024-09-20T20:29:57.592055+0000","last_clean":"2024-09-20T20:29:57.592055+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:29:57.592055+0000","last_undegraded":"2024-09-20T20:29:57.592055+0000","last_fullsized":"2024-09-20T20:29:57.592055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591525+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:29:57.591525+0000","last_peered":"2024-09-20T20:29:57.591525+0000","last_clean":"2024-09-20T20:29:57.591525+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:29:57.591525+0000","last_undegraded":"2024-09-20T20:29:57.591525+0000","last_fullsized":"2024-09-20T20:29:57.591525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591679+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:29:57.591679+0000","last_peered":"2024-09-20T20:29:57.591679+0000","last_clean":"2024-09-20T20:29:57.591679+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:29:57.591679+0000","last_undegraded":"2024-09-20T20:29:57.591679+0000","last_fullsized":"2024-09-20T20:29:57.591679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594009+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:29:57.594009+0000","last_peered":"2024-09-20T20:29:57.594009+0000","last_clean":"2024-09-20T20:29:57.594009+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:29:57.594009+0000","last_undegraded":"2024-09-20T20:29:57.594009+0000","last_fullsized":"2024-09-20T20:29:57.594009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593950+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:29:57.593950+0000","last_peered":"2024-09-20T20:29:57.593950+0000","last_clean":"2024-09-20T20:29:57.593950+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:29:57.593950+0000","last_undegraded":"2024-09-20T20:29:57.593950+0000","last_fullsized":"2024-09-20T20:29:57.593950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593395+0000","last_change":"2024-09-20T20:29:55.012467+0000","last_active":"2024-09-20T20:29:57.593395+0000","last_peered":"2024-09-20T20:29:57.593395+0000","last_clean":"2024-09-20T20:29:57.593395+0000","last_became_active":"2024-09-20T20:29:55.011686+0000","last_became_peered":"2024-09-20T20:29:55.011686+0000","last_unstale":"2024-09-20T20:29:57.593395+0000","last_undegraded":"2024-09-20T20:29:57.593395+0000","last_fullsized":"2024-09-20T20:29:57.593395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592940+0000","last_change":"2024-09-20T20:29:55.006208+0000","last_active":"2024-09-20T20:29:57.592940+0000","last_peered":"2024-09-20T20:29:57.592940+0000","last_clean":"2024-09-20T20:29:57.592940+0000","last_became_active":"2024-09-20T20:29:55.002864+0000","last_became_peered":"2024-09-20T20:29:55.002864+0000","last_unstale":"2024-09-20T20:29:57.592940+0000","last_undegraded":"2024-09-20T20:29:57.592940+0000","last_fullsized":"2024-09-20T20:29:57.592940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592235+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:29:57.592235+0000","last_peered":"2024-09-20T20:29:57.592235+0000","last_clean":"2024-09-20T20:29:57.592235+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:29:57.592235+0000","last_undegraded":"2024-09-20T20:29:57.592235+0000","last_fullsized":"2024-09-20T20:29:57.592235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592226+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:29:57.592226+0000","last_peered":"2024-09-20T20:29:57.592226+0000","last_clean":"2024-09-20T20:29:57.592226+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:29:57.592226+0000","last_undegraded":"2024-09-20T20:29:57.592226+0000","last_fullsized":"2024-09-20T20:29:57.592226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591482+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:29:57.591482+0000","last_peered":"2024-09-20T20:29:57.591482+0000","last_clean":"2024-09-20T20:29:57.591482+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:29:57.591482+0000","last_undegraded":"2024-09-20T20:29:57.591482+0000","last_fullsized":"2024-09-20T20:29:57.591482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592894+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:29:57.592894+0000","last_peered":"2024-09-20T20:29:57.592894+0000","last_clean":"2024-09-20T20:29:57.592894+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:29:57.592894+0000","last_undegraded":"2024-09-20T20:29:57.592894+0000","last_fullsized":"2024-09-20T20:29:57.592894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594068+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:29:57.594068+0000","last_peered":"2024-09-20T20:29:57.594068+0000","last_clean":"2024-09-20T20:29:57.594068+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:29:57.594068+0000","last_undegraded":"2024-09-20T20:29:57.594068+0000","last_fullsized":"2024-09-20T20:29:57.594068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591391+0000","last_change":"2024-09-20T20:29:54.999350+0000","last_active":"2024-09-20T20:29:57.591391+0000","last_peered":"2024-09-20T20:29:57.591391+0000","last_clean":"2024-09-20T20:29:57.591391+0000","last_became_active":"2024-09-20T20:29:54.998741+0000","last_became_peered":"2024-09-20T20:29:54.998741+0000","last_unstale":"2024-09-20T20:29:57.591391+0000","last_undegraded":"2024-09-20T20:29:57.591391+0000","last_fullsized":"2024-09-20T20:29:57.591391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593556+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:29:57.593556+0000","last_peered":"2024-09-20T20:29:57.593556+0000","last_clean":"2024-09-20T20:29:57.593556+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:29:57.593556+0000","last_undegraded":"2024-09-20T20:29:57.593556+0000","last_fullsized":"2024-09-20T20:29:57.593556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592975+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:29:57.592975+0000","last_peered":"2024-09-20T20:29:57.592975+0000","last_clean":"2024-09-20T20:29:57.592975+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:29:57.592975+0000","last_undegraded":"2024-09-20T20:29:57.592975+0000","last_fullsized":"2024-09-20T20:29:57.592975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592502+0000","last_change":"2024-09-20T20:29:55.015082+0000","last_active":"2024-09-20T20:29:57.592502+0000","last_peered":"2024-09-20T20:29:57.592502+0000","last_clean":"2024-09-20T20:29:57.592502+0000","last_became_active":"2024-09-20T20:29:55.012708+0000","last_became_peered":"2024-09-20T20:29:55.012708+0000","last_unstale":"2024-09-20T20:29:57.592502+0000","last_undegraded":"2024-09-20T20:29:57.592502+0000","last_fullsized":"2024-09-20T20:29:57.592502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:24.045731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590012+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:29:57.590012+0000","last_peered":"2024-09-20T20:29:57.590012+0000","last_clean":"2024-09-20T20:29:57.590012+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:29:57.590012+0000","last_undegraded":"2024-09-20T20:29:57.590012+0000","last_fullsized":"2024-09-20T20:29:57.590012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591951+0000","last_change":"2024-09-20T20:29:55.002784+0000","last_active":"2024-09-20T20:29:57.591951+0000","last_peered":"2024-09-20T20:29:57.591951+0000","last_clean":"2024-09-20T20:29:57.591951+0000","last_became_active":"2024-09-20T20:29:55.001575+0000","last_became_peered":"2024-09-20T20:29:55.001575+0000","last_unstale":"2024-09-20T20:29:57.591951+0000","last_undegraded":"2024-09-20T20:29:57.591951+0000","last_fullsized":"2024-09-20T20:29:57.591951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:45.086905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594645+0000","last_change":"2024-09-20T20:29:55.014653+0000","last_active":"2024-09-20T20:29:57.594645+0000","last_peered":"2024-09-20T20:29:57.594645+0000","last_clean":"2024-09-20T20:29:57.594645+0000","last_became_active":"2024-09-20T20:29:55.013806+0000","last_became_peered":"2024-09-20T20:29:55.013806+0000","last_unstale":"2024-09-20T20:29:57.594645+0000","last_undegraded":"2024-09-20T20:29:57.594645+0000","last_fullsized":"2024-09-20T20:29:57.594645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592032+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:29:57.592032+0000","last_peered":"2024-09-20T20:29:57.592032+0000","last_clean":"2024-09-20T20:29:57.592032+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:29:57.592032+0000","last_undegraded":"2024-09-20T20:29:57.592032+0000","last_fullsized":"2024-09-20T20:29:57.592032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594255+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:29:57.594255+0000","last_peered":"2024-09-20T20:29:57.594255+0000","last_clean":"2024-09-20T20:29:57.594255+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:29:57.594255+0000","last_undegraded":"2024-09-20T20:29:57.594255+0000","last_fullsized":"2024-09-20T20:29:57.594255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594065+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:29:57.594065+0000","last_peered":"2024-09-20T20:29:57.594065+0000","last_clean":"2024-09-20T20:29:57.594065+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:29:57.594065+0000","last_undegraded":"2024-09-20T20:29:57.594065+0000","last_fullsized":"2024-09-20T20:29:57.594065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591517+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:29:57.591517+0000","last_peered":"2024-09-20T20:29:57.591517+0000","last_clean":"2024-09-20T20:29:57.591517+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:29:57.591517+0000","last_undegraded":"2024-09-20T20:29:57.591517+0000","last_fullsized":"2024-09-20T20:29:57.591517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592863+0000","last_change":"2024-09-20T20:29:55.014505+0000","last_active":"2024-09-20T20:29:57.592863+0000","last_peered":"2024-09-20T20:29:57.592863+0000","last_clean":"2024-09-20T20:29:57.592863+0000","last_became_active":"2024-09-20T20:29:55.012721+0000","last_became_peered":"2024-09-20T20:29:55.012721+0000","last_unstale":"2024-09-20T20:29:57.592863+0000","last_undegraded":"2024-09-20T20:29:57.592863+0000","last_fullsized":"2024-09-20T20:29:57.592863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590169+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:29:57.590169+0000","last_peered":"2024-09-20T20:29:57.590169+0000","last_clean":"2024-09-20T20:29:57.590169+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:29:57.590169+0000","last_undegraded":"2024-09-20T20:29:57.590169+0000","last_fullsized":"2024-09-20T20:29:57.590169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591691+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:29:57.591691+0000","last_peered":"2024-09-20T20:29:57.591691+0000","last_clean":"2024-09-20T20:29:57.591691+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:29:57.591691+0000","last_undegraded":"2024-09-20T20:29:57.591691+0000","last_fullsized":"2024-09-20T20:29:57.591691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594004+0000","last_change":"2024-09-20T20:29:55.001960+0000","last_active":"2024-09-20T20:29:57.594004+0000","last_peered":"2024-09-20T20:29:57.594004+0000","last_clean":"2024-09-20T20:29:57.594004+0000","last_became_active":"2024-09-20T20:29:55.001033+0000","last_became_peered":"2024-09-20T20:29:55.001033+0000","last_unstale":"2024-09-20T20:29:57.594004+0000","last_undegraded":"2024-09-20T20:29:57.594004+0000","last_fullsized":"2024-09-20T20:29:57.594004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593125+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:29:57.593125+0000","last_peered":"2024-09-20T20:29:57.593125+0000","last_clean":"2024-09-20T20:29:57.593125+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:29:57.593125+0000","last_undegraded":"2024-09-20T20:29:57.593125+0000","last_fullsized":"2024-09-20T20:29:57.593125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593494+0000","last_change":"2024-09-20T20:29:55.006411+0000","last_active":"2024-09-20T20:29:57.593494+0000","last_peered":"2024-09-20T20:29:57.593494+0000","last_clean":"2024-09-20T20:29:57.593494+0000","last_became_active":"2024-09-20T20:29:55.004960+0000","last_became_peered":"2024-09-20T20:29:55.004960+0000","last_unstale":"2024-09-20T20:29:57.593494+0000","last_undegraded":"2024-09-20T20:29:57.593494+0000","last_fullsized":"2024-09-20T20:29:57.593494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590823+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:29:57.590823+0000","last_peered":"2024-09-20T20:29:57.590823+0000","last_clean":"2024-09-20T20:29:57.590823+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:29:57.590823+0000","last_undegraded":"2024-09-20T20:29:57.590823+0000","last_fullsized":"2024-09-20T20:29:57.590823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592575+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:29:57.592575+0000","last_peered":"2024-09-20T20:29:57.592575+0000","last_clean":"2024-09-20T20:29:57.592575+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:29:57.592575+0000","last_undegraded":"2024-09-20T20:29:57.592575+0000","last_fullsized":"2024-09-20T20:29:57.592575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592468+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:29:57.592468+0000","last_peered":"2024-09-20T20:29:57.592468+0000","last_clean":"2024-09-20T20:29:57.592468+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:29:57.592468+0000","last_undegraded":"2024-09-20T20:29:57.592468+0000","last_fullsized":"2024-09-20T20:29:57.592468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592413+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:29:57.592413+0000","last_peered":"2024-09-20T20:29:57.592413+0000","last_clean":"2024-09-20T20:29:57.592413+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:29:57.592413+0000","last_undegraded":"2024-09-20T20:29:57.592413+0000","last_fullsized":"2024-09-20T20:29:57.592413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591791+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:29:57.591791+0000","last_peered":"2024-09-20T20:29:57.591791+0000","last_clean":"2024-09-20T20:29:57.591791+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:29:57.591791+0000","last_undegraded":"2024-09-20T20:29:57.591791+0000","last_fullsized":"2024-09-20T20:29:57.591791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594458+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:29:57.594458+0000","last_peered":"2024-09-20T20:29:57.594458+0000","last_clean":"2024-09-20T20:29:57.594458+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:29:57.594458+0000","last_undegraded":"2024-09-20T20:29:57.594458+0000","last_fullsized":"2024-09-20T20:29:57.594458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592083+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:29:57.592083+0000","last_peered":"2024-09-20T20:29:57.592083+0000","last_clean":"2024-09-20T20:29:57.592083+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:29:57.592083+0000","last_undegraded":"2024-09-20T20:29:57.592083+0000","last_fullsized":"2024-09-20T20:29:57.592083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594387+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:29:57.594387+0000","last_peered":"2024-09-20T20:29:57.594387+0000","last_clean":"2024-09-20T20:29:57.594387+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:29:57.594387+0000","last_undegraded":"2024-09-20T20:29:57.594387+0000","last_fullsized":"2024-09-20T20:29:57.594387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592138+0000","last_change":"2024-09-20T20:29:55.006455+0000","last_active":"2024-09-20T20:29:57.592138+0000","last_peered":"2024-09-20T20:29:57.592138+0000","last_clean":"2024-09-20T20:29:57.592138+0000","last_became_active":"2024-09-20T20:29:55.004010+0000","last_became_peered":"2024-09-20T20:29:55.004010+0000","last_unstale":"2024-09-20T20:29:57.592138+0000","last_undegraded":"2024-09-20T20:29:57.592138+0000","last_fullsized":"2024-09-20T20:29:57.592138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:20.842224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594769+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:29:57.594769+0000","last_peered":"2024-09-20T20:29:57.594769+0000","last_clean":"2024-09-20T20:29:57.594769+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:29:57.594769+0000","last_undegraded":"2024-09-20T20:29:57.594769+0000","last_fullsized":"2024-09-20T20:29:57.594769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592379+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:29:57.592379+0000","last_peered":"2024-09-20T20:29:57.592379+0000","last_clean":"2024-09-20T20:29:57.592379+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:29:57.592379+0000","last_undegraded":"2024-09-20T20:29:57.592379+0000","last_fullsized":"2024-09-20T20:29:57.592379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594413+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:29:57.594413+0000","last_peered":"2024-09-20T20:29:57.594413+0000","last_clean":"2024-09-20T20:29:57.594413+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:29:57.594413+0000","last_undegraded":"2024-09-20T20:29:57.594413+0000","last_fullsized":"2024-09-20T20:29:57.594413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591064+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:29:57.591064+0000","last_peered":"2024-09-20T20:29:57.591064+0000","last_clean":"2024-09-20T20:29:57.591064+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:29:57.591064+0000","last_undegraded":"2024-09-20T20:29:57.591064+0000","last_fullsized":"2024-09-20T20:29:57.591064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591558+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:29:57.591558+0000","last_peered":"2024-09-20T20:29:57.591558+0000","last_clean":"2024-09-20T20:29:57.591558+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:29:57.591558+0000","last_undegraded":"2024-09-20T20:29:57.591558+0000","last_fullsized":"2024-09-20T20:29:57.591558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594239+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:29:57.594239+0000","last_peered":"2024-09-20T20:29:57.594239+0000","last_clean":"2024-09-20T20:29:57.594239+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:29:57.594239+0000","last_undegraded":"2024-09-20T20:29:57.594239+0000","last_fullsized":"2024-09-20T20:29:57.594239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592628+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:29:57.592628+0000","last_peered":"2024-09-20T20:29:57.592628+0000","last_clean":"2024-09-20T20:29:57.592628+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:29:57.592628+0000","last_undegraded":"2024-09-20T20:29:57.592628+0000","last_fullsized":"2024-09-20T20:29:57.592628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594505+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:29:57.594505+0000","last_peered":"2024-09-20T20:29:57.594505+0000","last_clean":"2024-09-20T20:29:57.594505+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:29:57.594505+0000","last_undegraded":"2024-09-20T20:29:57.594505+0000","last_fullsized":"2024-09-20T20:29:57.594505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592805+0000","last_change":"2024-09-20T20:29:54.001861+0000","last_active":"2024-09-20T20:29:57.592805+0000","last_peered":"2024-09-20T20:29:57.592805+0000","last_clean":"2024-09-20T20:29:57.592805+0000","last_became_active":"2024-09-20T20:29:54.000965+0000","last_became_peered":"2024-09-20T20:29:54.000965+0000","last_unstale":"2024-09-20T20:29:57.592805+0000","last_undegraded":"2024-09-20T20:29:57.592805+0000","last_fullsized":"2024-09-20T20:29:57.592805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:28.103332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593778+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:29:57.593778+0000","last_peered":"2024-09-20T20:29:57.593778+0000","last_clean":"2024-09-20T20:29:57.593778+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:29:57.593778+0000","last_undegraded":"2024-09-20T20:29:57.593778+0000","last_fullsized":"2024-09-20T20:29:57.593778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592180+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:29:57.592180+0000","last_peered":"2024-09-20T20:29:57.592180+0000","last_clean":"2024-09-20T20:29:57.592180+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:29:57.592180+0000","last_undegraded":"2024-09-20T20:29:57.592180+0000","last_fullsized":"2024-09-20T20:29:57.592180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592009+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:29:57.592009+0000","last_peered":"2024-09-20T20:29:57.592009+0000","last_clean":"2024-09-20T20:29:57.592009+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:29:57.592009+0000","last_undegraded":"2024-09-20T20:29:57.592009+0000","last_fullsized":"2024-09-20T20:29:57.592009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592119+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:57.592119+0000","last_peered":"2024-09-20T20:29:57.592119+0000","last_clean":"2024-09-20T20:29:57.592119+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:57.592119+0000","last_undegraded":"2024-09-20T20:29:57.592119+0000","last_fullsized":"2024-09-20T20:29:57.592119+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593368+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:57.593368+0000","last_peered":"2024-09-20T20:29:57.593368+0000","last_clean":"2024-09-20T20:29:57.593368+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:57.593368+0000","last_undegraded":"2024-09-20T20:29:57.593368+0000","last_fullsized":"2024-09-20T20:29:57.593368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591134+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:29:57.591134+0000","last_peered":"2024-09-20T20:29:57.591134+0000","last_clean":"2024-09-20T20:29:57.591134+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:29:57.591134+0000","last_undegraded":"2024-09-20T20:29:57.591134+0000","last_fullsized":"2024-09-20T20:29:57.591134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594567+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:29:57.594567+0000","last_peered":"2024-09-20T20:29:57.594567+0000","last_clean":"2024-09-20T20:29:57.594567+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:29:57.594567+0000","last_undegraded":"2024-09-20T20:29:57.594567+0000","last_fullsized":"2024-09-20T20:29:57.594567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592052+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:57.592052+0000","last_peered":"2024-09-20T20:29:57.592052+0000","last_clean":"2024-09-20T20:29:57.592052+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:57.592052+0000","last_undegraded":"2024-09-20T20:29:57.592052+0000","last_fullsized":"2024-09-20T20:29:57.592052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590779+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:29:57.590779+0000","last_peered":"2024-09-20T20:29:57.590779+0000","last_clean":"2024-09-20T20:29:57.590779+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:29:57.590779+0000","last_undegraded":"2024-09-20T20:29:57.590779+0000","last_fullsized":"2024-09-20T20:29:57.590779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594373+0000","last_change":"2024-09-20T20:29:55.007379+0000","last_active":"2024-09-20T20:29:57.594373+0000","last_peered":"2024-09-20T20:29:57.594373+0000","last_clean":"2024-09-20T20:29:57.594373+0000","last_became_active":"2024-09-20T20:29:55.005006+0000","last_became_peered":"2024-09-20T20:29:55.005006+0000","last_unstale":"2024-09-20T20:29:57.594373+0000","last_undegraded":"2024-09-20T20:29:57.594373+0000","last_fullsized":"2024-09-20T20:29:57.594373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591245+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:57.591245+0000","last_peered":"2024-09-20T20:29:57.591245+0000","last_clean":"2024-09-20T20:29:57.591245+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:57.591245+0000","last_undegraded":"2024-09-20T20:29:57.591245+0000","last_fullsized":"2024-09-20T20:29:57.591245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:54.000434+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:53.999658+0000","last_became_peered":"2024-09-20T20:29:53.999658+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:31.923210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592275+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:29:57.592275+0000","last_peered":"2024-09-20T20:29:57.592275+0000","last_clean":"2024-09-20T20:29:57.592275+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:29:57.592275+0000","last_undegraded":"2024-09-20T20:29:57.592275+0000","last_fullsized":"2024-09-20T20:29:57.592275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592825+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:57.592825+0000","last_peered":"2024-09-20T20:29:57.592825+0000","last_clean":"2024-09-20T20:29:57.592825+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:57.592825+0000","last_undegraded":"2024-09-20T20:29:57.592825+0000","last_fullsized":"2024-09-20T20:29:57.592825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593206+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:29:57.593206+0000","last_peered":"2024-09-20T20:29:57.593206+0000","last_clean":"2024-09-20T20:29:57.593206+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:29:57.593206+0000","last_undegraded":"2024-09-20T20:29:57.593206+0000","last_fullsized":"2024-09-20T20:29:57.593206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591843+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:29:57.591843+0000","last_peered":"2024-09-20T20:29:57.591843+0000","last_clean":"2024-09-20T20:29:57.591843+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:29:57.591843+0000","last_undegraded":"2024-09-20T20:29:57.591843+0000","last_fullsized":"2024-09-20T20:29:57.591843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594707+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:29:57.594707+0000","last_peered":"2024-09-20T20:29:57.594707+0000","last_clean":"2024-09-20T20:29:57.594707+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:29:57.594707+0000","last_undegraded":"2024-09-20T20:29:57.594707+0000","last_fullsized":"2024-09-20T20:29:57.594707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593023+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:29:57.593023+0000","last_peered":"2024-09-20T20:29:57.593023+0000","last_clean":"2024-09-20T20:29:57.593023+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:29:57.593023+0000","last_undegraded":"2024-09-20T20:29:57.593023+0000","last_fullsized":"2024-09-20T20:29:57.593023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592094+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:29:57.592094+0000","last_peered":"2024-09-20T20:29:57.592094+0000","last_clean":"2024-09-20T20:29:57.592094+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:29:57.592094+0000","last_undegraded":"2024-09-20T20:29:57.592094+0000","last_fullsized":"2024-09-20T20:29:57.592094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594126+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:57.594126+0000","last_peered":"2024-09-20T20:29:57.594126+0000","last_clean":"2024-09-20T20:29:57.594126+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:57.594126+0000","last_undegraded":"2024-09-20T20:29:57.594126+0000","last_fullsized":"2024-09-20T20:29:57.594126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593059+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:29:57.593059+0000","last_peered":"2024-09-20T20:29:57.593059+0000","last_clean":"2024-09-20T20:29:57.593059+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:29:57.593059+0000","last_undegraded":"2024-09-20T20:29:57.593059+0000","last_fullsized":"2024-09-20T20:29:57.593059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593061+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:29:57.593061+0000","last_peered":"2024-09-20T20:29:57.593061+0000","last_clean":"2024-09-20T20:29:57.593061+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:29:57.593061+0000","last_undegraded":"2024-09-20T20:29:57.593061+0000","last_fullsized":"2024-09-20T20:29:57.593061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592854+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:57.592854+0000","last_peered":"2024-09-20T20:29:57.592854+0000","last_clean":"2024-09-20T20:29:57.592854+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:57.592854+0000","last_undegraded":"2024-09-20T20:29:57.592854+0000","last_fullsized":"2024-09-20T20:29:57.592854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590342+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:29:57.590342+0000","last_peered":"2024-09-20T20:29:57.590342+0000","last_clean":"2024-09-20T20:29:57.590342+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:29:57.590342+0000","last_undegraded":"2024-09-20T20:29:57.590342+0000","last_fullsized":"2024-09-20T20:29:57.590342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592849+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:29:57.592849+0000","last_peered":"2024-09-20T20:29:57.592849+0000","last_clean":"2024-09-20T20:29:57.592849+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:29:57.592849+0000","last_undegraded":"2024-09-20T20:29:57.592849+0000","last_fullsized":"2024-09-20T20:29:57.592849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594408+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:57.594408+0000","last_peered":"2024-09-20T20:29:57.594408+0000","last_clean":"2024-09-20T20:29:57.594408+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:57.594408+0000","last_undegraded":"2024-09-20T20:29:57.594408+0000","last_fullsized":"2024-09-20T20:29:57.594408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592661+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:29:57.592661+0000","last_peered":"2024-09-20T20:29:57.592661+0000","last_clean":"2024-09-20T20:29:57.592661+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:29:57.592661+0000","last_undegraded":"2024-09-20T20:29:57.592661+0000","last_fullsized":"2024-09-20T20:29:57.592661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592767+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:29:57.592767+0000","last_peered":"2024-09-20T20:29:57.592767+0000","last_clean":"2024-09-20T20:29:57.592767+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:29:57.592767+0000","last_undegraded":"2024-09-20T20:29:57.592767+0000","last_fullsized":"2024-09-20T20:29:57.592767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594136+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:29:57.594136+0000","last_peered":"2024-09-20T20:29:57.594136+0000","last_clean":"2024-09-20T20:29:57.594136+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:29:57.594136+0000","last_undegraded":"2024-09-20T20:29:57.594136+0000","last_fullsized":"2024-09-20T20:29:57.594136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590881+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:29:57.590881+0000","last_peered":"2024-09-20T20:29:57.590881+0000","last_clean":"2024-09-20T20:29:57.590881+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:29:57.590881+0000","last_undegraded":"2024-09-20T20:29:57.590881+0000","last_fullsized":"2024-09-20T20:29:57.590881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594037+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:29:57.594037+0000","last_peered":"2024-09-20T20:29:57.594037+0000","last_clean":"2024-09-20T20:29:57.594037+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:29:57.594037+0000","last_undegraded":"2024-09-20T20:29:57.594037+0000","last_fullsized":"2024-09-20T20:29:57.594037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594030+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:29:57.594030+0000","last_peered":"2024-09-20T20:29:57.594030+0000","last_clean":"2024-09-20T20:29:57.594030+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:29:57.594030+0000","last_undegraded":"2024-09-20T20:29:57.594030+0000","last_fullsized":"2024-09-20T20:29:57.594030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590305+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:29:57.590305+0000","last_peered":"2024-09-20T20:29:57.590305+0000","last_clean":"2024-09-20T20:29:57.590305+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:29:57.590305+0000","last_undegraded":"2024-09-20T20:29:57.590305+0000","last_fullsized":"2024-09-20T20:29:57.590305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592804+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:29:57.592804+0000","last_peered":"2024-09-20T20:29:57.592804+0000","last_clean":"2024-09-20T20:29:57.592804+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:29:57.592804+0000","last_undegraded":"2024-09-20T20:29:57.592804+0000","last_fullsized":"2024-09-20T20:29:57.592804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590221+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:29:57.590221+0000","last_peered":"2024-09-20T20:29:57.590221+0000","last_clean":"2024-09-20T20:29:57.590221+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:29:57.590221+0000","last_undegraded":"2024-09-20T20:29:57.590221+0000","last_fullsized":"2024-09-20T20:29:57.590221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594834+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:29:57.594834+0000","last_peered":"2024-09-20T20:29:57.594834+0000","last_clean":"2024-09-20T20:29:57.594834+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:29:57.594834+0000","last_undegraded":"2024-09-20T20:29:57.594834+0000","last_fullsized":"2024-09-20T20:29:57.594834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590499+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:29:57.590499+0000","last_peered":"2024-09-20T20:29:57.590499+0000","last_clean":"2024-09-20T20:29:57.590499+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:29:57.590499+0000","last_undegraded":"2024-09-20T20:29:57.590499+0000","last_fullsized":"2024-09-20T20:29:57.590499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592213+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:29:57.592213+0000","last_peered":"2024-09-20T20:29:57.592213+0000","last_clean":"2024-09-20T20:29:57.592213+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:29:57.592213+0000","last_undegraded":"2024-09-20T20:29:57.592213+0000","last_fullsized":"2024-09-20T20:29:57.592213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590675+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:29:57.590675+0000","last_peered":"2024-09-20T20:29:57.590675+0000","last_clean":"2024-09-20T20:29:57.590675+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:29:57.590675+0000","last_undegraded":"2024-09-20T20:29:57.590675+0000","last_fullsized":"2024-09-20T20:29:57.590675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593420+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:29:57.593420+0000","last_peered":"2024-09-20T20:29:57.593420+0000","last_clean":"2024-09-20T20:29:57.593420+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:29:57.593420+0000","last_undegraded":"2024-09-20T20:29:57.593420+0000","last_fullsized":"2024-09-20T20:29:57.593420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593148+0000","last_change":"2024-09-20T20:29:53.995769+0000","last_active":"2024-09-20T20:29:57.593148+0000","last_peered":"2024-09-20T20:29:57.593148+0000","last_clean":"2024-09-20T20:29:57.593148+0000","last_became_active":"2024-09-20T20:29:53.994788+0000","last_became_peered":"2024-09-20T20:29:53.994788+0000","last_unstale":"2024-09-20T20:29:57.593148+0000","last_undegraded":"2024-09-20T20:29:57.593148+0000","last_fullsized":"2024-09-20T20:29:57.593148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:58.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593654+0000","last_change":"2024-09-20T20:29:55.004166+0000","last_active":"2024-09-20T20:29:57.593654+0000","last_peered":"2024-09-20T20:29:57.593654+0000","last_clean":"2024-09-20T20:29:57.593654+0000","last_became_active":"2024-09-20T20:29:55.002511+0000","last_became_peered":"2024-09-20T20:29:55.002511+0000","last_unstale":"2024-09-20T20:29:57.593654+0000","last_undegraded":"2024-09-20T20:29:57.593654+0000","last_fullsized":"2024-09-20T20:29:57.593654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593507+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:29:57.593507+0000","last_peered":"2024-09-20T20:29:57.593507+0000","last_clean":"2024-09-20T20:29:57.593507+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:29:57.593507+0000","last_undegraded":"2024-09-20T20:29:57.593507+0000","last_fullsized":"2024-09-20T20:29:57.593507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592500+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:29:57.592500+0000","last_peered":"2024-09-20T20:29:57.592500+0000","last_clean":"2024-09-20T20:29:57.592500+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:29:57.592500+0000","last_undegraded":"2024-09-20T20:29:57.592500+0000","last_fullsized":"2024-09-20T20:29:57.592500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593828+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:29:57.593828+0000","last_peered":"2024-09-20T20:29:57.593828+0000","last_clean":"2024-09-20T20:29:57.593828+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:29:57.593828+0000","last_undegraded":"2024-09-20T20:29:57.593828+0000","last_fullsized":"2024-09-20T20:29:57.593828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592557+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:29:57.592557+0000","last_peered":"2024-09-20T20:29:57.592557+0000","last_clean":"2024-09-20T20:29:57.592557+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:29:57.592557+0000","last_undegraded":"2024-09-20T20:29:57.592557+0000","last_fullsized":"2024-09-20T20:29:57.592557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593691+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:29:57.593691+0000","last_peered":"2024-09-20T20:29:57.593691+0000","last_clean":"2024-09-20T20:29:57.593691+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:29:57.593691+0000","last_undegraded":"2024-09-20T20:29:57.593691+0000","last_fullsized":"2024-09-20T20:29:57.593691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593091+0000","last_change":"2024-09-20T20:29:55.001408+0000","last_active":"2024-09-20T20:29:57.593091+0000","last_peered":"2024-09-20T20:29:57.593091+0000","last_clean":"2024-09-20T20:29:57.593091+0000","last_became_active":"2024-09-20T20:29:55.000076+0000","last_became_peered":"2024-09-20T20:29:55.000076+0000","last_unstale":"2024-09-20T20:29:57.593091+0000","last_undegraded":"2024-09-20T20:29:57.593091+0000","last_fullsized":"2024-09-20T20:29:57.593091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592547+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:29:57.592547+0000","last_peered":"2024-09-20T20:29:57.592547+0000","last_clean":"2024-09-20T20:29:57.592547+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:29:57.592547+0000","last_undegraded":"2024-09-20T20:29:57.592547+0000","last_fullsized":"2024-09-20T20:29:57.592547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591986+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:29:57.591986+0000","last_peered":"2024-09-20T20:29:57.591986+0000","last_clean":"2024-09-20T20:29:57.591986+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:29:57.591986+0000","last_undegraded":"2024-09-20T20:29:57.591986+0000","last_fullsized":"2024-09-20T20:29:57.591986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592554+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:29:57.592554+0000","last_peered":"2024-09-20T20:29:57.592554+0000","last_clean":"2024-09-20T20:29:57.592554+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:29:57.592554+0000","last_undegraded":"2024-09-20T20:29:57.592554+0000","last_fullsized":"2024-09-20T20:29:57.592554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:30:07.707 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-20T20:30:07.707 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-20T20:30:07.707 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-20T20:30:07.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-20T20:30:08.069 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:08.070 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-20T20:30:08.087 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-20T20:30:08.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T20:30:08.398 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:08.398 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T20:29:54.341626+0000","modified":"2024-09-20T20:29:56.333455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.70:6803/89722736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":89722736},{"type":"v1","addr":"172.21.15.70:6803","nonce":89722736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-09-20T20:30:08.398 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-09-20T20:30:08.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T20:30:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:08.730 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T20:29:54.341626+0000","modified":"2024-09-20T20:29:56.333455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.70:6803/89722736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":89722736},{"type":"v1","addr":"172.21.15.70:6803","nonce":89722736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-09-20T20:30:08.731 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-09-20T20:30:08.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:30:09.026 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:09.027 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:29:57.587557+0000","last_up_change":"2024-09-20T20:29:42.497975+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6801","nonce":367188288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6803","nonce":367188288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6807","nonce":367188288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":367188288},{"type":"v1","addr":"172.21.15.79:6805","nonce":367188288}]},"public_addr":"172.21.15.79:6801/367188288","cluster_addr":"172.21.15.79:6803/367188288","heartbeat_back_addr":"172.21.15.79:6807/367188288","heartbeat_front_addr":"172.21.15.79:6805/367188288","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:30:09.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T20:30:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:09.346 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T20:29:54.341626+0000","modified":"2024-09-20T20:29:56.333455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.70:6803/89722736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":89722736},{"type":"v1","addr":"172.21.15.70:6803","nonce":89722736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-09-20T20:30:09.346 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-09-20T20:30:09.464 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-20T20:29:54.341626+0000', 'modified': '2024-09-20T20:29:56.333455+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4230}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4230': {'gid': 4230, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.70:6803/89722736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 89722736}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 89722736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4230, 'qdb_cluster': [4230]} 2024-09-20T20:30:09.464 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-20T20:30:09.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-20T20:30:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:09.602+0000 7f381bfff640 0 client.4554 ms_handle_reset on v2:172.21.15.70:6802/89722736 2024-09-20T20:30:09.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:09.626+0000 7f381bfff640 0 client.4414 ms_handle_reset on v2:172.21.15.70:6802/89722736 2024-09-20T20:30:09.625 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:30:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "49cfe37c-8fc4-44b8-a85f-d53d77eb9d19", 2024-09-20T20:30:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-20T20:30:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4230, 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 14.648785828999999, 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 5, 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 20, 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 19, 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 17.687109960000001 2024-09-20T20:30:09.626 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:30:09.641 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-20T20:30:09.653 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-20T20:30:09.654 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9e2ac70bb7aea67d34f0d50002344abbe7803736'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ed8ee0f26ef720e6504cefa8be1a2d0872192de7'}} 2024-09-20T20:30:09.654 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-20T20:30:09.654 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-20T20:30:09.654 DEBUG:teuthology.orchestra.run.smithi070:> sync 2024-09-20T20:30:09.948 DEBUG:teuthology.orchestra.run.smithi079:> sync 2024-09-20T20:30:10.006 DEBUG:teuthology.orchestra.run.smithi090:> sync 2024-09-20T20:30:10.137 DEBUG:teuthology.orchestra.run.smithi187:> sync 2024-09-20T20:30:10.197 DEBUG:tasks.thrashosds:checking console status of smithi070 2024-09-20T20:30:10.197 DEBUG:teuthology.orchestra.console.smithi070:Waiting for login prompt 2024-09-20T20:30:10.197 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi070 2024-09-20T20:30:10.330 DEBUG:teuthology.orchestra.console.smithi070:expect before: [Enter `^Ec?' for help] 2024-09-20T20:30:10.330 DEBUG:teuthology.orchestra.console.smithi070:expect after: smithi070 login: 2024-09-20T20:30:10.382 DEBUG:teuthology.orchestra.console.smithi070:console disconnect output: [Enter `^Ec?' for help] smithi070 login: [disconnect] 2024-09-20T20:30:10.484 DEBUG:tasks.thrashosds:checking console status of smithi079 2024-09-20T20:30:10.484 DEBUG:teuthology.orchestra.console.smithi079:Waiting for login prompt 2024-09-20T20:30:10.484 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi079 2024-09-20T20:30:10.610 DEBUG:teuthology.orchestra.console.smithi079:expect before: [Enter `^Ec?' for help] 2024-09-20T20:30:10.610 DEBUG:teuthology.orchestra.console.smithi079:expect after: smithi079 login: 2024-09-20T20:30:10.662 DEBUG:teuthology.orchestra.console.smithi079:console disconnect output: [Enter `^Ec?' for help] smithi079 login: [disconnect] 2024-09-20T20:30:10.764 DEBUG:tasks.thrashosds:checking console status of smithi090 2024-09-20T20:30:10.764 DEBUG:teuthology.orchestra.console.smithi090:Waiting for login prompt 2024-09-20T20:30:10.764 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi090 2024-09-20T20:30:10.928 DEBUG:teuthology.orchestra.console.smithi090:expect before: [Enter `^Ec?' for help] 2024-09-20T20:30:10.929 DEBUG:teuthology.orchestra.console.smithi090:expect after: smithi090 login: 2024-09-20T20:30:10.980 DEBUG:teuthology.orchestra.console.smithi090:console disconnect output: [Enter `^Ec?' for help] smithi090 login: [disconnect] 2024-09-20T20:30:11.081 DEBUG:tasks.thrashosds:checking console status of smithi187 2024-09-20T20:30:11.082 DEBUG:teuthology.orchestra.console.smithi187:Waiting for login prompt 2024-09-20T20:30:11.082 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi187 2024-09-20T20:30:11.239 DEBUG:teuthology.orchestra.console.smithi187:expect before: [Enter `^Ec?' for help] 2024-09-20T20:30:11.239 DEBUG:teuthology.orchestra.console.smithi187:expect after: smithi187 login: 2024-09-20T20:30:11.291 DEBUG:teuthology.orchestra.console.smithi187:console disconnect output: [Enter `^Ec?' for help] smithi187 login: [disconnect] 2024-09-20T20:30:11.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-20T20:30:11.736 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-20T20:30:11.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-20T20:30:11.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:30:12.047 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:12.049 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:30:12.064 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-20T20:30:11.609785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003539"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594390+0000","last_change":"2024-09-20T20:29:55.007075+0000","last_active":"2024-09-20T20:29:57.594390+0000","last_peered":"2024-09-20T20:29:57.594390+0000","last_clean":"2024-09-20T20:29:57.594390+0000","last_became_active":"2024-09-20T20:29:55.005105+0000","last_became_peered":"2024-09-20T20:29:55.005105+0000","last_unstale":"2024-09-20T20:29:57.594390+0000","last_undegraded":"2024-09-20T20:29:57.594390+0000","last_fullsized":"2024-09-20T20:29:57.594390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593823+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:29:57.593823+0000","last_peered":"2024-09-20T20:29:57.593823+0000","last_clean":"2024-09-20T20:29:57.593823+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:29:57.593823+0000","last_undegraded":"2024-09-20T20:29:57.593823+0000","last_fullsized":"2024-09-20T20:29:57.593823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593699+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:29:57.593699+0000","last_peered":"2024-09-20T20:29:57.593699+0000","last_clean":"2024-09-20T20:29:57.593699+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:29:57.593699+0000","last_undegraded":"2024-09-20T20:29:57.593699+0000","last_fullsized":"2024-09-20T20:29:57.593699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593419+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:29:57.593419+0000","last_peered":"2024-09-20T20:29:57.593419+0000","last_clean":"2024-09-20T20:29:57.593419+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:29:57.593419+0000","last_undegraded":"2024-09-20T20:29:57.593419+0000","last_fullsized":"2024-09-20T20:29:57.593419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593304+0000","last_change":"2024-09-20T20:29:55.001482+0000","last_active":"2024-09-20T20:29:57.593304+0000","last_peered":"2024-09-20T20:29:57.593304+0000","last_clean":"2024-09-20T20:29:57.593304+0000","last_became_active":"2024-09-20T20:29:55.000290+0000","last_became_peered":"2024-09-20T20:29:55.000290+0000","last_unstale":"2024-09-20T20:29:57.593304+0000","last_undegraded":"2024-09-20T20:29:57.593304+0000","last_fullsized":"2024-09-20T20:29:57.593304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592133+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:29:57.592133+0000","last_peered":"2024-09-20T20:29:57.592133+0000","last_clean":"2024-09-20T20:29:57.592133+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:29:57.592133+0000","last_undegraded":"2024-09-20T20:29:57.592133+0000","last_fullsized":"2024-09-20T20:29:57.592133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592055+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:29:57.592055+0000","last_peered":"2024-09-20T20:29:57.592055+0000","last_clean":"2024-09-20T20:29:57.592055+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:29:57.592055+0000","last_undegraded":"2024-09-20T20:29:57.592055+0000","last_fullsized":"2024-09-20T20:29:57.592055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591525+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:29:57.591525+0000","last_peered":"2024-09-20T20:29:57.591525+0000","last_clean":"2024-09-20T20:29:57.591525+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:29:57.591525+0000","last_undegraded":"2024-09-20T20:29:57.591525+0000","last_fullsized":"2024-09-20T20:29:57.591525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591679+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:29:57.591679+0000","last_peered":"2024-09-20T20:29:57.591679+0000","last_clean":"2024-09-20T20:29:57.591679+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:29:57.591679+0000","last_undegraded":"2024-09-20T20:29:57.591679+0000","last_fullsized":"2024-09-20T20:29:57.591679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594009+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:29:57.594009+0000","last_peered":"2024-09-20T20:29:57.594009+0000","last_clean":"2024-09-20T20:29:57.594009+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:29:57.594009+0000","last_undegraded":"2024-09-20T20:29:57.594009+0000","last_fullsized":"2024-09-20T20:29:57.594009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593950+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:29:57.593950+0000","last_peered":"2024-09-20T20:29:57.593950+0000","last_clean":"2024-09-20T20:29:57.593950+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:29:57.593950+0000","last_undegraded":"2024-09-20T20:29:57.593950+0000","last_fullsized":"2024-09-20T20:29:57.593950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593395+0000","last_change":"2024-09-20T20:29:55.012467+0000","last_active":"2024-09-20T20:29:57.593395+0000","last_peered":"2024-09-20T20:29:57.593395+0000","last_clean":"2024-09-20T20:29:57.593395+0000","last_became_active":"2024-09-20T20:29:55.011686+0000","last_became_peered":"2024-09-20T20:29:55.011686+0000","last_unstale":"2024-09-20T20:29:57.593395+0000","last_undegraded":"2024-09-20T20:29:57.593395+0000","last_fullsized":"2024-09-20T20:29:57.593395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592940+0000","last_change":"2024-09-20T20:29:55.006208+0000","last_active":"2024-09-20T20:29:57.592940+0000","last_peered":"2024-09-20T20:29:57.592940+0000","last_clean":"2024-09-20T20:29:57.592940+0000","last_became_active":"2024-09-20T20:29:55.002864+0000","last_became_peered":"2024-09-20T20:29:55.002864+0000","last_unstale":"2024-09-20T20:29:57.592940+0000","last_undegraded":"2024-09-20T20:29:57.592940+0000","last_fullsized":"2024-09-20T20:29:57.592940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592235+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:29:57.592235+0000","last_peered":"2024-09-20T20:29:57.592235+0000","last_clean":"2024-09-20T20:29:57.592235+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:29:57.592235+0000","last_undegraded":"2024-09-20T20:29:57.592235+0000","last_fullsized":"2024-09-20T20:29:57.592235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592226+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:29:57.592226+0000","last_peered":"2024-09-20T20:29:57.592226+0000","last_clean":"2024-09-20T20:29:57.592226+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:29:57.592226+0000","last_undegraded":"2024-09-20T20:29:57.592226+0000","last_fullsized":"2024-09-20T20:29:57.592226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591482+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:29:57.591482+0000","last_peered":"2024-09-20T20:29:57.591482+0000","last_clean":"2024-09-20T20:29:57.591482+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:29:57.591482+0000","last_undegraded":"2024-09-20T20:29:57.591482+0000","last_fullsized":"2024-09-20T20:29:57.591482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592894+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:29:57.592894+0000","last_peered":"2024-09-20T20:29:57.592894+0000","last_clean":"2024-09-20T20:29:57.592894+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:29:57.592894+0000","last_undegraded":"2024-09-20T20:29:57.592894+0000","last_fullsized":"2024-09-20T20:29:57.592894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594068+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:29:57.594068+0000","last_peered":"2024-09-20T20:29:57.594068+0000","last_clean":"2024-09-20T20:29:57.594068+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:29:57.594068+0000","last_undegraded":"2024-09-20T20:29:57.594068+0000","last_fullsized":"2024-09-20T20:29:57.594068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591391+0000","last_change":"2024-09-20T20:29:54.999350+0000","last_active":"2024-09-20T20:29:57.591391+0000","last_peered":"2024-09-20T20:29:57.591391+0000","last_clean":"2024-09-20T20:29:57.591391+0000","last_became_active":"2024-09-20T20:29:54.998741+0000","last_became_peered":"2024-09-20T20:29:54.998741+0000","last_unstale":"2024-09-20T20:29:57.591391+0000","last_undegraded":"2024-09-20T20:29:57.591391+0000","last_fullsized":"2024-09-20T20:29:57.591391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593556+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:29:57.593556+0000","last_peered":"2024-09-20T20:29:57.593556+0000","last_clean":"2024-09-20T20:29:57.593556+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:29:57.593556+0000","last_undegraded":"2024-09-20T20:29:57.593556+0000","last_fullsized":"2024-09-20T20:29:57.593556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592975+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:29:57.592975+0000","last_peered":"2024-09-20T20:29:57.592975+0000","last_clean":"2024-09-20T20:29:57.592975+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:29:57.592975+0000","last_undegraded":"2024-09-20T20:29:57.592975+0000","last_fullsized":"2024-09-20T20:29:57.592975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592502+0000","last_change":"2024-09-20T20:29:55.015082+0000","last_active":"2024-09-20T20:29:57.592502+0000","last_peered":"2024-09-20T20:29:57.592502+0000","last_clean":"2024-09-20T20:29:57.592502+0000","last_became_active":"2024-09-20T20:29:55.012708+0000","last_became_peered":"2024-09-20T20:29:55.012708+0000","last_unstale":"2024-09-20T20:29:57.592502+0000","last_undegraded":"2024-09-20T20:29:57.592502+0000","last_fullsized":"2024-09-20T20:29:57.592502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:24.045731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590012+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:29:57.590012+0000","last_peered":"2024-09-20T20:29:57.590012+0000","last_clean":"2024-09-20T20:29:57.590012+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:29:57.590012+0000","last_undegraded":"2024-09-20T20:29:57.590012+0000","last_fullsized":"2024-09-20T20:29:57.590012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591951+0000","last_change":"2024-09-20T20:29:55.002784+0000","last_active":"2024-09-20T20:29:57.591951+0000","last_peered":"2024-09-20T20:29:57.591951+0000","last_clean":"2024-09-20T20:29:57.591951+0000","last_became_active":"2024-09-20T20:29:55.001575+0000","last_became_peered":"2024-09-20T20:29:55.001575+0000","last_unstale":"2024-09-20T20:29:57.591951+0000","last_undegraded":"2024-09-20T20:29:57.591951+0000","last_fullsized":"2024-09-20T20:29:57.591951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:45.086905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594645+0000","last_change":"2024-09-20T20:29:55.014653+0000","last_active":"2024-09-20T20:29:57.594645+0000","last_peered":"2024-09-20T20:29:57.594645+0000","last_clean":"2024-09-20T20:29:57.594645+0000","last_became_active":"2024-09-20T20:29:55.013806+0000","last_became_peered":"2024-09-20T20:29:55.013806+0000","last_unstale":"2024-09-20T20:29:57.594645+0000","last_undegraded":"2024-09-20T20:29:57.594645+0000","last_fullsized":"2024-09-20T20:29:57.594645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592032+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:29:57.592032+0000","last_peered":"2024-09-20T20:29:57.592032+0000","last_clean":"2024-09-20T20:29:57.592032+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:29:57.592032+0000","last_undegraded":"2024-09-20T20:29:57.592032+0000","last_fullsized":"2024-09-20T20:29:57.592032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594255+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:29:57.594255+0000","last_peered":"2024-09-20T20:29:57.594255+0000","last_clean":"2024-09-20T20:29:57.594255+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:29:57.594255+0000","last_undegraded":"2024-09-20T20:29:57.594255+0000","last_fullsized":"2024-09-20T20:29:57.594255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594065+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:29:57.594065+0000","last_peered":"2024-09-20T20:29:57.594065+0000","last_clean":"2024-09-20T20:29:57.594065+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:29:57.594065+0000","last_undegraded":"2024-09-20T20:29:57.594065+0000","last_fullsized":"2024-09-20T20:29:57.594065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591517+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:29:57.591517+0000","last_peered":"2024-09-20T20:29:57.591517+0000","last_clean":"2024-09-20T20:29:57.591517+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:29:57.591517+0000","last_undegraded":"2024-09-20T20:29:57.591517+0000","last_fullsized":"2024-09-20T20:29:57.591517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592863+0000","last_change":"2024-09-20T20:29:55.014505+0000","last_active":"2024-09-20T20:29:57.592863+0000","last_peered":"2024-09-20T20:29:57.592863+0000","last_clean":"2024-09-20T20:29:57.592863+0000","last_became_active":"2024-09-20T20:29:55.012721+0000","last_became_peered":"2024-09-20T20:29:55.012721+0000","last_unstale":"2024-09-20T20:29:57.592863+0000","last_undegraded":"2024-09-20T20:29:57.592863+0000","last_fullsized":"2024-09-20T20:29:57.592863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590169+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:29:57.590169+0000","last_peered":"2024-09-20T20:29:57.590169+0000","last_clean":"2024-09-20T20:29:57.590169+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:29:57.590169+0000","last_undegraded":"2024-09-20T20:29:57.590169+0000","last_fullsized":"2024-09-20T20:29:57.590169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591691+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:29:57.591691+0000","last_peered":"2024-09-20T20:29:57.591691+0000","last_clean":"2024-09-20T20:29:57.591691+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:29:57.591691+0000","last_undegraded":"2024-09-20T20:29:57.591691+0000","last_fullsized":"2024-09-20T20:29:57.591691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594004+0000","last_change":"2024-09-20T20:29:55.001960+0000","last_active":"2024-09-20T20:29:57.594004+0000","last_peered":"2024-09-20T20:29:57.594004+0000","last_clean":"2024-09-20T20:29:57.594004+0000","last_became_active":"2024-09-20T20:29:55.001033+0000","last_became_peered":"2024-09-20T20:29:55.001033+0000","last_unstale":"2024-09-20T20:29:57.594004+0000","last_undegraded":"2024-09-20T20:29:57.594004+0000","last_fullsized":"2024-09-20T20:29:57.594004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593125+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:29:57.593125+0000","last_peered":"2024-09-20T20:29:57.593125+0000","last_clean":"2024-09-20T20:29:57.593125+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:29:57.593125+0000","last_undegraded":"2024-09-20T20:29:57.593125+0000","last_fullsized":"2024-09-20T20:29:57.593125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593494+0000","last_change":"2024-09-20T20:29:55.006411+0000","last_active":"2024-09-20T20:29:57.593494+0000","last_peered":"2024-09-20T20:29:57.593494+0000","last_clean":"2024-09-20T20:29:57.593494+0000","last_became_active":"2024-09-20T20:29:55.004960+0000","last_became_peered":"2024-09-20T20:29:55.004960+0000","last_unstale":"2024-09-20T20:29:57.593494+0000","last_undegraded":"2024-09-20T20:29:57.593494+0000","last_fullsized":"2024-09-20T20:29:57.593494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590823+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:29:57.590823+0000","last_peered":"2024-09-20T20:29:57.590823+0000","last_clean":"2024-09-20T20:29:57.590823+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:29:57.590823+0000","last_undegraded":"2024-09-20T20:29:57.590823+0000","last_fullsized":"2024-09-20T20:29:57.590823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592575+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:29:57.592575+0000","last_peered":"2024-09-20T20:29:57.592575+0000","last_clean":"2024-09-20T20:29:57.592575+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:29:57.592575+0000","last_undegraded":"2024-09-20T20:29:57.592575+0000","last_fullsized":"2024-09-20T20:29:57.592575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592468+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:29:57.592468+0000","last_peered":"2024-09-20T20:29:57.592468+0000","last_clean":"2024-09-20T20:29:57.592468+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:29:57.592468+0000","last_undegraded":"2024-09-20T20:29:57.592468+0000","last_fullsized":"2024-09-20T20:29:57.592468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592413+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:29:57.592413+0000","last_peered":"2024-09-20T20:29:57.592413+0000","last_clean":"2024-09-20T20:29:57.592413+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:29:57.592413+0000","last_undegraded":"2024-09-20T20:29:57.592413+0000","last_fullsized":"2024-09-20T20:29:57.592413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591791+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:29:57.591791+0000","last_peered":"2024-09-20T20:29:57.591791+0000","last_clean":"2024-09-20T20:29:57.591791+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:29:57.591791+0000","last_undegraded":"2024-09-20T20:29:57.591791+0000","last_fullsized":"2024-09-20T20:29:57.591791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594458+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:29:57.594458+0000","last_peered":"2024-09-20T20:29:57.594458+0000","last_clean":"2024-09-20T20:29:57.594458+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:29:57.594458+0000","last_undegraded":"2024-09-20T20:29:57.594458+0000","last_fullsized":"2024-09-20T20:29:57.594458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592083+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:29:57.592083+0000","last_peered":"2024-09-20T20:29:57.592083+0000","last_clean":"2024-09-20T20:29:57.592083+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:29:57.592083+0000","last_undegraded":"2024-09-20T20:29:57.592083+0000","last_fullsized":"2024-09-20T20:29:57.592083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594387+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:29:57.594387+0000","last_peered":"2024-09-20T20:29:57.594387+0000","last_clean":"2024-09-20T20:29:57.594387+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:29:57.594387+0000","last_undegraded":"2024-09-20T20:29:57.594387+0000","last_fullsized":"2024-09-20T20:29:57.594387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592138+0000","last_change":"2024-09-20T20:29:55.006455+0000","last_active":"2024-09-20T20:29:57.592138+0000","last_peered":"2024-09-20T20:29:57.592138+0000","last_clean":"2024-09-20T20:29:57.592138+0000","last_became_active":"2024-09-20T20:29:55.004010+0000","last_became_peered":"2024-09-20T20:29:55.004010+0000","last_unstale":"2024-09-20T20:29:57.592138+0000","last_undegraded":"2024-09-20T20:29:57.592138+0000","last_fullsized":"2024-09-20T20:29:57.592138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:20.842224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594769+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:29:57.594769+0000","last_peered":"2024-09-20T20:29:57.594769+0000","last_clean":"2024-09-20T20:29:57.594769+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:29:57.594769+0000","last_undegraded":"2024-09-20T20:29:57.594769+0000","last_fullsized":"2024-09-20T20:29:57.594769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592379+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:29:57.592379+0000","last_peered":"2024-09-20T20:29:57.592379+0000","last_clean":"2024-09-20T20:29:57.592379+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:29:57.592379+0000","last_undegraded":"2024-09-20T20:29:57.592379+0000","last_fullsized":"2024-09-20T20:29:57.592379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594413+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:29:57.594413+0000","last_peered":"2024-09-20T20:29:57.594413+0000","last_clean":"2024-09-20T20:29:57.594413+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:29:57.594413+0000","last_undegraded":"2024-09-20T20:29:57.594413+0000","last_fullsized":"2024-09-20T20:29:57.594413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591064+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:29:57.591064+0000","last_peered":"2024-09-20T20:29:57.591064+0000","last_clean":"2024-09-20T20:29:57.591064+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:29:57.591064+0000","last_undegraded":"2024-09-20T20:29:57.591064+0000","last_fullsized":"2024-09-20T20:29:57.591064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591558+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:29:57.591558+0000","last_peered":"2024-09-20T20:29:57.591558+0000","last_clean":"2024-09-20T20:29:57.591558+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:29:57.591558+0000","last_undegraded":"2024-09-20T20:29:57.591558+0000","last_fullsized":"2024-09-20T20:29:57.591558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594239+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:29:57.594239+0000","last_peered":"2024-09-20T20:29:57.594239+0000","last_clean":"2024-09-20T20:29:57.594239+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:29:57.594239+0000","last_undegraded":"2024-09-20T20:29:57.594239+0000","last_fullsized":"2024-09-20T20:29:57.594239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592628+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:29:57.592628+0000","last_peered":"2024-09-20T20:29:57.592628+0000","last_clean":"2024-09-20T20:29:57.592628+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:29:57.592628+0000","last_undegraded":"2024-09-20T20:29:57.592628+0000","last_fullsized":"2024-09-20T20:29:57.592628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594505+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:29:57.594505+0000","last_peered":"2024-09-20T20:29:57.594505+0000","last_clean":"2024-09-20T20:29:57.594505+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:29:57.594505+0000","last_undegraded":"2024-09-20T20:29:57.594505+0000","last_fullsized":"2024-09-20T20:29:57.594505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592805+0000","last_change":"2024-09-20T20:29:54.001861+0000","last_active":"2024-09-20T20:29:57.592805+0000","last_peered":"2024-09-20T20:29:57.592805+0000","last_clean":"2024-09-20T20:29:57.592805+0000","last_became_active":"2024-09-20T20:29:54.000965+0000","last_became_peered":"2024-09-20T20:29:54.000965+0000","last_unstale":"2024-09-20T20:29:57.592805+0000","last_undegraded":"2024-09-20T20:29:57.592805+0000","last_fullsized":"2024-09-20T20:29:57.592805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:28.103332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593778+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:29:57.593778+0000","last_peered":"2024-09-20T20:29:57.593778+0000","last_clean":"2024-09-20T20:29:57.593778+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:29:57.593778+0000","last_undegraded":"2024-09-20T20:29:57.593778+0000","last_fullsized":"2024-09-20T20:29:57.593778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592180+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:29:57.592180+0000","last_peered":"2024-09-20T20:29:57.592180+0000","last_clean":"2024-09-20T20:29:57.592180+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:29:57.592180+0000","last_undegraded":"2024-09-20T20:29:57.592180+0000","last_fullsized":"2024-09-20T20:29:57.592180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592009+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:29:57.592009+0000","last_peered":"2024-09-20T20:29:57.592009+0000","last_clean":"2024-09-20T20:29:57.592009+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:29:57.592009+0000","last_undegraded":"2024-09-20T20:29:57.592009+0000","last_fullsized":"2024-09-20T20:29:57.592009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592119+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:57.592119+0000","last_peered":"2024-09-20T20:29:57.592119+0000","last_clean":"2024-09-20T20:29:57.592119+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:57.592119+0000","last_undegraded":"2024-09-20T20:29:57.592119+0000","last_fullsized":"2024-09-20T20:29:57.592119+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593368+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:57.593368+0000","last_peered":"2024-09-20T20:29:57.593368+0000","last_clean":"2024-09-20T20:29:57.593368+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:57.593368+0000","last_undegraded":"2024-09-20T20:29:57.593368+0000","last_fullsized":"2024-09-20T20:29:57.593368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591134+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:29:57.591134+0000","last_peered":"2024-09-20T20:29:57.591134+0000","last_clean":"2024-09-20T20:29:57.591134+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:29:57.591134+0000","last_undegraded":"2024-09-20T20:29:57.591134+0000","last_fullsized":"2024-09-20T20:29:57.591134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594567+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:29:57.594567+0000","last_peered":"2024-09-20T20:29:57.594567+0000","last_clean":"2024-09-20T20:29:57.594567+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:29:57.594567+0000","last_undegraded":"2024-09-20T20:29:57.594567+0000","last_fullsized":"2024-09-20T20:29:57.594567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592052+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:57.592052+0000","last_peered":"2024-09-20T20:29:57.592052+0000","last_clean":"2024-09-20T20:29:57.592052+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:57.592052+0000","last_undegraded":"2024-09-20T20:29:57.592052+0000","last_fullsized":"2024-09-20T20:29:57.592052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590779+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:29:57.590779+0000","last_peered":"2024-09-20T20:29:57.590779+0000","last_clean":"2024-09-20T20:29:57.590779+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:29:57.590779+0000","last_undegraded":"2024-09-20T20:29:57.590779+0000","last_fullsized":"2024-09-20T20:29:57.590779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594373+0000","last_change":"2024-09-20T20:29:55.007379+0000","last_active":"2024-09-20T20:29:57.594373+0000","last_peered":"2024-09-20T20:29:57.594373+0000","last_clean":"2024-09-20T20:29:57.594373+0000","last_became_active":"2024-09-20T20:29:55.005006+0000","last_became_peered":"2024-09-20T20:29:55.005006+0000","last_unstale":"2024-09-20T20:29:57.594373+0000","last_undegraded":"2024-09-20T20:29:57.594373+0000","last_fullsized":"2024-09-20T20:29:57.594373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591245+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:57.591245+0000","last_peered":"2024-09-20T20:29:57.591245+0000","last_clean":"2024-09-20T20:29:57.591245+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:57.591245+0000","last_undegraded":"2024-09-20T20:29:57.591245+0000","last_fullsized":"2024-09-20T20:29:57.591245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:54.000434+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:53.999658+0000","last_became_peered":"2024-09-20T20:29:53.999658+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:31.923210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592275+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:29:57.592275+0000","last_peered":"2024-09-20T20:29:57.592275+0000","last_clean":"2024-09-20T20:29:57.592275+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:29:57.592275+0000","last_undegraded":"2024-09-20T20:29:57.592275+0000","last_fullsized":"2024-09-20T20:29:57.592275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592825+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:57.592825+0000","last_peered":"2024-09-20T20:29:57.592825+0000","last_clean":"2024-09-20T20:29:57.592825+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:57.592825+0000","last_undegraded":"2024-09-20T20:29:57.592825+0000","last_fullsized":"2024-09-20T20:29:57.592825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593206+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:29:57.593206+0000","last_peered":"2024-09-20T20:29:57.593206+0000","last_clean":"2024-09-20T20:29:57.593206+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:29:57.593206+0000","last_undegraded":"2024-09-20T20:29:57.593206+0000","last_fullsized":"2024-09-20T20:29:57.593206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591843+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:29:57.591843+0000","last_peered":"2024-09-20T20:29:57.591843+0000","last_clean":"2024-09-20T20:29:57.591843+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:29:57.591843+0000","last_undegraded":"2024-09-20T20:29:57.591843+0000","last_fullsized":"2024-09-20T20:29:57.591843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594707+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:29:57.594707+0000","last_peered":"2024-09-20T20:29:57.594707+0000","last_clean":"2024-09-20T20:29:57.594707+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:29:57.594707+0000","last_undegraded":"2024-09-20T20:29:57.594707+0000","last_fullsized":"2024-09-20T20:29:57.594707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593023+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:29:57.593023+0000","last_peered":"2024-09-20T20:29:57.593023+0000","last_clean":"2024-09-20T20:29:57.593023+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:29:57.593023+0000","last_undegraded":"2024-09-20T20:29:57.593023+0000","last_fullsized":"2024-09-20T20:29:57.593023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592094+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:29:57.592094+0000","last_peered":"2024-09-20T20:29:57.592094+0000","last_clean":"2024-09-20T20:29:57.592094+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:29:57.592094+0000","last_undegraded":"2024-09-20T20:29:57.592094+0000","last_fullsized":"2024-09-20T20:29:57.592094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594126+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:57.594126+0000","last_peered":"2024-09-20T20:29:57.594126+0000","last_clean":"2024-09-20T20:29:57.594126+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:57.594126+0000","last_undegraded":"2024-09-20T20:29:57.594126+0000","last_fullsized":"2024-09-20T20:29:57.594126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593059+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:29:57.593059+0000","last_peered":"2024-09-20T20:29:57.593059+0000","last_clean":"2024-09-20T20:29:57.593059+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:29:57.593059+0000","last_undegraded":"2024-09-20T20:29:57.593059+0000","last_fullsized":"2024-09-20T20:29:57.593059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593061+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:29:57.593061+0000","last_peered":"2024-09-20T20:29:57.593061+0000","last_clean":"2024-09-20T20:29:57.593061+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:29:57.593061+0000","last_undegraded":"2024-09-20T20:29:57.593061+0000","last_fullsized":"2024-09-20T20:29:57.593061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592854+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:57.592854+0000","last_peered":"2024-09-20T20:29:57.592854+0000","last_clean":"2024-09-20T20:29:57.592854+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:57.592854+0000","last_undegraded":"2024-09-20T20:29:57.592854+0000","last_fullsized":"2024-09-20T20:29:57.592854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590342+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:29:57.590342+0000","last_peered":"2024-09-20T20:29:57.590342+0000","last_clean":"2024-09-20T20:29:57.590342+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:29:57.590342+0000","last_undegraded":"2024-09-20T20:29:57.590342+0000","last_fullsized":"2024-09-20T20:29:57.590342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592849+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:29:57.592849+0000","last_peered":"2024-09-20T20:29:57.592849+0000","last_clean":"2024-09-20T20:29:57.592849+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:29:57.592849+0000","last_undegraded":"2024-09-20T20:29:57.592849+0000","last_fullsized":"2024-09-20T20:29:57.592849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594408+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:57.594408+0000","last_peered":"2024-09-20T20:29:57.594408+0000","last_clean":"2024-09-20T20:29:57.594408+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:57.594408+0000","last_undegraded":"2024-09-20T20:29:57.594408+0000","last_fullsized":"2024-09-20T20:29:57.594408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592661+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:29:57.592661+0000","last_peered":"2024-09-20T20:29:57.592661+0000","last_clean":"2024-09-20T20:29:57.592661+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:29:57.592661+0000","last_undegraded":"2024-09-20T20:29:57.592661+0000","last_fullsized":"2024-09-20T20:29:57.592661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592767+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:29:57.592767+0000","last_peered":"2024-09-20T20:29:57.592767+0000","last_clean":"2024-09-20T20:29:57.592767+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:29:57.592767+0000","last_undegraded":"2024-09-20T20:29:57.592767+0000","last_fullsized":"2024-09-20T20:29:57.592767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594136+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:29:57.594136+0000","last_peered":"2024-09-20T20:29:57.594136+0000","last_clean":"2024-09-20T20:29:57.594136+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:29:57.594136+0000","last_undegraded":"2024-09-20T20:29:57.594136+0000","last_fullsized":"2024-09-20T20:29:57.594136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590881+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:29:57.590881+0000","last_peered":"2024-09-20T20:29:57.590881+0000","last_clean":"2024-09-20T20:29:57.590881+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:29:57.590881+0000","last_undegraded":"2024-09-20T20:29:57.590881+0000","last_fullsized":"2024-09-20T20:29:57.590881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594037+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:29:57.594037+0000","last_peered":"2024-09-20T20:29:57.594037+0000","last_clean":"2024-09-20T20:29:57.594037+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:29:57.594037+0000","last_undegraded":"2024-09-20T20:29:57.594037+0000","last_fullsized":"2024-09-20T20:29:57.594037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594030+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:29:57.594030+0000","last_peered":"2024-09-20T20:29:57.594030+0000","last_clean":"2024-09-20T20:29:57.594030+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:29:57.594030+0000","last_undegraded":"2024-09-20T20:29:57.594030+0000","last_fullsized":"2024-09-20T20:29:57.594030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590305+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:29:57.590305+0000","last_peered":"2024-09-20T20:29:57.590305+0000","last_clean":"2024-09-20T20:29:57.590305+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:29:57.590305+0000","last_undegraded":"2024-09-20T20:29:57.590305+0000","last_fullsized":"2024-09-20T20:29:57.590305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592804+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:29:57.592804+0000","last_peered":"2024-09-20T20:29:57.592804+0000","last_clean":"2024-09-20T20:29:57.592804+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:29:57.592804+0000","last_undegraded":"2024-09-20T20:29:57.592804+0000","last_fullsized":"2024-09-20T20:29:57.592804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590221+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:29:57.590221+0000","last_peered":"2024-09-20T20:29:57.590221+0000","last_clean":"2024-09-20T20:29:57.590221+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:29:57.590221+0000","last_undegraded":"2024-09-20T20:29:57.590221+0000","last_fullsized":"2024-09-20T20:29:57.590221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594834+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:29:57.594834+0000","last_peered":"2024-09-20T20:29:57.594834+0000","last_clean":"2024-09-20T20:29:57.594834+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:29:57.594834+0000","last_undegraded":"2024-09-20T20:29:57.594834+0000","last_fullsized":"2024-09-20T20:29:57.594834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590499+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:29:57.590499+0000","last_peered":"2024-09-20T20:29:57.590499+0000","last_clean":"2024-09-20T20:29:57.590499+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:29:57.590499+0000","last_undegraded":"2024-09-20T20:29:57.590499+0000","last_fullsized":"2024-09-20T20:29:57.590499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592213+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:29:57.592213+0000","last_peered":"2024-09-20T20:29:57.592213+0000","last_clean":"2024-09-20T20:29:57.592213+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:29:57.592213+0000","last_undegraded":"2024-09-20T20:29:57.592213+0000","last_fullsized":"2024-09-20T20:29:57.592213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590675+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:29:57.590675+0000","last_peered":"2024-09-20T20:29:57.590675+0000","last_clean":"2024-09-20T20:29:57.590675+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:29:57.590675+0000","last_undegraded":"2024-09-20T20:29:57.590675+0000","last_fullsized":"2024-09-20T20:29:57.590675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593420+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:29:57.593420+0000","last_peered":"2024-09-20T20:29:57.593420+0000","last_clean":"2024-09-20T20:29:57.593420+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:29:57.593420+0000","last_undegraded":"2024-09-20T20:29:57.593420+0000","last_fullsized":"2024-09-20T20:29:57.593420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593148+0000","last_change":"2024-09-20T20:29:53.995769+0000","last_active":"2024-09-20T20:29:57.593148+0000","last_peered":"2024-09-20T20:29:57.593148+0000","last_clean":"2024-09-20T20:29:57.593148+0000","last_became_active":"2024-09-20T20:29:53.994788+0000","last_became_peered":"2024-09-20T20:29:53.994788+0000","last_unstale":"2024-09-20T20:29:57.593148+0000","last_undegraded":"2024-09-20T20:29:57.593148+0000","last_fullsized":"2024-09-20T20:29:57.593148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:58.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593654+0000","last_change":"2024-09-20T20:29:55.004166+0000","last_active":"2024-09-20T20:29:57.593654+0000","last_peered":"2024-09-20T20:29:57.593654+0000","last_clean":"2024-09-20T20:29:57.593654+0000","last_became_active":"2024-09-20T20:29:55.002511+0000","last_became_peered":"2024-09-20T20:29:55.002511+0000","last_unstale":"2024-09-20T20:29:57.593654+0000","last_undegraded":"2024-09-20T20:29:57.593654+0000","last_fullsized":"2024-09-20T20:29:57.593654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593507+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:29:57.593507+0000","last_peered":"2024-09-20T20:29:57.593507+0000","last_clean":"2024-09-20T20:29:57.593507+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:29:57.593507+0000","last_undegraded":"2024-09-20T20:29:57.593507+0000","last_fullsized":"2024-09-20T20:29:57.593507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592500+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:29:57.592500+0000","last_peered":"2024-09-20T20:29:57.592500+0000","last_clean":"2024-09-20T20:29:57.592500+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:29:57.592500+0000","last_undegraded":"2024-09-20T20:29:57.592500+0000","last_fullsized":"2024-09-20T20:29:57.592500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593828+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:29:57.593828+0000","last_peered":"2024-09-20T20:29:57.593828+0000","last_clean":"2024-09-20T20:29:57.593828+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:29:57.593828+0000","last_undegraded":"2024-09-20T20:29:57.593828+0000","last_fullsized":"2024-09-20T20:29:57.593828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592557+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:29:57.592557+0000","last_peered":"2024-09-20T20:29:57.592557+0000","last_clean":"2024-09-20T20:29:57.592557+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:29:57.592557+0000","last_undegraded":"2024-09-20T20:29:57.592557+0000","last_fullsized":"2024-09-20T20:29:57.592557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593691+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:29:57.593691+0000","last_peered":"2024-09-20T20:29:57.593691+0000","last_clean":"2024-09-20T20:29:57.593691+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:29:57.593691+0000","last_undegraded":"2024-09-20T20:29:57.593691+0000","last_fullsized":"2024-09-20T20:29:57.593691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593091+0000","last_change":"2024-09-20T20:29:55.001408+0000","last_active":"2024-09-20T20:29:57.593091+0000","last_peered":"2024-09-20T20:29:57.593091+0000","last_clean":"2024-09-20T20:29:57.593091+0000","last_became_active":"2024-09-20T20:29:55.000076+0000","last_became_peered":"2024-09-20T20:29:55.000076+0000","last_unstale":"2024-09-20T20:29:57.593091+0000","last_undegraded":"2024-09-20T20:29:57.593091+0000","last_fullsized":"2024-09-20T20:29:57.593091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592547+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:29:57.592547+0000","last_peered":"2024-09-20T20:29:57.592547+0000","last_clean":"2024-09-20T20:29:57.592547+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:29:57.592547+0000","last_undegraded":"2024-09-20T20:29:57.592547+0000","last_fullsized":"2024-09-20T20:29:57.592547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591986+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:29:57.591986+0000","last_peered":"2024-09-20T20:29:57.591986+0000","last_clean":"2024-09-20T20:29:57.591986+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:29:57.591986+0000","last_undegraded":"2024-09-20T20:29:57.591986+0000","last_fullsized":"2024-09-20T20:29:57.591986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592554+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:29:57.592554+0000","last_peered":"2024-09-20T20:29:57.592554+0000","last_clean":"2024-09-20T20:29:57.592554+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:29:57.592554+0000","last_undegraded":"2024-09-20T20:29:57.592554+0000","last_fullsized":"2024-09-20T20:29:57.592554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:30:12.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:30:12.397 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:30:12.414 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-20T20:30:11.609785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003539"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594390+0000","last_change":"2024-09-20T20:29:55.007075+0000","last_active":"2024-09-20T20:29:57.594390+0000","last_peered":"2024-09-20T20:29:57.594390+0000","last_clean":"2024-09-20T20:29:57.594390+0000","last_became_active":"2024-09-20T20:29:55.005105+0000","last_became_peered":"2024-09-20T20:29:55.005105+0000","last_unstale":"2024-09-20T20:29:57.594390+0000","last_undegraded":"2024-09-20T20:29:57.594390+0000","last_fullsized":"2024-09-20T20:29:57.594390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593823+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:29:57.593823+0000","last_peered":"2024-09-20T20:29:57.593823+0000","last_clean":"2024-09-20T20:29:57.593823+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:29:57.593823+0000","last_undegraded":"2024-09-20T20:29:57.593823+0000","last_fullsized":"2024-09-20T20:29:57.593823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593699+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:29:57.593699+0000","last_peered":"2024-09-20T20:29:57.593699+0000","last_clean":"2024-09-20T20:29:57.593699+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:29:57.593699+0000","last_undegraded":"2024-09-20T20:29:57.593699+0000","last_fullsized":"2024-09-20T20:29:57.593699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593419+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:29:57.593419+0000","last_peered":"2024-09-20T20:29:57.593419+0000","last_clean":"2024-09-20T20:29:57.593419+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:29:57.593419+0000","last_undegraded":"2024-09-20T20:29:57.593419+0000","last_fullsized":"2024-09-20T20:29:57.593419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593304+0000","last_change":"2024-09-20T20:29:55.001482+0000","last_active":"2024-09-20T20:29:57.593304+0000","last_peered":"2024-09-20T20:29:57.593304+0000","last_clean":"2024-09-20T20:29:57.593304+0000","last_became_active":"2024-09-20T20:29:55.000290+0000","last_became_peered":"2024-09-20T20:29:55.000290+0000","last_unstale":"2024-09-20T20:29:57.593304+0000","last_undegraded":"2024-09-20T20:29:57.593304+0000","last_fullsized":"2024-09-20T20:29:57.593304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592133+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:29:57.592133+0000","last_peered":"2024-09-20T20:29:57.592133+0000","last_clean":"2024-09-20T20:29:57.592133+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:29:57.592133+0000","last_undegraded":"2024-09-20T20:29:57.592133+0000","last_fullsized":"2024-09-20T20:29:57.592133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592055+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:29:57.592055+0000","last_peered":"2024-09-20T20:29:57.592055+0000","last_clean":"2024-09-20T20:29:57.592055+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:29:57.592055+0000","last_undegraded":"2024-09-20T20:29:57.592055+0000","last_fullsized":"2024-09-20T20:29:57.592055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591525+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:29:57.591525+0000","last_peered":"2024-09-20T20:29:57.591525+0000","last_clean":"2024-09-20T20:29:57.591525+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:29:57.591525+0000","last_undegraded":"2024-09-20T20:29:57.591525+0000","last_fullsized":"2024-09-20T20:29:57.591525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591679+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:29:57.591679+0000","last_peered":"2024-09-20T20:29:57.591679+0000","last_clean":"2024-09-20T20:29:57.591679+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:29:57.591679+0000","last_undegraded":"2024-09-20T20:29:57.591679+0000","last_fullsized":"2024-09-20T20:29:57.591679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594009+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:29:57.594009+0000","last_peered":"2024-09-20T20:29:57.594009+0000","last_clean":"2024-09-20T20:29:57.594009+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:29:57.594009+0000","last_undegraded":"2024-09-20T20:29:57.594009+0000","last_fullsized":"2024-09-20T20:29:57.594009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593950+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:29:57.593950+0000","last_peered":"2024-09-20T20:29:57.593950+0000","last_clean":"2024-09-20T20:29:57.593950+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:29:57.593950+0000","last_undegraded":"2024-09-20T20:29:57.593950+0000","last_fullsized":"2024-09-20T20:29:57.593950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593395+0000","last_change":"2024-09-20T20:29:55.012467+0000","last_active":"2024-09-20T20:29:57.593395+0000","last_peered":"2024-09-20T20:29:57.593395+0000","last_clean":"2024-09-20T20:29:57.593395+0000","last_became_active":"2024-09-20T20:29:55.011686+0000","last_became_peered":"2024-09-20T20:29:55.011686+0000","last_unstale":"2024-09-20T20:29:57.593395+0000","last_undegraded":"2024-09-20T20:29:57.593395+0000","last_fullsized":"2024-09-20T20:29:57.593395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592940+0000","last_change":"2024-09-20T20:29:55.006208+0000","last_active":"2024-09-20T20:29:57.592940+0000","last_peered":"2024-09-20T20:29:57.592940+0000","last_clean":"2024-09-20T20:29:57.592940+0000","last_became_active":"2024-09-20T20:29:55.002864+0000","last_became_peered":"2024-09-20T20:29:55.002864+0000","last_unstale":"2024-09-20T20:29:57.592940+0000","last_undegraded":"2024-09-20T20:29:57.592940+0000","last_fullsized":"2024-09-20T20:29:57.592940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592235+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:29:57.592235+0000","last_peered":"2024-09-20T20:29:57.592235+0000","last_clean":"2024-09-20T20:29:57.592235+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:29:57.592235+0000","last_undegraded":"2024-09-20T20:29:57.592235+0000","last_fullsized":"2024-09-20T20:29:57.592235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592226+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:29:57.592226+0000","last_peered":"2024-09-20T20:29:57.592226+0000","last_clean":"2024-09-20T20:29:57.592226+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:29:57.592226+0000","last_undegraded":"2024-09-20T20:29:57.592226+0000","last_fullsized":"2024-09-20T20:29:57.592226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591482+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:29:57.591482+0000","last_peered":"2024-09-20T20:29:57.591482+0000","last_clean":"2024-09-20T20:29:57.591482+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:29:57.591482+0000","last_undegraded":"2024-09-20T20:29:57.591482+0000","last_fullsized":"2024-09-20T20:29:57.591482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592894+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:29:57.592894+0000","last_peered":"2024-09-20T20:29:57.592894+0000","last_clean":"2024-09-20T20:29:57.592894+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:29:57.592894+0000","last_undegraded":"2024-09-20T20:29:57.592894+0000","last_fullsized":"2024-09-20T20:29:57.592894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594068+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:29:57.594068+0000","last_peered":"2024-09-20T20:29:57.594068+0000","last_clean":"2024-09-20T20:29:57.594068+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:29:57.594068+0000","last_undegraded":"2024-09-20T20:29:57.594068+0000","last_fullsized":"2024-09-20T20:29:57.594068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591391+0000","last_change":"2024-09-20T20:29:54.999350+0000","last_active":"2024-09-20T20:29:57.591391+0000","last_peered":"2024-09-20T20:29:57.591391+0000","last_clean":"2024-09-20T20:29:57.591391+0000","last_became_active":"2024-09-20T20:29:54.998741+0000","last_became_peered":"2024-09-20T20:29:54.998741+0000","last_unstale":"2024-09-20T20:29:57.591391+0000","last_undegraded":"2024-09-20T20:29:57.591391+0000","last_fullsized":"2024-09-20T20:29:57.591391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593556+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:29:57.593556+0000","last_peered":"2024-09-20T20:29:57.593556+0000","last_clean":"2024-09-20T20:29:57.593556+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:29:57.593556+0000","last_undegraded":"2024-09-20T20:29:57.593556+0000","last_fullsized":"2024-09-20T20:29:57.593556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592975+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:29:57.592975+0000","last_peered":"2024-09-20T20:29:57.592975+0000","last_clean":"2024-09-20T20:29:57.592975+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:29:57.592975+0000","last_undegraded":"2024-09-20T20:29:57.592975+0000","last_fullsized":"2024-09-20T20:29:57.592975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592502+0000","last_change":"2024-09-20T20:29:55.015082+0000","last_active":"2024-09-20T20:29:57.592502+0000","last_peered":"2024-09-20T20:29:57.592502+0000","last_clean":"2024-09-20T20:29:57.592502+0000","last_became_active":"2024-09-20T20:29:55.012708+0000","last_became_peered":"2024-09-20T20:29:55.012708+0000","last_unstale":"2024-09-20T20:29:57.592502+0000","last_undegraded":"2024-09-20T20:29:57.592502+0000","last_fullsized":"2024-09-20T20:29:57.592502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:24.045731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590012+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:29:57.590012+0000","last_peered":"2024-09-20T20:29:57.590012+0000","last_clean":"2024-09-20T20:29:57.590012+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:29:57.590012+0000","last_undegraded":"2024-09-20T20:29:57.590012+0000","last_fullsized":"2024-09-20T20:29:57.590012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591951+0000","last_change":"2024-09-20T20:29:55.002784+0000","last_active":"2024-09-20T20:29:57.591951+0000","last_peered":"2024-09-20T20:29:57.591951+0000","last_clean":"2024-09-20T20:29:57.591951+0000","last_became_active":"2024-09-20T20:29:55.001575+0000","last_became_peered":"2024-09-20T20:29:55.001575+0000","last_unstale":"2024-09-20T20:29:57.591951+0000","last_undegraded":"2024-09-20T20:29:57.591951+0000","last_fullsized":"2024-09-20T20:29:57.591951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:45.086905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594645+0000","last_change":"2024-09-20T20:29:55.014653+0000","last_active":"2024-09-20T20:29:57.594645+0000","last_peered":"2024-09-20T20:29:57.594645+0000","last_clean":"2024-09-20T20:29:57.594645+0000","last_became_active":"2024-09-20T20:29:55.013806+0000","last_became_peered":"2024-09-20T20:29:55.013806+0000","last_unstale":"2024-09-20T20:29:57.594645+0000","last_undegraded":"2024-09-20T20:29:57.594645+0000","last_fullsized":"2024-09-20T20:29:57.594645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592032+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:29:57.592032+0000","last_peered":"2024-09-20T20:29:57.592032+0000","last_clean":"2024-09-20T20:29:57.592032+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:29:57.592032+0000","last_undegraded":"2024-09-20T20:29:57.592032+0000","last_fullsized":"2024-09-20T20:29:57.592032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594255+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:29:57.594255+0000","last_peered":"2024-09-20T20:29:57.594255+0000","last_clean":"2024-09-20T20:29:57.594255+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:29:57.594255+0000","last_undegraded":"2024-09-20T20:29:57.594255+0000","last_fullsized":"2024-09-20T20:29:57.594255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594065+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:29:57.594065+0000","last_peered":"2024-09-20T20:29:57.594065+0000","last_clean":"2024-09-20T20:29:57.594065+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:29:57.594065+0000","last_undegraded":"2024-09-20T20:29:57.594065+0000","last_fullsized":"2024-09-20T20:29:57.594065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591517+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:29:57.591517+0000","last_peered":"2024-09-20T20:29:57.591517+0000","last_clean":"2024-09-20T20:29:57.591517+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:29:57.591517+0000","last_undegraded":"2024-09-20T20:29:57.591517+0000","last_fullsized":"2024-09-20T20:29:57.591517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592863+0000","last_change":"2024-09-20T20:29:55.014505+0000","last_active":"2024-09-20T20:29:57.592863+0000","last_peered":"2024-09-20T20:29:57.592863+0000","last_clean":"2024-09-20T20:29:57.592863+0000","last_became_active":"2024-09-20T20:29:55.012721+0000","last_became_peered":"2024-09-20T20:29:55.012721+0000","last_unstale":"2024-09-20T20:29:57.592863+0000","last_undegraded":"2024-09-20T20:29:57.592863+0000","last_fullsized":"2024-09-20T20:29:57.592863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590169+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:29:57.590169+0000","last_peered":"2024-09-20T20:29:57.590169+0000","last_clean":"2024-09-20T20:29:57.590169+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:29:57.590169+0000","last_undegraded":"2024-09-20T20:29:57.590169+0000","last_fullsized":"2024-09-20T20:29:57.590169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591691+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:29:57.591691+0000","last_peered":"2024-09-20T20:29:57.591691+0000","last_clean":"2024-09-20T20:29:57.591691+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:29:57.591691+0000","last_undegraded":"2024-09-20T20:29:57.591691+0000","last_fullsized":"2024-09-20T20:29:57.591691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594004+0000","last_change":"2024-09-20T20:29:55.001960+0000","last_active":"2024-09-20T20:29:57.594004+0000","last_peered":"2024-09-20T20:29:57.594004+0000","last_clean":"2024-09-20T20:29:57.594004+0000","last_became_active":"2024-09-20T20:29:55.001033+0000","last_became_peered":"2024-09-20T20:29:55.001033+0000","last_unstale":"2024-09-20T20:29:57.594004+0000","last_undegraded":"2024-09-20T20:29:57.594004+0000","last_fullsized":"2024-09-20T20:29:57.594004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593125+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:29:57.593125+0000","last_peered":"2024-09-20T20:29:57.593125+0000","last_clean":"2024-09-20T20:29:57.593125+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:29:57.593125+0000","last_undegraded":"2024-09-20T20:29:57.593125+0000","last_fullsized":"2024-09-20T20:29:57.593125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593494+0000","last_change":"2024-09-20T20:29:55.006411+0000","last_active":"2024-09-20T20:29:57.593494+0000","last_peered":"2024-09-20T20:29:57.593494+0000","last_clean":"2024-09-20T20:29:57.593494+0000","last_became_active":"2024-09-20T20:29:55.004960+0000","last_became_peered":"2024-09-20T20:29:55.004960+0000","last_unstale":"2024-09-20T20:29:57.593494+0000","last_undegraded":"2024-09-20T20:29:57.593494+0000","last_fullsized":"2024-09-20T20:29:57.593494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590823+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:29:57.590823+0000","last_peered":"2024-09-20T20:29:57.590823+0000","last_clean":"2024-09-20T20:29:57.590823+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:29:57.590823+0000","last_undegraded":"2024-09-20T20:29:57.590823+0000","last_fullsized":"2024-09-20T20:29:57.590823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592575+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:29:57.592575+0000","last_peered":"2024-09-20T20:29:57.592575+0000","last_clean":"2024-09-20T20:29:57.592575+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:29:57.592575+0000","last_undegraded":"2024-09-20T20:29:57.592575+0000","last_fullsized":"2024-09-20T20:29:57.592575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592468+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:29:57.592468+0000","last_peered":"2024-09-20T20:29:57.592468+0000","last_clean":"2024-09-20T20:29:57.592468+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:29:57.592468+0000","last_undegraded":"2024-09-20T20:29:57.592468+0000","last_fullsized":"2024-09-20T20:29:57.592468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592413+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:29:57.592413+0000","last_peered":"2024-09-20T20:29:57.592413+0000","last_clean":"2024-09-20T20:29:57.592413+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:29:57.592413+0000","last_undegraded":"2024-09-20T20:29:57.592413+0000","last_fullsized":"2024-09-20T20:29:57.592413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591791+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:29:57.591791+0000","last_peered":"2024-09-20T20:29:57.591791+0000","last_clean":"2024-09-20T20:29:57.591791+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:29:57.591791+0000","last_undegraded":"2024-09-20T20:29:57.591791+0000","last_fullsized":"2024-09-20T20:29:57.591791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594458+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:29:57.594458+0000","last_peered":"2024-09-20T20:29:57.594458+0000","last_clean":"2024-09-20T20:29:57.594458+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:29:57.594458+0000","last_undegraded":"2024-09-20T20:29:57.594458+0000","last_fullsized":"2024-09-20T20:29:57.594458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592083+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:29:57.592083+0000","last_peered":"2024-09-20T20:29:57.592083+0000","last_clean":"2024-09-20T20:29:57.592083+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:29:57.592083+0000","last_undegraded":"2024-09-20T20:29:57.592083+0000","last_fullsized":"2024-09-20T20:29:57.592083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594387+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:29:57.594387+0000","last_peered":"2024-09-20T20:29:57.594387+0000","last_clean":"2024-09-20T20:29:57.594387+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:29:57.594387+0000","last_undegraded":"2024-09-20T20:29:57.594387+0000","last_fullsized":"2024-09-20T20:29:57.594387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592138+0000","last_change":"2024-09-20T20:29:55.006455+0000","last_active":"2024-09-20T20:29:57.592138+0000","last_peered":"2024-09-20T20:29:57.592138+0000","last_clean":"2024-09-20T20:29:57.592138+0000","last_became_active":"2024-09-20T20:29:55.004010+0000","last_became_peered":"2024-09-20T20:29:55.004010+0000","last_unstale":"2024-09-20T20:29:57.592138+0000","last_undegraded":"2024-09-20T20:29:57.592138+0000","last_fullsized":"2024-09-20T20:29:57.592138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:20.842224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594769+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:29:57.594769+0000","last_peered":"2024-09-20T20:29:57.594769+0000","last_clean":"2024-09-20T20:29:57.594769+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:29:57.594769+0000","last_undegraded":"2024-09-20T20:29:57.594769+0000","last_fullsized":"2024-09-20T20:29:57.594769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592379+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:29:57.592379+0000","last_peered":"2024-09-20T20:29:57.592379+0000","last_clean":"2024-09-20T20:29:57.592379+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:29:57.592379+0000","last_undegraded":"2024-09-20T20:29:57.592379+0000","last_fullsized":"2024-09-20T20:29:57.592379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594413+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:29:57.594413+0000","last_peered":"2024-09-20T20:29:57.594413+0000","last_clean":"2024-09-20T20:29:57.594413+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:29:57.594413+0000","last_undegraded":"2024-09-20T20:29:57.594413+0000","last_fullsized":"2024-09-20T20:29:57.594413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591064+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:29:57.591064+0000","last_peered":"2024-09-20T20:29:57.591064+0000","last_clean":"2024-09-20T20:29:57.591064+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:29:57.591064+0000","last_undegraded":"2024-09-20T20:29:57.591064+0000","last_fullsized":"2024-09-20T20:29:57.591064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591558+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:29:57.591558+0000","last_peered":"2024-09-20T20:29:57.591558+0000","last_clean":"2024-09-20T20:29:57.591558+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:29:57.591558+0000","last_undegraded":"2024-09-20T20:29:57.591558+0000","last_fullsized":"2024-09-20T20:29:57.591558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594239+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:29:57.594239+0000","last_peered":"2024-09-20T20:29:57.594239+0000","last_clean":"2024-09-20T20:29:57.594239+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:29:57.594239+0000","last_undegraded":"2024-09-20T20:29:57.594239+0000","last_fullsized":"2024-09-20T20:29:57.594239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592628+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:29:57.592628+0000","last_peered":"2024-09-20T20:29:57.592628+0000","last_clean":"2024-09-20T20:29:57.592628+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:29:57.592628+0000","last_undegraded":"2024-09-20T20:29:57.592628+0000","last_fullsized":"2024-09-20T20:29:57.592628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594505+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:29:57.594505+0000","last_peered":"2024-09-20T20:29:57.594505+0000","last_clean":"2024-09-20T20:29:57.594505+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:29:57.594505+0000","last_undegraded":"2024-09-20T20:29:57.594505+0000","last_fullsized":"2024-09-20T20:29:57.594505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592805+0000","last_change":"2024-09-20T20:29:54.001861+0000","last_active":"2024-09-20T20:29:57.592805+0000","last_peered":"2024-09-20T20:29:57.592805+0000","last_clean":"2024-09-20T20:29:57.592805+0000","last_became_active":"2024-09-20T20:29:54.000965+0000","last_became_peered":"2024-09-20T20:29:54.000965+0000","last_unstale":"2024-09-20T20:29:57.592805+0000","last_undegraded":"2024-09-20T20:29:57.592805+0000","last_fullsized":"2024-09-20T20:29:57.592805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:28.103332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593778+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:29:57.593778+0000","last_peered":"2024-09-20T20:29:57.593778+0000","last_clean":"2024-09-20T20:29:57.593778+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:29:57.593778+0000","last_undegraded":"2024-09-20T20:29:57.593778+0000","last_fullsized":"2024-09-20T20:29:57.593778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592180+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:29:57.592180+0000","last_peered":"2024-09-20T20:29:57.592180+0000","last_clean":"2024-09-20T20:29:57.592180+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:29:57.592180+0000","last_undegraded":"2024-09-20T20:29:57.592180+0000","last_fullsized":"2024-09-20T20:29:57.592180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592009+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:29:57.592009+0000","last_peered":"2024-09-20T20:29:57.592009+0000","last_clean":"2024-09-20T20:29:57.592009+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:29:57.592009+0000","last_undegraded":"2024-09-20T20:29:57.592009+0000","last_fullsized":"2024-09-20T20:29:57.592009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592119+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:57.592119+0000","last_peered":"2024-09-20T20:29:57.592119+0000","last_clean":"2024-09-20T20:29:57.592119+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:57.592119+0000","last_undegraded":"2024-09-20T20:29:57.592119+0000","last_fullsized":"2024-09-20T20:29:57.592119+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593368+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:57.593368+0000","last_peered":"2024-09-20T20:29:57.593368+0000","last_clean":"2024-09-20T20:29:57.593368+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:57.593368+0000","last_undegraded":"2024-09-20T20:29:57.593368+0000","last_fullsized":"2024-09-20T20:29:57.593368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591134+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:29:57.591134+0000","last_peered":"2024-09-20T20:29:57.591134+0000","last_clean":"2024-09-20T20:29:57.591134+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:29:57.591134+0000","last_undegraded":"2024-09-20T20:29:57.591134+0000","last_fullsized":"2024-09-20T20:29:57.591134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594567+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:29:57.594567+0000","last_peered":"2024-09-20T20:29:57.594567+0000","last_clean":"2024-09-20T20:29:57.594567+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:29:57.594567+0000","last_undegraded":"2024-09-20T20:29:57.594567+0000","last_fullsized":"2024-09-20T20:29:57.594567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592052+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:57.592052+0000","last_peered":"2024-09-20T20:29:57.592052+0000","last_clean":"2024-09-20T20:29:57.592052+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:57.592052+0000","last_undegraded":"2024-09-20T20:29:57.592052+0000","last_fullsized":"2024-09-20T20:29:57.592052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590779+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:29:57.590779+0000","last_peered":"2024-09-20T20:29:57.590779+0000","last_clean":"2024-09-20T20:29:57.590779+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:29:57.590779+0000","last_undegraded":"2024-09-20T20:29:57.590779+0000","last_fullsized":"2024-09-20T20:29:57.590779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594373+0000","last_change":"2024-09-20T20:29:55.007379+0000","last_active":"2024-09-20T20:29:57.594373+0000","last_peered":"2024-09-20T20:29:57.594373+0000","last_clean":"2024-09-20T20:29:57.594373+0000","last_became_active":"2024-09-20T20:29:55.005006+0000","last_became_peered":"2024-09-20T20:29:55.005006+0000","last_unstale":"2024-09-20T20:29:57.594373+0000","last_undegraded":"2024-09-20T20:29:57.594373+0000","last_fullsized":"2024-09-20T20:29:57.594373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591245+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:57.591245+0000","last_peered":"2024-09-20T20:29:57.591245+0000","last_clean":"2024-09-20T20:29:57.591245+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:57.591245+0000","last_undegraded":"2024-09-20T20:29:57.591245+0000","last_fullsized":"2024-09-20T20:29:57.591245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:54.000434+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:53.999658+0000","last_became_peered":"2024-09-20T20:29:53.999658+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:31.923210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592275+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:29:57.592275+0000","last_peered":"2024-09-20T20:29:57.592275+0000","last_clean":"2024-09-20T20:29:57.592275+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:29:57.592275+0000","last_undegraded":"2024-09-20T20:29:57.592275+0000","last_fullsized":"2024-09-20T20:29:57.592275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592825+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:57.592825+0000","last_peered":"2024-09-20T20:29:57.592825+0000","last_clean":"2024-09-20T20:29:57.592825+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:57.592825+0000","last_undegraded":"2024-09-20T20:29:57.592825+0000","last_fullsized":"2024-09-20T20:29:57.592825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593206+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:29:57.593206+0000","last_peered":"2024-09-20T20:29:57.593206+0000","last_clean":"2024-09-20T20:29:57.593206+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:29:57.593206+0000","last_undegraded":"2024-09-20T20:29:57.593206+0000","last_fullsized":"2024-09-20T20:29:57.593206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591843+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:29:57.591843+0000","last_peered":"2024-09-20T20:29:57.591843+0000","last_clean":"2024-09-20T20:29:57.591843+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:29:57.591843+0000","last_undegraded":"2024-09-20T20:29:57.591843+0000","last_fullsized":"2024-09-20T20:29:57.591843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594707+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:29:57.594707+0000","last_peered":"2024-09-20T20:29:57.594707+0000","last_clean":"2024-09-20T20:29:57.594707+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:29:57.594707+0000","last_undegraded":"2024-09-20T20:29:57.594707+0000","last_fullsized":"2024-09-20T20:29:57.594707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593023+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:29:57.593023+0000","last_peered":"2024-09-20T20:29:57.593023+0000","last_clean":"2024-09-20T20:29:57.593023+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:29:57.593023+0000","last_undegraded":"2024-09-20T20:29:57.593023+0000","last_fullsized":"2024-09-20T20:29:57.593023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592094+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:29:57.592094+0000","last_peered":"2024-09-20T20:29:57.592094+0000","last_clean":"2024-09-20T20:29:57.592094+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:29:57.592094+0000","last_undegraded":"2024-09-20T20:29:57.592094+0000","last_fullsized":"2024-09-20T20:29:57.592094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594126+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:57.594126+0000","last_peered":"2024-09-20T20:29:57.594126+0000","last_clean":"2024-09-20T20:29:57.594126+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:57.594126+0000","last_undegraded":"2024-09-20T20:29:57.594126+0000","last_fullsized":"2024-09-20T20:29:57.594126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593059+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:29:57.593059+0000","last_peered":"2024-09-20T20:29:57.593059+0000","last_clean":"2024-09-20T20:29:57.593059+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:29:57.593059+0000","last_undegraded":"2024-09-20T20:29:57.593059+0000","last_fullsized":"2024-09-20T20:29:57.593059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593061+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:29:57.593061+0000","last_peered":"2024-09-20T20:29:57.593061+0000","last_clean":"2024-09-20T20:29:57.593061+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:29:57.593061+0000","last_undegraded":"2024-09-20T20:29:57.593061+0000","last_fullsized":"2024-09-20T20:29:57.593061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592854+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:57.592854+0000","last_peered":"2024-09-20T20:29:57.592854+0000","last_clean":"2024-09-20T20:29:57.592854+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:57.592854+0000","last_undegraded":"2024-09-20T20:29:57.592854+0000","last_fullsized":"2024-09-20T20:29:57.592854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590342+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:29:57.590342+0000","last_peered":"2024-09-20T20:29:57.590342+0000","last_clean":"2024-09-20T20:29:57.590342+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:29:57.590342+0000","last_undegraded":"2024-09-20T20:29:57.590342+0000","last_fullsized":"2024-09-20T20:29:57.590342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592849+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:29:57.592849+0000","last_peered":"2024-09-20T20:29:57.592849+0000","last_clean":"2024-09-20T20:29:57.592849+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:29:57.592849+0000","last_undegraded":"2024-09-20T20:29:57.592849+0000","last_fullsized":"2024-09-20T20:29:57.592849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594408+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:57.594408+0000","last_peered":"2024-09-20T20:29:57.594408+0000","last_clean":"2024-09-20T20:29:57.594408+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:57.594408+0000","last_undegraded":"2024-09-20T20:29:57.594408+0000","last_fullsized":"2024-09-20T20:29:57.594408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592661+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:29:57.592661+0000","last_peered":"2024-09-20T20:29:57.592661+0000","last_clean":"2024-09-20T20:29:57.592661+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:29:57.592661+0000","last_undegraded":"2024-09-20T20:29:57.592661+0000","last_fullsized":"2024-09-20T20:29:57.592661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592767+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:29:57.592767+0000","last_peered":"2024-09-20T20:29:57.592767+0000","last_clean":"2024-09-20T20:29:57.592767+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:29:57.592767+0000","last_undegraded":"2024-09-20T20:29:57.592767+0000","last_fullsized":"2024-09-20T20:29:57.592767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594136+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:29:57.594136+0000","last_peered":"2024-09-20T20:29:57.594136+0000","last_clean":"2024-09-20T20:29:57.594136+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:29:57.594136+0000","last_undegraded":"2024-09-20T20:29:57.594136+0000","last_fullsized":"2024-09-20T20:29:57.594136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590881+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:29:57.590881+0000","last_peered":"2024-09-20T20:29:57.590881+0000","last_clean":"2024-09-20T20:29:57.590881+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:29:57.590881+0000","last_undegraded":"2024-09-20T20:29:57.590881+0000","last_fullsized":"2024-09-20T20:29:57.590881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594037+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:29:57.594037+0000","last_peered":"2024-09-20T20:29:57.594037+0000","last_clean":"2024-09-20T20:29:57.594037+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:29:57.594037+0000","last_undegraded":"2024-09-20T20:29:57.594037+0000","last_fullsized":"2024-09-20T20:29:57.594037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594030+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:29:57.594030+0000","last_peered":"2024-09-20T20:29:57.594030+0000","last_clean":"2024-09-20T20:29:57.594030+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:29:57.594030+0000","last_undegraded":"2024-09-20T20:29:57.594030+0000","last_fullsized":"2024-09-20T20:29:57.594030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590305+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:29:57.590305+0000","last_peered":"2024-09-20T20:29:57.590305+0000","last_clean":"2024-09-20T20:29:57.590305+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:29:57.590305+0000","last_undegraded":"2024-09-20T20:29:57.590305+0000","last_fullsized":"2024-09-20T20:29:57.590305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592804+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:29:57.592804+0000","last_peered":"2024-09-20T20:29:57.592804+0000","last_clean":"2024-09-20T20:29:57.592804+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:29:57.592804+0000","last_undegraded":"2024-09-20T20:29:57.592804+0000","last_fullsized":"2024-09-20T20:29:57.592804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590221+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:29:57.590221+0000","last_peered":"2024-09-20T20:29:57.590221+0000","last_clean":"2024-09-20T20:29:57.590221+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:29:57.590221+0000","last_undegraded":"2024-09-20T20:29:57.590221+0000","last_fullsized":"2024-09-20T20:29:57.590221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594834+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:29:57.594834+0000","last_peered":"2024-09-20T20:29:57.594834+0000","last_clean":"2024-09-20T20:29:57.594834+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:29:57.594834+0000","last_undegraded":"2024-09-20T20:29:57.594834+0000","last_fullsized":"2024-09-20T20:29:57.594834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590499+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:29:57.590499+0000","last_peered":"2024-09-20T20:29:57.590499+0000","last_clean":"2024-09-20T20:29:57.590499+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:29:57.590499+0000","last_undegraded":"2024-09-20T20:29:57.590499+0000","last_fullsized":"2024-09-20T20:29:57.590499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592213+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:29:57.592213+0000","last_peered":"2024-09-20T20:29:57.592213+0000","last_clean":"2024-09-20T20:29:57.592213+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:29:57.592213+0000","last_undegraded":"2024-09-20T20:29:57.592213+0000","last_fullsized":"2024-09-20T20:29:57.592213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590675+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:29:57.590675+0000","last_peered":"2024-09-20T20:29:57.590675+0000","last_clean":"2024-09-20T20:29:57.590675+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:29:57.590675+0000","last_undegraded":"2024-09-20T20:29:57.590675+0000","last_fullsized":"2024-09-20T20:29:57.590675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593420+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:29:57.593420+0000","last_peered":"2024-09-20T20:29:57.593420+0000","last_clean":"2024-09-20T20:29:57.593420+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:29:57.593420+0000","last_undegraded":"2024-09-20T20:29:57.593420+0000","last_fullsized":"2024-09-20T20:29:57.593420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593148+0000","last_change":"2024-09-20T20:29:53.995769+0000","last_active":"2024-09-20T20:29:57.593148+0000","last_peered":"2024-09-20T20:29:57.593148+0000","last_clean":"2024-09-20T20:29:57.593148+0000","last_became_active":"2024-09-20T20:29:53.994788+0000","last_became_peered":"2024-09-20T20:29:53.994788+0000","last_unstale":"2024-09-20T20:29:57.593148+0000","last_undegraded":"2024-09-20T20:29:57.593148+0000","last_fullsized":"2024-09-20T20:29:57.593148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:58.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593654+0000","last_change":"2024-09-20T20:29:55.004166+0000","last_active":"2024-09-20T20:29:57.593654+0000","last_peered":"2024-09-20T20:29:57.593654+0000","last_clean":"2024-09-20T20:29:57.593654+0000","last_became_active":"2024-09-20T20:29:55.002511+0000","last_became_peered":"2024-09-20T20:29:55.002511+0000","last_unstale":"2024-09-20T20:29:57.593654+0000","last_undegraded":"2024-09-20T20:29:57.593654+0000","last_fullsized":"2024-09-20T20:29:57.593654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593507+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:29:57.593507+0000","last_peered":"2024-09-20T20:29:57.593507+0000","last_clean":"2024-09-20T20:29:57.593507+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:29:57.593507+0000","last_undegraded":"2024-09-20T20:29:57.593507+0000","last_fullsized":"2024-09-20T20:29:57.593507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592500+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:29:57.592500+0000","last_peered":"2024-09-20T20:29:57.592500+0000","last_clean":"2024-09-20T20:29:57.592500+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:29:57.592500+0000","last_undegraded":"2024-09-20T20:29:57.592500+0000","last_fullsized":"2024-09-20T20:29:57.592500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593828+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:29:57.593828+0000","last_peered":"2024-09-20T20:29:57.593828+0000","last_clean":"2024-09-20T20:29:57.593828+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:29:57.593828+0000","last_undegraded":"2024-09-20T20:29:57.593828+0000","last_fullsized":"2024-09-20T20:29:57.593828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592557+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:29:57.592557+0000","last_peered":"2024-09-20T20:29:57.592557+0000","last_clean":"2024-09-20T20:29:57.592557+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:29:57.592557+0000","last_undegraded":"2024-09-20T20:29:57.592557+0000","last_fullsized":"2024-09-20T20:29:57.592557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593691+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:29:57.593691+0000","last_peered":"2024-09-20T20:29:57.593691+0000","last_clean":"2024-09-20T20:29:57.593691+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:29:57.593691+0000","last_undegraded":"2024-09-20T20:29:57.593691+0000","last_fullsized":"2024-09-20T20:29:57.593691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593091+0000","last_change":"2024-09-20T20:29:55.001408+0000","last_active":"2024-09-20T20:29:57.593091+0000","last_peered":"2024-09-20T20:29:57.593091+0000","last_clean":"2024-09-20T20:29:57.593091+0000","last_became_active":"2024-09-20T20:29:55.000076+0000","last_became_peered":"2024-09-20T20:29:55.000076+0000","last_unstale":"2024-09-20T20:29:57.593091+0000","last_undegraded":"2024-09-20T20:29:57.593091+0000","last_fullsized":"2024-09-20T20:29:57.593091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592547+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:29:57.592547+0000","last_peered":"2024-09-20T20:29:57.592547+0000","last_clean":"2024-09-20T20:29:57.592547+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:29:57.592547+0000","last_undegraded":"2024-09-20T20:29:57.592547+0000","last_fullsized":"2024-09-20T20:29:57.592547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591986+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:29:57.591986+0000","last_peered":"2024-09-20T20:29:57.591986+0000","last_clean":"2024-09-20T20:29:57.591986+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:29:57.591986+0000","last_undegraded":"2024-09-20T20:29:57.591986+0000","last_fullsized":"2024-09-20T20:29:57.591986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592554+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:29:57.592554+0000","last_peered":"2024-09-20T20:29:57.592554+0000","last_clean":"2024-09-20T20:29:57.592554+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:29:57.592554+0000","last_undegraded":"2024-09-20T20:29:57.592554+0000","last_fullsized":"2024-09-20T20:29:57.592554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:30:12.418 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-20T20:30:12.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-20T20:30:12.751 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 20 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 49cfe37c-8fc4-44b8-a85f-d53d77eb9d19 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-20T20:29:32.709374+0000 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-20T20:29:57.587557+0000 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 4 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-09-20T20:30:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client jewel 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 3 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/367188288,v1:172.21.15.79:6801/367188288] [v2:172.21.15.79:6802/367188288,v1:172.21.15.79:6803/367188288] exists,up 1faec90a-457d-4941-a408-c3a5b5f8e2f1 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6800/3440150315,v1:172.21.15.90:6801/3440150315] [v2:172.21.15.90:6802/3440150315,v1:172.21.15.90:6803/3440150315] exists,up 99ce4df8-04c8-4992-9306-22ca73b3e744 2024-09-20T20:30:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/3717183720,v1:172.21.15.187:6801/3717183720] [v2:172.21.15.187:6802/3717183720,v1:172.21.15.187:6803/3717183720] exists,up 9427eb75-9576-46b8-9123-f40e3ad555fc 2024-09-20T20:30:12.769 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/367188288,v1:172.21.15.79:6801/367188288] [v2:172.21.15.79:6802/367188288,v1:172.21.15.79:6803/367188288] exists,up 1faec90a-457d-4941-a408-c3a5b5f8e2f1', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6800/3440150315,v1:172.21.15.90:6801/3440150315] [v2:172.21.15.90:6802/3440150315,v1:172.21.15.90:6803/3440150315] exists,up 99ce4df8-04c8-4992-9306-22ca73b3e744', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/3717183720,v1:172.21.15.187:6801/3717183720] [v2:172.21.15.187:6802/3717183720,v1:172.21.15.187:6803/3717183720] exists,up 9427eb75-9576-46b8-9123-f40e3ad555fc'] 2024-09-20T20:30:12.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-20T20:30:12.882 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:30:12.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mon.a", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster": "ceph", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket_mode": "", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_client_required": "cephx, none", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_cluster_required": "cephx", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_debug": "true", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_required": "cephx", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_supported": "cephx", 2024-09-20T20:30:12.883 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio": "true", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_poll_ms": "250", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_reap_max": "16", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_async_discard": "false", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_block_size": "4096", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio": "false", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_inflight_ios": "false", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_enable_discard": "false", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry": "3", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-20T20:30:12.884 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash": "0", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring": "false", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_hipri": "false", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_type": "", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_alloc_size": "1048576", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_allocator": "hybrid", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_buffered_io": "true", 2024-09-20T20:30:12.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_for_zeros": "false", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_compact_log_sync": "false", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_log_runway": "4194304", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_prefetch": "1048576", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_flush_size": "524288", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_log_runway": "1048576", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery": "false", 2024-09-20T20:30:12.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_sync_write": "false", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocation_from_file": "true", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocator": "hybrid", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_multi": "true", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-20T20:30:12.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_create": "true", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_create": "false", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_path": "", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_size": "0", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_path": "", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_preallocate_file": "false", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_size": "107374182400", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_create": "false", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_path": "", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_size": "100663296", 2024-09-20T20:30:12.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs": "true", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune": "true", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-20T20:30:12.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size": "0", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_type": "2q", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_clone_cow": "true", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-20T20:30:12.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_mode": "none", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_csum_type": "crc32c", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_freelist": "false", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-20T20:30:12.891 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_small_allocations": "0", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_read": "true", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_write": "false", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-20T20:30:12.892 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fail_eio": "false", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount": "false", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount": "false", 2024-09-20T20:30:12.893 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_ignore_data_csum": "false", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-20T20:30:12.894 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_op_age": "5.000000", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_alloc_size": "0", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size": "0", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_deferred_txc": "32", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size": "0", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_nid_prealloc": "1024", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-20T20:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_retry_disk_reads": "3", 2024-09-20T20:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cf": "true", 2024-09-20T20:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-20T20:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_mem": "512", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-20T20:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_tracing": "false", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_zero_block_detection": "false", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-20T20:30:12.899 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_signatures": "false", 2024-09-20T20:30:12.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_version": "2", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_signatures": "false", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_version": "2", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_signatures": "false", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_version": "2", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_sign_messages": "true", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "chdir": "", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_acl_type": "", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_asio_thread_count": "2", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_mid": "0.750000", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_size": "16384", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_caps_release_delay": "5", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_check_pool_perm": "true", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-20T20:30:12.901 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_force_sync_read": "false", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_getattr_caps": "false", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_features": "", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_tick_delay": "0", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_remount": "false", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_dirsize_rbytes": "true", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_force_lazyio": "false", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_fs": "", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_release_failure": "false", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_inline_size": "4096", 2024-09-20T20:30:12.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mds_namespace": "", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_metadata": "", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_gid": "-1", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_timeout": "300", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_uid": "-1", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mountpoint": "/", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_notify_timeout": "10", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc": "true", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty": "104857600", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_objects": "1000", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_size": "209715200", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_target_dirty": "8388608", 2024-09-20T20:30:12.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_permissions": "true", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota": "true", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota_df": "true", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_bytes": "0", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_periods": "4", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_min": "131072", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_reconnect_stale": "false", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_shutdown_timeout": "30", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_snapdir": ".snap", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_tick_interval": "1", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_trace": "", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_try_dentry_invalidate": "false", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_faked_inos": "false", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_random_mds": "false", 2024-09-20T20:30:12.904 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog": "false", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_port": "12201", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_monitors": "default=true", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog": "false", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_level": "info", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "-", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network": "", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network_interface": "", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_isal": "false", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_level": "5", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_winsize": "-15", 2024-09-20T20:30:12.905 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zstd_level": "1", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_op_num_threads": "6", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_stat_interval": "0", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_cpu_cores": "", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_num_threads": "0", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location": "", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook": "", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook_timeout": "10", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "daemonize": "false", 2024-09-20T20:30:12.906 INFO:teuthology.orchestra.run.smithi070.stdout: "daos_pool": "tank", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_alienstore": "0/5", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_allow_any_pool_priority": "false", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok": "1/5", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok_assert_abort": "false", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asserts_on_shutdown": "true", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_auth": "20/20", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bdev": "1/3", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluefs": "1/5", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluestore": "1/5", 2024-09-20T20:30:12.907 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_buffer": "0/1", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ceph_exporter": "1/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephfs_mirror": "0/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephsqlite": "0/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_client": "0/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_compressor": "1/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_context": "0/1", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crimson_interrupt": "0/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crush": "1/1", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crypto": "1/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cyanstore": "0/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_deliberately_leak_memory": "false", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_disable_randomized_ping": "false", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_dpdk": "1/5", 2024-09-20T20:30:12.908 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_eventtrace": "1/5", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filer": "0/1", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filestore": "1/3", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_finisher": "1/1", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_fuse": "1/5", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeat_testing_span": "0", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeatmap": "1/5", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_javaclient": "1/5", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journal": "1/3", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journaler": "0/5", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_kstore": "1/5", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_lockdep": "0/1", 2024-09-20T20:30:12.909 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mclock": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_balancer": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_locker": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log_expire": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_migrator": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_quiesce": "3/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_memstore": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgr": "2/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgrc": "1/5", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mon": "20/20", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_monc": "0/10", 2024-09-20T20:30:12.910 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ms": "1/1", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_none": "0/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objclass": "0/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objectcacher": "0/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objecter": "0/1", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_optracker": "0/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_osd": "1/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_paxos": "20/20", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_perfcounter": "1/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_prioritycache": "1/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rados": "0/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd": "0/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_mirror": "0/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_pwl": "0/5", 2024-09-20T20:30:12.911 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_replay": "0/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_refs": "0/0", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_reserver": "1/1", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw": "1/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_access": "1/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_datacache": "1/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_dbstore": "1/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_flight": "1/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_sync": "1/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rocksdb": "4/5", 2024-09-20T20:30:12.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_backref": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cache": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cleaner": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_device": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_epm": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_journal": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_lba": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_odata": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_omap": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_onode": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_t": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_tm": "0/5", 2024-09-20T20:30:12.913 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_striper": "0/1", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_test": "0/5", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_throttle": "1/1", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_timer": "0/1", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_tp": "0/5", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_trace": "1/5", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "device_failure_prediction_mode": "none", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_graylog": "false", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_journald": "false", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_stderr": "true", 2024-09-20T20:30:12.914 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_syslog": "false", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event_tracing": "false", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_addr": "0.0.0.0", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_http_port": "9926", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_prio_limit": "5", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sort_metrics": "true", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_stats_period": "5", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "fake_statfs_for_testing": "0", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "fatal_signal_handlers": "true", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_purge_ops": "10", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_truncate_ops": "128", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_apply_finisher_threads": "1", 2024-09-20T20:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_blackhole": "false", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_clone_range": "true", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_snap": "true", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_caller_concurrency": "10", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_collect_device_partition_information": "true", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_commit_timeout": "600.000000", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_inject_read_err": "false", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_omap_check": "false", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_verify_split": "false", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_dump_file": "", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fadvise": "true", 2024-09-20T20:30:12.916 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fail_eio": "true", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_shards": "16", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_size": "128", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap": "false", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap_threshold": "4096", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_inject_stall": "0", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_parallel": "false", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_trailing": "false", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_writeahead": "false", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_kill_at": "0", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-20T20:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs": "0", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size": "0", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_merge_threshold": "-10", 2024-09-20T20:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_odsync_write": "false", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend": "rocksdb", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend_path": "", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_timeout": "60", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_threads": "2", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_punch_hole": "false", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-20T20:30:12.919 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_ops": "50", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_seek_data_hole": "false", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc": "false", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_splice": "false", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_multiple": "2", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_rand_factor": "20", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_update_to": "1000", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-20T20:30:12.920 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_enable": "true", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_xfs_extsize": "false", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_zfs_snap": "false", 2024-09-20T20:30:12.921 INFO:teuthology.orchestra.run.smithi070.stdout: "fio_dir": "/tmp/fio", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "49cfe37c-8fc4-44b8-a85f-d53d77eb9d19", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_allow_other": "true", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_atomic_o_trunc": "true", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_big_writes": "true", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_debug": "false", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_default_permissions": "false", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_disable_pagecache": "false", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_max_write": "0", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_multithreaded": "true", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_require_active_mds": "true", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_set_user_groups": "true", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_move": "true", 2024-09-20T20:30:12.922 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_read": "true", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_write": "true", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_use_invalidate_cb": "true", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_target_name": "ceph", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_file": "", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_inject_failure": "0", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_interval": "5", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "host": "smithi070", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-20T20:30:12.923 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "inject_early_sigterm": "false", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_agent_port": "6799", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_tracing_enable": "false", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_aio": "true", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_align_min_size": "65536", 2024-09-20T20:30:12.924 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_align": "true", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_size": "4096", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_dio": "true", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_discard": "false", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_force_aio": "false", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_ignore_corruption": "false", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_bytes": "10485760", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_entries": "100", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_replay_from": "0", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_write_header_frequency": "0", 2024-09-20T20:30:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_zero_on_create": "false", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prefetch_periods": "10", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prezero_periods": "5", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_write_head_interval": "15", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "keyfile": "", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_backend": "rocksdb", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_default_stripe_size": "65536", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount": "false", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_bytes": "67108864", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_ops": "512", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_nid_prealloc": "1024", 2024-09-20T20:30:12.926 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_onode_map_size": "1024", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_submit_transaction": "false", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_transaction": "false", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "librados_thread_count": "2", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep": "false", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep_force_backtrace": "false", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_coarse_timestamps": "true", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_flush_on_exit": "false", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_host": "127.0.0.1", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_port": "12201", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_new": "1000", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_recent": "10000", 2024-09-20T20:30:12.927 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stderr_prefix": "", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stop_at_utilization": "0.970000", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": "true", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_graylog": "false", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_journald": "false", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_stderr": "false", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_syslog": "false", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "max_rotating_auth_attempts": "10", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_action_on_write_error": "1", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_alternate_name_max": "8192", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_asio_thread_count": "2", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_export_pin": "true", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_dirs": "true", 2024-09-20T20:30:12.928 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_interval": "5", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_interval": "10", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max": "-1", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max_until": "-1", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_merge_size": "50", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_midchunk": "0.300000", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_start": "0.200000", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_minchunk": "0.001000", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_mode": "0", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_max": "1.200000", 2024-09-20T20:30:12.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_min": "0.800000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_overload_epochs": "2", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_bits": "3", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_size": "10000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_target_decay": "10.000000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_grace": "15.000000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_interval": "4.000000", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-20T20:30:12.930 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_mid": "0.700000", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_delay": "0", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_release_free_interval": "10", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_reservation": "0.050000", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_interval": "1", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_threshold": "262144", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-20T20:30:12.931 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_prealloc_inos": "1000", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_connect_bootstrapping": "false", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_damage_table_max_entries": "10000", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_auth_pins": "false", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_frag": "false", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_scatterstat": "false", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_subtrees": "false", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_decay_halflife": "5.000000", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_default_dir_hash": "2", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_defer_session_stale": "true", 2024-09-20T20:30:12.932 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_deny_all_reconnect": "false", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_keys_per_op": "16384", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_commit_size": "10", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_entries": "0", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_prefetch": "true", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_on_map": "false", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_early_reply": "true", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enable_op_tracker": "true", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enforce_unique_name": "true", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-20T20:30:12.933 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random": "true", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_summarize_threshold": "10", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_health_dummy": "false", 2024-09-20T20:30:12.934 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_migrator_session_race": "false", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_join_fs": "", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_journal_format": "1", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_create_at": "0", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_export_at": "0", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_import_at": "0", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_at": "0", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_expire_at": "0", 2024-09-20T20:30:12.935 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_replay_at": "0", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_link_at": "0", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_mdstable_at": "0", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_openc_at": "0", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_rename_at": "0", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_shutdown_at": "0", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_event_large_threshold": "524288", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_events_per_segment": "1024", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_events": "-1", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_segments": "128", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_pause": "false", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_segment_size": "0", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-20T20:30:12.936 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_threshold": "128", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_warn_factor": "2.000000", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_caps_per_client": "1048576", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_flushes": "100000", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_requests": "100000", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_export_size": "20971520", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_file_recover": "32", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_files": "64", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops": "8192", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-20T20:30:12.937 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_snaps_per_dir": "100", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_metrics_update_interval": "2", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_per_client": "100", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_working_set": "10000", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_numa_node": "-1", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_complaint_time": "30.000000", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_duration": "600", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_size": "20", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_slow_op_size": "20", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-20T20:30:12.938 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_log_threshold": "5", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_grace": "15", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_interval": "5", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_caps": "30000", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_threshold": "262144", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_interval": "1.000000", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-20T20:30:12.939 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_gid": "0", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_uid": "0", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_shutdown_check": "0", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_skip_ino": "0", 2024-09-20T20:30:12.940 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_max_uid": "4294967294", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_min_uid": "0", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_rstat": "false", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_standby_replay_damaged": "false", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_symlink_recovery": "true", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_exports": "0", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_fragments": "0", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_tick_interval": "5.000000", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_valgrind_exit": "false", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_backtrace": "1", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_scatter": "false", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-20T20:30:12.941 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_sessions": "false", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool_debug": "false", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_device_bytes": "1073741824", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_set": "false", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_size": "65536", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_bytes": "134217728", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_messages": "512", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_disabled_modules": "", 2024-09-20T20:30:12.942 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_enable_op_tracker": "true", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_max_pg_num_change": "128", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_bytes": "134217728", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_messages": "128", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_bytes": "134217728", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_messages": "128", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_duration": "600", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_size": "20", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-20T20:30:12.943 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_log_threshold": "5", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_bytes": "536870912", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_messages": "8192", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_pool": "true", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_standby_modules": "true", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_period": "5", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_threshold": "5", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_tick_period": "2", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_delete": "true", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_size_one": "true", 2024-09-20T20:30:12.944 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_auth_validate_all_caps": "true", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_bytes": "104857600", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_directed_command_retry": "2", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_parallel": "3", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_log_interval": "1.000000", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_interval": "10.000000", 2024-09-20T20:30:12.945 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_target_rank": "-1", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file_level": "debug", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_file": "true", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_journald": "false", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-20T20:30:12.946 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_bootstrap": "false", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_start": "false", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_trim": "true", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cpu_threads": "4", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_crush_min_required_version": "hammer", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_daemon_bytes": "419430400", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_crit": "5", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_warn": "5", 2024-09-20T20:30:12.947 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_size_warn": "16106127360", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_json": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_transactions": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_extra_checks": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_reef": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_squid": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-20T20:30:12.948 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_mkfs_grace": "120", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_uptime_grace": "60", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_default_strategy": "1", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_timeout": "5.000000", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_divisor": "2", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_enable_op_tracker": "true", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fake_pool_delete": "false", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_force_quorum_join": "false", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_globalid_prealloc": "10000", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_detail_to_clog": "false", 2024-09-20T20:30:12.949 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_log_update_period": "5", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_max_detail": "50", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog": "true", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_interval": "600", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host": "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],[v2:172.21.15.70:3302,v1:172.21.15.70:6791]", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host_override": "", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_initial_members": "", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-20T20:30:12.950 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease": "5.000000", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_full_interval": "50", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max": "10000", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max_summary": "50", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_epochs": "500", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_osd": "10000", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pg_per_osd": "10000", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pool_pg_num": "65536", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-20T20:30:12.951 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_force_trim_to": "0", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_skip_sanity": "false", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_autotune": "true", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_target": "2147483648", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_beacon_grace": "30", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_digest_period": "5", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_inactive_grace": "60", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_min_osdmap_epochs": "500", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_complaint_time": "30", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_duration": "600", 2024-09-20T20:30:12.952 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_size": "20", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_size": "20", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_log_threshold": "5", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_in": "false", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size": "500", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-20T20:30:12.953 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_interval": "600", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_force_trim_to": "0", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-20T20:30:12.954 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_down_reporters": "2", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_report_timeout": "900", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-20T20:30:12.955 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_stuck_threshold": "60", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_probe_timeout": "2.000000", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_change": "0.050000", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_osds": "4", 2024-09-20T20:30:12.956 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_interval": "86400", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_max_keys": "100", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_timeout": "300", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_session_timeout": "300", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_smart_report_timeout": "5", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stat_smooth_intervals": "6", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_min_size": "2", 2024-09-20T20:30:12.957 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_size": "4", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_debug": "false", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_provider_kill_at": "0", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_requester_kill_at": "0", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_timeout": "60.000000", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_target_pg_per_osd": "100", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_tick_interval": "5", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_interval": "300.000000", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_use_min_delay_socket": "false", 2024-09-20T20:30:12.958 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_older_version_delay": "604800", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_misplaced": "false", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_older_version": "true", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-20T20:30:12.959 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "monmap": "", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_tracing_enabled": "false", 2024-09-20T20:30:12.960 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_op_threads": "3", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_cm": "false", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_device_name": "", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_dscp": "96", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_local_gid": "", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_port_num": "1", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-20T20:30:12.961 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_sl": "3", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_support_srq": "true", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_type": "ib", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_reap_threshold": "5", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_before_connect": "false", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv4": "true", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv6": "false", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr1": "true", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr2": "true", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_max": "7568", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_min": "6800", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_count": "3", 2024-09-20T20:30:12.962 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_delay": "5", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_client": "false", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mds": "false", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mgr": "false", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mon": "false", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_osd": "false", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_client_mode": "crc secure", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_mode": "crc secure", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_type": "", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_compress_secure": "false", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_idle_timeout": "900", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_ready_timeout": "10", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_data": "true", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_header": "true", 2024-09-20T20:30:12.963 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bad_msg": "false", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bug": "true", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_old_message": "true", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_skipped_message": "false", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_coremask": "0xF", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_enable_tso": "true", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hugepages": "", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-20T20:30:12.964 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_lro": "true", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_memory_channel": "4", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_pmd": "", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_port_id": "0", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_on_send": "false", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_initial_backoff": "0.200000", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_max": "1.000000", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_type": "", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-20T20:30:12.965 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_network_congestion": "0", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_socket_failures": "0", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_learn_addr_from_peer": "true", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_accept_failures": "4", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_backoff": "15.000000", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_client_mode": "secure crc", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_service_mode": "secure crc", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_min_size": "1024", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_mode": "none", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_min_cost": "65536", 2024-09-20T20:30:12.966 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_public_type": "", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_service_mode": "crc secure", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_listen_backlog": "512", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_nodelay": "true", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_rcvbuf": "0", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_type": "async+posix", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "no_config_file": "false", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_completion_locks_per_session": "32", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_ops": "1024", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-20T20:30:12.967 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_tick_interval": "5.000000", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_timeout": "10.000000", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_blackhole": "false", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "openssl_engine_opts": "", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_delay_time": "5.000000", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_hist_halflife": "1000", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_low_ops": "2", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_ops": "4", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_slop": "0.020000", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-20T20:30:12.968 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_asio_thread_count": "2", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_async_recovery_min_cost": "100", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_max": "512", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_min": "64", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_degraded": "false", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_peering": "false", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_unfound": "true", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_beacon_report_interval": "300", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_duration": "30", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_max_block_size": "67108864", 2024-09-20T20:30:12.969 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blkin_trace_all": "false", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_for_log_corruption": "false", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_update_on_start": "true", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_cap": "256", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_size_cap": "524288000", 2024-09-20T20:30:12.970 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_op_priority": "63", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_watch_timeout": "30", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_command_max_records": "256", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_compact_on_start": "false", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_on_start": "true", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_weight_set": "true", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-20T20:30:12.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_feed_pullee": "-1", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_misdirected_ops": "false", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_acting_change": "false", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_purge_strays": "false", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_op_order": "false", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_shutdown": "false", 2024-09-20T20:30:12.972 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_trim_objects": "false", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_snaps": "false", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_keys": "1024", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_stride": "524288", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-20T20:30:12.973 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_notify_timeout": "30", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep": "0.000000", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_discard_disconnected_ops": "true", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_enable_op_tracker": "true", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-20T20:30:12.974 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_info": "true", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown": "true", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_function_tracing": "false", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_grace": "20", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_interval": "6", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_peers": "10", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_size": "2000", 2024-09-20T20:30:12.975 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_stale": "600", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_max_size": "100000", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_min_size": "1000", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_size": "5120", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_kill_backfill_at": "0", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_cache_size": "50", 2024-09-20T20:30:12.976 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_dedup": "true", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max": "40", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_share_max_epochs": "40", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_name_len": "100", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_size": "0", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_backfills": "1", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_count": "5", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_period": "600", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_name_len": "2048", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_namespace_len": "256", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_size": "134217728", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-20T20:30:12.977 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_blocked_by": "16", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_log_entries": "10000", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pgls": "1024", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_cost": "8388608", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_objects": "10", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_scrubs": "3", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_trimming_pgs": "2", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_op_reply_len": "64", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_size": "90", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-20T20:30:12.978 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_profile": "balanced", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-20T20:30:12.979 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_base": "805306368", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_min": "134217728", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target": "4294967296", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_autotune": "false", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_pg_log_entries": "250", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_recovery_priority": "0", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-20T20:30:12.980 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_interval": "5", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_cache_shards": "32", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_op_tracker_shard": "32", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_auto_affinity": "true", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_node": "-1", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_prefer_iface": "true", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objecter_finishers": "1", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore": "bluestore", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_fuse": "false", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_tracing": "false", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_complaint_time": "30.000000", 2024-09-20T20:30:12.981 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_duration": "600", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_size": "20", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_size": "20", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_log_threshold": "5", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards": "0", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_hdd": "5", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_ssd": "8", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_min_cost": "65536", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-20T20:30:12.982 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue_cut_off": "high", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_timeout": "15", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_open_classes_on_start": "true", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_os_flags": "0", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_peering_op_priority": "255", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_cost": "1048576", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_priority": "5", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_max": "10000", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_min": "100", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-20T20:30:12.983 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crimson": "false", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-20T20:30:12.984 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flags": "0", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_min_size": "0", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_num": "32", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pgp_num": "0", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_ratio": "70", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_size": "2", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_type": "replicated", 2024-09-20T20:30:12.985 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_push_per_object_cost": "1000", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap": "true", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_cost": "20971520", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active": "0", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_single_start": "1", 2024-09-20T20:30:12.986 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_priority": "3", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_priority": "5", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep": "0.000000", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_repair_during_recovery": "false", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_requested_scrub_priority": "120", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair": "false", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-20T20:30:12.987 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_hour": "0", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_week_day": "0", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_max": "25", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_min": "5", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_cost": "52428800", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_during_recovery": "false", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_hour": "0", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_week_day": "0", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_event_cost": "4096", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-20T20:30:12.988 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_invalid_stats": "true", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_preemptions": "5", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_priority": "5", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_sleep": "0.000000", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_skip_data_digest": "false", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_smart_report_timeout": "5", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_cost": "1048576", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_priority": "5", 2024-09-20T20:30:12.989 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_transaction_size": "30", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-20T20:30:12.990 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tracing": "false", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_use_stale_snap": "false", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "osdc_blkin_trace_all": "false", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_kill_at": "0", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_max_join_drift": "10", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min": "500", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min_wait": "0.050000", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_propose_interval": "1.000000", 2024-09-20T20:30:12.991 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max": "500", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_min": "250", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_stash_full_interval": "25", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_max": "500", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_min": "250", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "perf": "true", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "-", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrv": "", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "public_bind_addr": "-", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network": "", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network_interface": "", 2024-09-20T20:30:12.992 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_busy_polling": "false", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_enabled": "false", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_session_max_number": "256", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_mon_op_timeout": "0", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_osd_op_timeout": "0", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_tracing": "false", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_atime_update_interval": "60", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_parent_reads": "false", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_snap_reads": "false", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blkin_trace_all": "false", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-20T20:30:12.993 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache": "true", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_policy": "writearound", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_size": "33554432", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_clone_copy_on_read": "false", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_compression_hint": "none", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_concurrent_management_ops": "10", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-20T20:30:12.994 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_clone_format": "auto", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_data_pool": "", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_features": "61", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_format": "2", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_map_options": "", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_order": "22", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_pool": "rbd", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_count": "0", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_unit": "0", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_enable_alloc_hint": "true", 2024-09-20T20:30:12.995 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler": "simple", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_order": "24", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_pool": "", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_splay_width": "4", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_parent_reads": "false", 2024-09-20T20:30:12.996 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_snap_reads": "false", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-20T20:30:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-20T20:30:12.998 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mtime_update_interval": "60", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_non_blocking_aio": "true", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_thread_timeout": "60", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_threads": "1", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_parent_cache_enabled": "false", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_plugins": "", 2024-09-20T20:30:12.999 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_limit": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_exclude_ops": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_limit": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-20T20:30:13.000 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_read_from_replica_policy": "default", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_skip_partial_discard": "true", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-20T20:30:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_tracing": "false", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_names": "true", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_pool": "true", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_base_url": "", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_log_level": "", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_acl_grants_max_num": "100", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_admin_entry": "admin", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_backend_store": "rados", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_barbican_url": "", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_beast_enable_async": "true", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_counters_cache": "false", 2024-09-20T20:30:13.002 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_enabled": "true", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_expiry_interval": "900", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_lru_size": "25000", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_config_store": "rados", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_content_length_compat": "false", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress": "true", 2024-09-20T20:30:13.003 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cors_rules_max_num": "100", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cross_domain_policy": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_addr": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_password": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_username": "", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_require_ssl": "true", 2024-09-20T20:30:13.004 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-20T20:30:13.005 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_addr": "", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_auth": "token", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_namespace": "", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_prefix": "", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_token_file": "", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_buffersize": "524288", 2024-09-20T20:30:13.006 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_time": "300", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_port": "6379", 2024-09-20T20:30:13.007 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_changes_size": "1000", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_num_shards": "128", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_window": "30", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-20T20:30:13.008 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-20T20:30:13.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_name": "", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_s3website_name": "", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dynamic_resharding": "true", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_gc_threads": "true", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_lc_threads": "true", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_ops_log": "false", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_quota_threads": "true", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_static_website": "false", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_usage_log": "false", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enforce_swift_acls": "true", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_exit_timeout_secs": "120", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_expose_bucket": "false", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_extended_http_attrs": "", 2024-09-20T20:30:13.010 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_filter": "none", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontends": "beast port=7480", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred": "50", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_objs": "32", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_period": "3600", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-20T20:30:13.011 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_init_timeout": "300", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_connection_idle": "300", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_domain": "", 2024-09-20T20:30:13.012 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password_path": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_project": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_tenant": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token_path": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_user": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_api_version": "2", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_domain": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_password": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_project": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_user": "", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-20T20:30:13.013 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_url": "", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_debug_interval": "-1", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_lock_max_time": "90", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_objs": "32", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_rules": "1000", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_worker": "3", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_thread_delay": "0", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-20T20:30:13.014 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_dnattr": "uid", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchfilter": "", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_uri": "", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_http_headers": "", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name_utc": "false", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-20T20:30:13.015 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_name_len": "0", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_size": "0", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_chunk_size": "4194304", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_listing_results": "1000", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_notify_retries": "10", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_param_size": "1048576", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_size": "5368709120", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_slo_entries": "1000", 2024-09-20T20:30:13.016 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_log_max_shards": "64", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mp_lock_max_time": "600", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-20T20:30:13.017 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_max_gc": "300", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_async_rados_threads": "32", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_control_oids": "8", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_numa_node": "-1", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_chunk_size": "100", 2024-09-20T20:30:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_gc_interval": "600", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_timeout": "600", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_tracing": "false", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_token": "", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_url": "", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_verify_ssl": "true", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_rados": "false", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_socket_path": "", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-20T20:30:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval": "2.000000", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_lanes": "3", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_partitions": "3", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_continue": "true", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-20T20:30:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_tracing": "false", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm": "", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_id": "", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region": "", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-20T20:30:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_request_uri": "", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_batch_size": "64", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_max_aio": "128", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_num_logs": "16", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_thread_interval": "600", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_resolve_cname": "false", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_run_sync_thread": "true", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-20T20:30:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_scheduler_type": "throttler", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_script_uri": "", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_service_provider_name": "", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_id": "", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_secret": "", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_entry": "sts", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_key": "sts", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-20T20:30:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_min_session_duration": "900", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_token_introspection_url": "", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_account_in_url": "false", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_entry": "auth", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_url": "", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_custom_header": "", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_need_stats": "true", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_tenant_name": "", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_token_expiration": "86400", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url": "", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url_prefix": "swift", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-20T20:30:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_lease_period": "120", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_thread_pool_size": "512", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-20T20:30:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_comment": "", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_createby": "", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_encoding": "", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_flag": "false", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_origin": "", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_tracker": "", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_trust_forwarded_https": "false", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-20T20:30:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_shards": "32", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_user_shards": "1", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_use_opa_authz": "false", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_counters_cache": "false", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_max_buckets": "1000", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_policies_max_num": "100", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_unique_email": "true", 2024-09-20T20:30:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_verify_ssl": "true", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone": "", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_id": "", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup": "", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_id": "", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_auto_session_clear": "true", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_block_size": "4096", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-20T20:30:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_size": "536870912", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_index_type": "binary_search", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-20T20:30:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_partition_filters": "false", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_perf": "false", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "run_dir": "/var/run/ceph", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_block_create": "true", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cache_lru_size": "67108864", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_max_object_size": "16777216", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_device_size": "53687091200", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-20T20:30:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_full_integrity_check": "false", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_capacity": "16", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_main_device_type": "SSD", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_segment_size": "67108864", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "set_keepcaps": "false", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "setgroup": "", 2024-09-20T20:30:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser": "", 2024-09-20T20:30:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser_match_path": "", 2024-09-20T20:30:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-20T20:30:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "thp": "false", 2024-09-20T20:30:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_default_timeout": "60", 2024-09-20T20:30:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-20T20:30:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "throttler_perf_counter": "true" 2024-09-20T20:30:13.032 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:30:13.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-20T20:30:13.169 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2024-09-20T20:30:13.170 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T20:30:13.178 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2024-09-20T20:30:13.178 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T20:30:13.187 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2024-09-20T20:30:13.187 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T20:30:13.202 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-20T20:30:13.202 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-20T20:30:13.228 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-20T20:30:13.228 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-20T20:30:13.228 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-20T20:30:13.228 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-20T20:30:13.228 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:13.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:13.229 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-20T20:30:13.229 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-20T20:30:13.229 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:13.229 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:13.229 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-20T20:30:13.230 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:30:13.230 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:30:13.230 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-20T20:30:13.230 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-20T20:30:13.230 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-20T20:30:13.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:13.231 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-20T20:30:13.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:13.231 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-20T20:30:13.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:30:13.233 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:13.229+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:13.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:13.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-20T20:30:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2024-09-20T20:30:13.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:30:13.293 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-20T20:30:13.293 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-20T20:30:13.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-20T20:30:13.333 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:13.329+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:13.361 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:13.361 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-20T20:30:13.361 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:13.362 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:13.362 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:13.362 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:13.362 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:13.370 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:13.370 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:13.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:13.405 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:13.406 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:13.433 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:13.433+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:13.438 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:13.438 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:13.493 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:13.494 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:13.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:13.557 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:13.556+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:13.628 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:13.628 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:13.634 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:13.633+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:13.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:13.652 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-20T20:30:13.669 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-20T20:30:13.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:13.670 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-09-20T20:30:13.674 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-20T20:30:13.674 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-20T20:30:13.675 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-20T20:30:13.675 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-20T20:30:13.675 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-20T20:30:13.675 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-20T20:30:13.675 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-20T20:30:13.675 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-09-20T20:30:13.675 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42450sec preferred_lft 42450sec 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-20T20:30:13.676 INFO:teuthology.orchestra.run.smithi070.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-20T20:30:13.677 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 02:42:cc:9e:ce:d0 brd ff:ff:ff:ff:ff:ff 2024-09-20T20:30:13.677 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-20T20:30:13.677 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-20T20:30:13.677 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-20T20:30:13.677 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T20:30:13.677 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-20T20:30:13.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-09-20T20:30:13.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-09-20T20:30:13.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-09-20T20:30:13.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-20T20:30:13.678 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-20T20:30:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:30:13.735 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:13.732+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T20:30:13.777 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:13.777 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:13.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T20:30:13.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:13.792 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-20T20:30:13.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:13.836 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:13.836+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:13.846 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-20T20:30:13.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:13.848 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-09-20T20:30:13.918 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:13.918 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:13.919 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-09-20T20:30:13.919 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-20T20:30:13.919 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-20T20:30:13.919 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-20T20:30:13.919 INFO:teuthology.orchestra.run.smithi070.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-20T20:30:13.920 INFO:teuthology.orchestra.run.smithi070.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-20T20:30:13.920 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-20T20:30:13.920 INFO:teuthology.orchestra.run.smithi070.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-20T20:30:13.920 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-20T20:30:13.920 INFO:teuthology.orchestra.run.smithi070.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-20T20:30:13.920 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-20T20:30:13.920 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T20:30:13.920 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-20T20:30:13.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-20T20:30:13.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-20T20:30:13.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-20T20:30:13.921 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-20T20:30:13.929 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:13.937 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:13.936+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T20:30:14.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T20:30:14.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:14.029 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-20T20:30:14.037 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:14.036+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:14.045 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:14.046 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:14.059 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:14.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:14.076 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-09-20T20:30:14.123 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T20:30:14.123 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-20T20:30:14.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T20:30:14.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-20T20:30:14.124 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-20T20:30:14.138 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:14.137+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:14.189 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:14.189 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:14.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:14.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T20:30:14.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T20:30:14.233 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-20T20:30:14.233 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T20:30:14.234 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-20T20:30:14.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-20T20:30:14.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-20T20:30:14.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-20T20:30:14.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-20T20:30:14.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-20T20:30:14.234 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-20T20:30:14.239 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:14.236+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:14.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T20:30:14.327 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:14.327 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:14.339 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:14.336+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:14.342 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:14.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T20:30:14.374 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T20:30:14.374 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-20T20:30:14.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-09-20T20:30:14.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-09-20T20:30:14.374 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-20T20:30:14.440 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:14.441+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:14.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T20:30:14.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T20:30:14.463 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:14.463 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:14.468 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-20T20:30:14.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T20:30:14.468 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:14.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:14.514 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-20T20:30:14.514 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T20:30:14.514 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:14.541 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:14.541+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:14.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-20T20:30:14.612 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:14.612 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:14.613 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T20:30:14.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:14.642 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:14.641+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-20T20:30:14.660 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-20T20:30:14.661 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-20T20:30:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-20T20:30:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T20:30:14.662 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T20:30:14.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:14.663 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-20T20:30:14.711 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-20T20:30:14.711 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-20T20:30:14.743 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:14.740+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:14.749 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:14.749 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:14.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-20T20:30:14.763 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:14.768 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T20:30:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-20T20:30:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-20T20:30:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-20T20:30:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-20T20:30:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-20T20:30:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-20T20:30:14.815 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-20T20:30:14.816 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2024-09-20T20:30:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2024-09-20T20:30:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-20T20:30:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-20T20:30:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-20T20:30:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T20:30:14.817 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T20:30:14.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:14.818 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-20T20:30:14.843 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:14.841+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:14.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2024-09-20T20:30:14.854+0000 7fbd5dcaa580 -1 init, newargv = 0x55ae98950a90 newargc=15 2024-09-20T20:30:14.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[23821]: starting ceph client 2024-09-20T20:30:14.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[23821]: starting fuse 2024-09-20T20:30:14.927 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:14.927 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:14.942 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:14.944 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:14.941+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:15.045 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:15.044+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:15.075 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:15.076 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:15.090 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:15.145 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:15.145+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:15.213 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:15.213 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:15.229 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:15.246 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:15.245+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:15.347 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:15.345+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:15.391 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:15.391 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:15.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:15.448 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:15.449+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:15.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:15.537 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:15.537 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:15.548 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:15.545+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:15.552 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:15.611 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:15.611 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:15.631 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:15.632 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:15.649 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:15.645+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:15.651 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:15.652 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:15.716 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:15.717 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:15.717 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:15.717 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:15.717 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:15.730 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:15.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:30:15.749 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:15.749+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:15.850 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:15.849+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:15.904 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:15.904 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.085781726, 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:15.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:50.821055+0000", 2024-09-20T20:30:15.909 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.079619855000001, 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015451239999999999, 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.821055+0000", 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.821055+0000", 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.821056+0000", 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9299999999999998e-07 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.821069+0000", 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3473e-05 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.821112+0000", 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2092999999999998e-05 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.821128+0000", 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6293000000000001e-05 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.821220+0000", 2024-09-20T20:30:15.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1730000000000004e-05 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.821248+0000", 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8266e-05 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.822531+0000", 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012832239999999999 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:50.822600+0000", 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9451999999999998e-05 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.910180984, 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:15.914 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:15.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:15.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:15.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.910093125, 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.920 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:15.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.910051795000001, 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:15.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.931 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.909982649, 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:15.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:15.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.909932366, 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.937 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:15.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:15.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:15.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.942 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.909897260000001, 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:15.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.909845593, 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:15.948 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:15.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.909768624000002, 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:15.952 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:15.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:15.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:15.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:15.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:15.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.957 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.909716258, 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:15.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.897146234000001, 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.962 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:15.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.897054914999998, 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:15.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:15.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:15.971 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.896967136000001, 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.975 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.896107145999999, 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:15.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:15.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.891521667999999, 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:15.980 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:15.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:15.984 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.891452522000002, 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:15.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.888136008, 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018859790000000001, 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.988 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012540+0000", 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8299999999999995e-07 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012547+0000", 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1729999999999998e-06 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012568+0000", 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0820000000000001e-05 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012798+0000", 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000230072 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013602+0000", 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080420999999999997 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014425+0000", 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000822721 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.991 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.886945308000001, 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:15.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.920625988000001, 2024-09-20T20:30:15.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:15.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:15.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:15.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:16.000 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:16.001 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:16.001 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:16.001 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:16.001 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:16.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-20T20:30:16.003 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:16.001+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:16.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:16.017 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T20:30:16.063 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-20T20:30:16.063 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-20T20:30:16.064 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T20:30:16.065 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:16.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:16.066 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-20T20:30:16.103 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:16.101+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:16.115 INFO:teuthology.orchestra.run.smithi070.stdout:45 2024-09-20T20:30:16.115 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-20T20:30:16.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2024-09-20T20:30:16.115 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> import re 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> import os 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2024-09-20T20:30:16.116 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> return f 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2024-09-20T20:30:16.117 DEBUG:teuthology.orchestra.run.smithi070:> ' 2024-09-20T20:30:16.134 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:16.134 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:16.134 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:16.134 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:16.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:16.204 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:16.201+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:16.239 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.23821.asok 2024-09-20T20:30:16.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-20T20:30:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T20:30:16.250 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.23821.asok 2024-09-20T20:30:16.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:16.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.23821.asok status 2024-09-20T20:30:16.264 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:16.264 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:16.264 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:16.264 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:16.264 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:16.279 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:16.305 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:16.301+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:16.403 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:16.403 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:16.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:16.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:16.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.403 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:16.403 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.863598887999999, 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:16.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:16.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.415281131, 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:16.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:16.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.414904177, 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:16.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:16.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.414800135, 2024-09-20T20:30:16.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:16.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.413698896, 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.413608239999999, 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.413535767999999, 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.413473621000001, 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.413410872, 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.413302329, 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.413237042999999, 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.413175144, 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.410987374000001, 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.410889371, 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.409828043000001, 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.409385573000002, 2024-09-20T20:30:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.40850863, 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.408419180999999, 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.408352917999999, 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.406839615999999, 2024-09-20T20:30:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:16.514 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:16.516 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:30:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2024-09-20T20:30:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "9e2ac70bb7aea67d34f0d50002344abbe7803736", 2024-09-20T20:30:16.516 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.1.1-367-g9e2ac70b (9e2ac70bb7aea67d34f0d50002344abbe7803736) squid (stable)", 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "23821", 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4469, 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 4469 2024-09-20T20:30:16.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2963134731 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2963134731 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.4469 192.168.0.1:0/2963134731", 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/2963134731", 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2024-09-20T20:30:16.518 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 5, 2024-09-20T20:30:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 21, 2024-09-20T20:30:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2024-09-20T20:30:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2024-09-20T20:30:16.519 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2024-09-20T20:30:16.519 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:30:16.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:16.520 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:16.516+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:16.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:16.520 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2024-09-20T20:30:16.520 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:16.527 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2024-09-20T20:30:16.527 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:16.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:30:16.527 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:16.583 INFO:teuthology.run_tasks:Running task workunit... 2024-09-20T20:30:16.596 INFO:tasks.workunit:Pulling workunits from ref ed8ee0f26ef720e6504cefa8be1a2d0872192de7 2024-09-20T20:30:16.596 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-20T20:30:16.596 INFO:tasks.workunit:timeout=3h 2024-09-20T20:30:16.596 INFO:tasks.workunit:cleanup=True 2024-09-20T20:30:16.597 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:16.616 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:16.616+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-20T20:30:16.632 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-09-20T20:30:16.632 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T20:30:16.632 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-20T20:30:16.632 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-20 20:29:54.981776895 +0000 2024-09-20T20:30:16.632 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-20 20:30:16.586171863 +0000 2024-09-20T20:30:16.632 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-20T20:30:16.632 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-20T20:30:16.633 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-20T20:30:16.652 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:16.652 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:16.653 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:16.653 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:16.667 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:16.694 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ed8ee0f26ef720e6504cefa8be1a2d0872192de7 2024-09-20T20:30:16.716 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:16.717+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:16.726 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:30:16.733 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-20T20:30:16.791 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:16.791 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:16.791 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:16.805 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:16.848 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:16.849+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:16.918 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:16.917+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.92080296, 2024-09-20T20:30:16.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:16.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.977 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.920157591999999, 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:16.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:16.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:16.982 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.427847689, 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:16.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.984 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.985540808, 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.985426189000002, 2024-09-20T20:30:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.985326906000001, 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:16.998 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:16.999 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.000 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.001 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.985265433999999, 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.003 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:17.004 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:17.005 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.006 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.983113845999998, 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.008 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:17.009 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.010 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.011 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:17.012 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.013 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.980470101000002, 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.014 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:17.015 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:17.016 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:17.017 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:17.018 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.975876353, 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.019 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.020 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.021 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.022 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:17.023 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.975755769999999, 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:17.024 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.025 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.026 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:17.027 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.975683271000001, 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:17.028 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.029 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.030 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:17.031 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.972340150000001, 2024-09-20T20:30:17.032 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.033 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.034 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.035 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:17.036 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.970006004999998, 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.038 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.967916690999999, 2024-09-20T20:30:17.041 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:17.042 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:17.043 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.044 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.045 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.967558579999999, 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:17.046 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:17.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.967438801, 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:17.050 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.053 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:17.054 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.96713853, 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.057 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.058 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.964627028999999, 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.059 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:17.061 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.062 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 21.960177624, 2024-09-20T20:30:17.063 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:17.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:17.065 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.067 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.068 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:17.068 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:17.068 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:17.069 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:17.070 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:17.069+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:17.170 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:17.168+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:17.203 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:17.204 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:17.204 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:17.217 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:17.271 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:17.269+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:17.336 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:17.336 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:17.336 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:17.336 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:17.337 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:17.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:17.398 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:17.397+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:17.473 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:17.472+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:17.477 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.659698380999998, 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.478 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.484097639000002, 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:17.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:17.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:17.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:17.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.484009780000001, 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:17.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:17.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.483968449999999, 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:17.494 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:17.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:17.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.499 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.483899304000001, 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:17.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:17.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:17.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.483849021000001, 2024-09-20T20:30:17.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:17.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:17.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:17.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.483813914999999, 2024-09-20T20:30:17.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:17.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.483762248000001, 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.517 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:17.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.521 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.483685278999999, 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:17.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.525 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.483632913000001, 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:17.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.471062888999999, 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.530 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:17.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:17.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.47097157, 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:17.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.470883790999999, 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:17.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:17.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.470023801, 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.544 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:17.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:17.548 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.465438323000001, 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:17.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:17.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.465369176999999, 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.556 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.462052663000001, 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018859790000000001, 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012540+0000", 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8299999999999995e-07 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012547+0000", 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1729999999999998e-06 2024-09-20T20:30:17.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012568+0000", 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0820000000000001e-05 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012798+0000", 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000230072 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013602+0000", 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080420999999999997 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014425+0000", 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000822721 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:17.560 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.460861962999999, 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.494542642999999, 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.564 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:17.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:17.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.49220191000000002, 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:17.570 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:17.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:17.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.575 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.576 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:17.576 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:17.576 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:17.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:17.578 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:17.576+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:17.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:17.678 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:17.676+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:17.710 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:17.710 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:17.710 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:17.710 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:17.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:17.809 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:17.808+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:17.831 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:17.831 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:17.852 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:17.852 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:17.873 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:17.873 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:17.879 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:17.876+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:17.887 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:17.887 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:17.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:17.980 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:17.981+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:18.068 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:18.068 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:18.081 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:18.080+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:18.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:18.182 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:18.180+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:18.214 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:18.214 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:18.229 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:18.283 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:18.281+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:18.354 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:18.354 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:18.366 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:18.376 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:18.376 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:18.376 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-20T20:30:18.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-20T20:30:18.384 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:18.381+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:18.483 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:18.483 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:18.485 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:18.485+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:18.497 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:18.586 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:18.584+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:18.633 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:18.633 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:18.647 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:18.675 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:30:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 22, 2024-09-20T20:30:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "49cfe37c-8fc4-44b8-a85f-d53d77eb9d19", 2024-09-20T20:30:18.675 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-20T20:29:32.709374+0000", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-20T20:30:16.724962+0000", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-20T20:29:42.497975+0000", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-20T20:29:33.925164+0000", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5806080, 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "noscrub", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-20T20:30:18.676 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 4, 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.677 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:43.674922+0000", 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:18.678 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:18.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:18.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:18.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:18.682 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:18.683 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:48.243188+0000", 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:18.684 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:18.685 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "15", 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 15, 2024-09-20T20:30:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:18.689 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:52.828296+0000", 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:18.690 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:18.691 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:18.692 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:18.693 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:18.694 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:18.695 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2024-09-20T20:30:18.696 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:53.322652+0000", 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:18.697 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.698 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "19", 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:18.699 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:18.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2024-09-20T20:30:18.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-20T20:30:18.702 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1faec90a-457d-4941-a408-c3a5b5f8e2f1", 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:18.703 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6800", 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6801", 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6802", 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6803", 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6806", 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6807", 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6804", 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6805", 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.79:6801/367188288", 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.79:6803/367188288", 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.79:6807/367188288", 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.79:6805/367188288", 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "99ce4df8-04c8-4992-9306-22ca73b3e744", 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:18.709 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6800", 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6801", 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:18.710 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6802", 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6803", 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6806", 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6807", 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6804", 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6805", 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.90:6801/3440150315", 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.90:6803/3440150315", 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.90:6807/3440150315", 2024-09-20T20:30:18.713 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.90:6805/3440150315", 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "9427eb75-9576-46b8-9123-f40e3ad555fc", 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:18.714 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6800", 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.715 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6801", 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6802", 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.716 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6803", 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6806", 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6807", 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6804", 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6805", 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.187:6801/3717183720", 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.187:6803/3717183720", 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3717183720", 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3717183720", 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:18.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:40.098836+0000", 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-20T20:30:18.720 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:39.812954+0000", 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:40.075239+0000", 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-20T20:30:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-20T20:30:18.723 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-20T20:30:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-20T20:30:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-20T20:30:18.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:18.724 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:30:18.725 INFO:tasks.thrashosds.thrasher:j is {'epoch': 22, 'fsid': '49cfe37c-8fc4-44b8-a85f-d53d77eb9d19', 'created': '2024-09-20T20:29:32.709374+0000', 'modified': '2024-09-20T20:30:16.724962+0000', 'last_up_change': '2024-09-20T20:29:42.497975+0000', 'last_in_change': '2024-09-20T20:29:33.925164+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-20T20:29:43.674922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-20T20:29:48.243188+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-20T20:29:52.828296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-20T20:29:53.322652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '1faec90a-457d-4941-a408-c3a5b5f8e2f1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 367188288}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 367188288}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 367188288}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 367188288}]}, 'public_addr': '172.21.15.79:6801/367188288', 'cluster_addr': '172.21.15.79:6803/367188288', 'heartbeat_back_addr': '172.21.15.79:6807/367188288', 'heartbeat_front_addr': '172.21.15.79:6805/367188288', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '99ce4df8-04c8-4992-9306-22ca73b3e744', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6800', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6801', 'nonce': 3440150315}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6802', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6803', 'nonce': 3440150315}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6806', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6807', 'nonce': 3440150315}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6804', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6805', 'nonce': 3440150315}]}, 'public_addr': '172.21.15.90:6801/3440150315', 'cluster_addr': '172.21.15.90:6803/3440150315', 'heartbeat_back_addr': '172.21.15.90:6807/3440150315', 'heartbeat_front_addr': '172.21.15.90:6805/3440150315', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9427eb75-9576-46b8-9123-f40e3ad555fc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 3717183720}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 3717183720}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 3717183720}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 3717183720}]}, 'public_addr': '172.21.15.187:6801/3717183720', 'cluster_addr': '172.21.15.187:6803/3717183720', 'heartbeat_back_addr': '172.21.15.187:6807/3717183720', 'heartbeat_front_addr': '172.21.15.187:6805/3717183720', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:40.098836+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:39.812954+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:40.075239+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-20T20:30:18.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:30:18.726 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:18.724+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:18.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:30:18.769 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:18.769 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:18.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:18.826 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:18.825+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:18.907 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:18.907 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:18.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:18.926 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:18.924+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:19.027 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:19.024+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:19.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:30:19.058 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:19.059 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:19.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:19.074 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-20T20:30:17.611446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":696,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":712704,"data_stored":1375416,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002289"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594390+0000","last_change":"2024-09-20T20:29:55.007075+0000","last_active":"2024-09-20T20:29:57.594390+0000","last_peered":"2024-09-20T20:29:57.594390+0000","last_clean":"2024-09-20T20:29:57.594390+0000","last_became_active":"2024-09-20T20:29:55.005105+0000","last_became_peered":"2024-09-20T20:29:55.005105+0000","last_unstale":"2024-09-20T20:29:57.594390+0000","last_undegraded":"2024-09-20T20:29:57.594390+0000","last_fullsized":"2024-09-20T20:29:57.594390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593823+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:29:57.593823+0000","last_peered":"2024-09-20T20:29:57.593823+0000","last_clean":"2024-09-20T20:29:57.593823+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:29:57.593823+0000","last_undegraded":"2024-09-20T20:29:57.593823+0000","last_fullsized":"2024-09-20T20:29:57.593823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593699+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:29:57.593699+0000","last_peered":"2024-09-20T20:29:57.593699+0000","last_clean":"2024-09-20T20:29:57.593699+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:29:57.593699+0000","last_undegraded":"2024-09-20T20:29:57.593699+0000","last_fullsized":"2024-09-20T20:29:57.593699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593419+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:29:57.593419+0000","last_peered":"2024-09-20T20:29:57.593419+0000","last_clean":"2024-09-20T20:29:57.593419+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:29:57.593419+0000","last_undegraded":"2024-09-20T20:29:57.593419+0000","last_fullsized":"2024-09-20T20:29:57.593419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593304+0000","last_change":"2024-09-20T20:29:55.001482+0000","last_active":"2024-09-20T20:29:57.593304+0000","last_peered":"2024-09-20T20:29:57.593304+0000","last_clean":"2024-09-20T20:29:57.593304+0000","last_became_active":"2024-09-20T20:29:55.000290+0000","last_became_peered":"2024-09-20T20:29:55.000290+0000","last_unstale":"2024-09-20T20:29:57.593304+0000","last_undegraded":"2024-09-20T20:29:57.593304+0000","last_fullsized":"2024-09-20T20:29:57.593304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592133+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:29:57.592133+0000","last_peered":"2024-09-20T20:29:57.592133+0000","last_clean":"2024-09-20T20:29:57.592133+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:29:57.592133+0000","last_undegraded":"2024-09-20T20:29:57.592133+0000","last_fullsized":"2024-09-20T20:29:57.592133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592055+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:29:57.592055+0000","last_peered":"2024-09-20T20:29:57.592055+0000","last_clean":"2024-09-20T20:29:57.592055+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:29:57.592055+0000","last_undegraded":"2024-09-20T20:29:57.592055+0000","last_fullsized":"2024-09-20T20:29:57.592055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591525+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:29:57.591525+0000","last_peered":"2024-09-20T20:29:57.591525+0000","last_clean":"2024-09-20T20:29:57.591525+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:29:57.591525+0000","last_undegraded":"2024-09-20T20:29:57.591525+0000","last_fullsized":"2024-09-20T20:29:57.591525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591679+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:29:57.591679+0000","last_peered":"2024-09-20T20:29:57.591679+0000","last_clean":"2024-09-20T20:29:57.591679+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:29:57.591679+0000","last_undegraded":"2024-09-20T20:29:57.591679+0000","last_fullsized":"2024-09-20T20:29:57.591679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594009+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:29:57.594009+0000","last_peered":"2024-09-20T20:29:57.594009+0000","last_clean":"2024-09-20T20:29:57.594009+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:29:57.594009+0000","last_undegraded":"2024-09-20T20:29:57.594009+0000","last_fullsized":"2024-09-20T20:29:57.594009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593950+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:29:57.593950+0000","last_peered":"2024-09-20T20:29:57.593950+0000","last_clean":"2024-09-20T20:29:57.593950+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:29:57.593950+0000","last_undegraded":"2024-09-20T20:29:57.593950+0000","last_fullsized":"2024-09-20T20:29:57.593950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593395+0000","last_change":"2024-09-20T20:29:55.012467+0000","last_active":"2024-09-20T20:29:57.593395+0000","last_peered":"2024-09-20T20:29:57.593395+0000","last_clean":"2024-09-20T20:29:57.593395+0000","last_became_active":"2024-09-20T20:29:55.011686+0000","last_became_peered":"2024-09-20T20:29:55.011686+0000","last_unstale":"2024-09-20T20:29:57.593395+0000","last_undegraded":"2024-09-20T20:29:57.593395+0000","last_fullsized":"2024-09-20T20:29:57.593395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592940+0000","last_change":"2024-09-20T20:29:55.006208+0000","last_active":"2024-09-20T20:29:57.592940+0000","last_peered":"2024-09-20T20:29:57.592940+0000","last_clean":"2024-09-20T20:29:57.592940+0000","last_became_active":"2024-09-20T20:29:55.002864+0000","last_became_peered":"2024-09-20T20:29:55.002864+0000","last_unstale":"2024-09-20T20:29:57.592940+0000","last_undegraded":"2024-09-20T20:29:57.592940+0000","last_fullsized":"2024-09-20T20:29:57.592940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592235+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:29:57.592235+0000","last_peered":"2024-09-20T20:29:57.592235+0000","last_clean":"2024-09-20T20:29:57.592235+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:29:57.592235+0000","last_undegraded":"2024-09-20T20:29:57.592235+0000","last_fullsized":"2024-09-20T20:29:57.592235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592226+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:29:57.592226+0000","last_peered":"2024-09-20T20:29:57.592226+0000","last_clean":"2024-09-20T20:29:57.592226+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:29:57.592226+0000","last_undegraded":"2024-09-20T20:29:57.592226+0000","last_fullsized":"2024-09-20T20:29:57.592226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591482+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:29:57.591482+0000","last_peered":"2024-09-20T20:29:57.591482+0000","last_clean":"2024-09-20T20:29:57.591482+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:29:57.591482+0000","last_undegraded":"2024-09-20T20:29:57.591482+0000","last_fullsized":"2024-09-20T20:29:57.591482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592894+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:29:57.592894+0000","last_peered":"2024-09-20T20:29:57.592894+0000","last_clean":"2024-09-20T20:29:57.592894+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:29:57.592894+0000","last_undegraded":"2024-09-20T20:29:57.592894+0000","last_fullsized":"2024-09-20T20:29:57.592894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594068+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:29:57.594068+0000","last_peered":"2024-09-20T20:29:57.594068+0000","last_clean":"2024-09-20T20:29:57.594068+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:29:57.594068+0000","last_undegraded":"2024-09-20T20:29:57.594068+0000","last_fullsized":"2024-09-20T20:29:57.594068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591391+0000","last_change":"2024-09-20T20:29:54.999350+0000","last_active":"2024-09-20T20:29:57.591391+0000","last_peered":"2024-09-20T20:29:57.591391+0000","last_clean":"2024-09-20T20:29:57.591391+0000","last_became_active":"2024-09-20T20:29:54.998741+0000","last_became_peered":"2024-09-20T20:29:54.998741+0000","last_unstale":"2024-09-20T20:29:57.591391+0000","last_undegraded":"2024-09-20T20:29:57.591391+0000","last_fullsized":"2024-09-20T20:29:57.591391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593556+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:29:57.593556+0000","last_peered":"2024-09-20T20:29:57.593556+0000","last_clean":"2024-09-20T20:29:57.593556+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:29:57.593556+0000","last_undegraded":"2024-09-20T20:29:57.593556+0000","last_fullsized":"2024-09-20T20:29:57.593556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592975+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:29:57.592975+0000","last_peered":"2024-09-20T20:29:57.592975+0000","last_clean":"2024-09-20T20:29:57.592975+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:29:57.592975+0000","last_undegraded":"2024-09-20T20:29:57.592975+0000","last_fullsized":"2024-09-20T20:29:57.592975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592502+0000","last_change":"2024-09-20T20:29:55.015082+0000","last_active":"2024-09-20T20:29:57.592502+0000","last_peered":"2024-09-20T20:29:57.592502+0000","last_clean":"2024-09-20T20:29:57.592502+0000","last_became_active":"2024-09-20T20:29:55.012708+0000","last_became_peered":"2024-09-20T20:29:55.012708+0000","last_unstale":"2024-09-20T20:29:57.592502+0000","last_undegraded":"2024-09-20T20:29:57.592502+0000","last_fullsized":"2024-09-20T20:29:57.592502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:24.045731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590012+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:29:57.590012+0000","last_peered":"2024-09-20T20:29:57.590012+0000","last_clean":"2024-09-20T20:29:57.590012+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:29:57.590012+0000","last_undegraded":"2024-09-20T20:29:57.590012+0000","last_fullsized":"2024-09-20T20:29:57.590012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591951+0000","last_change":"2024-09-20T20:29:55.002784+0000","last_active":"2024-09-20T20:29:57.591951+0000","last_peered":"2024-09-20T20:29:57.591951+0000","last_clean":"2024-09-20T20:29:57.591951+0000","last_became_active":"2024-09-20T20:29:55.001575+0000","last_became_peered":"2024-09-20T20:29:55.001575+0000","last_unstale":"2024-09-20T20:29:57.591951+0000","last_undegraded":"2024-09-20T20:29:57.591951+0000","last_fullsized":"2024-09-20T20:29:57.591951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:45.086905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594645+0000","last_change":"2024-09-20T20:29:55.014653+0000","last_active":"2024-09-20T20:29:57.594645+0000","last_peered":"2024-09-20T20:29:57.594645+0000","last_clean":"2024-09-20T20:29:57.594645+0000","last_became_active":"2024-09-20T20:29:55.013806+0000","last_became_peered":"2024-09-20T20:29:55.013806+0000","last_unstale":"2024-09-20T20:29:57.594645+0000","last_undegraded":"2024-09-20T20:29:57.594645+0000","last_fullsized":"2024-09-20T20:29:57.594645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592032+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:29:57.592032+0000","last_peered":"2024-09-20T20:29:57.592032+0000","last_clean":"2024-09-20T20:29:57.592032+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:29:57.592032+0000","last_undegraded":"2024-09-20T20:29:57.592032+0000","last_fullsized":"2024-09-20T20:29:57.592032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594255+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:29:57.594255+0000","last_peered":"2024-09-20T20:29:57.594255+0000","last_clean":"2024-09-20T20:29:57.594255+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:29:57.594255+0000","last_undegraded":"2024-09-20T20:29:57.594255+0000","last_fullsized":"2024-09-20T20:29:57.594255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594065+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:29:57.594065+0000","last_peered":"2024-09-20T20:29:57.594065+0000","last_clean":"2024-09-20T20:29:57.594065+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:29:57.594065+0000","last_undegraded":"2024-09-20T20:29:57.594065+0000","last_fullsized":"2024-09-20T20:29:57.594065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591517+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:29:57.591517+0000","last_peered":"2024-09-20T20:29:57.591517+0000","last_clean":"2024-09-20T20:29:57.591517+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:29:57.591517+0000","last_undegraded":"2024-09-20T20:29:57.591517+0000","last_fullsized":"2024-09-20T20:29:57.591517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592863+0000","last_change":"2024-09-20T20:29:55.014505+0000","last_active":"2024-09-20T20:29:57.592863+0000","last_peered":"2024-09-20T20:29:57.592863+0000","last_clean":"2024-09-20T20:29:57.592863+0000","last_became_active":"2024-09-20T20:29:55.012721+0000","last_became_peered":"2024-09-20T20:29:55.012721+0000","last_unstale":"2024-09-20T20:29:57.592863+0000","last_undegraded":"2024-09-20T20:29:57.592863+0000","last_fullsized":"2024-09-20T20:29:57.592863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590169+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:29:57.590169+0000","last_peered":"2024-09-20T20:29:57.590169+0000","last_clean":"2024-09-20T20:29:57.590169+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:29:57.590169+0000","last_undegraded":"2024-09-20T20:29:57.590169+0000","last_fullsized":"2024-09-20T20:29:57.590169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591691+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:29:57.591691+0000","last_peered":"2024-09-20T20:29:57.591691+0000","last_clean":"2024-09-20T20:29:57.591691+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:29:57.591691+0000","last_undegraded":"2024-09-20T20:29:57.591691+0000","last_fullsized":"2024-09-20T20:29:57.591691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594004+0000","last_change":"2024-09-20T20:29:55.001960+0000","last_active":"2024-09-20T20:29:57.594004+0000","last_peered":"2024-09-20T20:29:57.594004+0000","last_clean":"2024-09-20T20:29:57.594004+0000","last_became_active":"2024-09-20T20:29:55.001033+0000","last_became_peered":"2024-09-20T20:29:55.001033+0000","last_unstale":"2024-09-20T20:29:57.594004+0000","last_undegraded":"2024-09-20T20:29:57.594004+0000","last_fullsized":"2024-09-20T20:29:57.594004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593125+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:29:57.593125+0000","last_peered":"2024-09-20T20:29:57.593125+0000","last_clean":"2024-09-20T20:29:57.593125+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:29:57.593125+0000","last_undegraded":"2024-09-20T20:29:57.593125+0000","last_fullsized":"2024-09-20T20:29:57.593125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593494+0000","last_change":"2024-09-20T20:29:55.006411+0000","last_active":"2024-09-20T20:29:57.593494+0000","last_peered":"2024-09-20T20:29:57.593494+0000","last_clean":"2024-09-20T20:29:57.593494+0000","last_became_active":"2024-09-20T20:29:55.004960+0000","last_became_peered":"2024-09-20T20:29:55.004960+0000","last_unstale":"2024-09-20T20:29:57.593494+0000","last_undegraded":"2024-09-20T20:29:57.593494+0000","last_fullsized":"2024-09-20T20:29:57.593494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590823+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:29:57.590823+0000","last_peered":"2024-09-20T20:29:57.590823+0000","last_clean":"2024-09-20T20:29:57.590823+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:29:57.590823+0000","last_undegraded":"2024-09-20T20:29:57.590823+0000","last_fullsized":"2024-09-20T20:29:57.590823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592575+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:29:57.592575+0000","last_peered":"2024-09-20T20:29:57.592575+0000","last_clean":"2024-09-20T20:29:57.592575+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:29:57.592575+0000","last_undegraded":"2024-09-20T20:29:57.592575+0000","last_fullsized":"2024-09-20T20:29:57.592575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592468+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:29:57.592468+0000","last_peered":"2024-09-20T20:29:57.592468+0000","last_clean":"2024-09-20T20:29:57.592468+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:29:57.592468+0000","last_undegraded":"2024-09-20T20:29:57.592468+0000","last_fullsized":"2024-09-20T20:29:57.592468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592413+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:29:57.592413+0000","last_peered":"2024-09-20T20:29:57.592413+0000","last_clean":"2024-09-20T20:29:57.592413+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:29:57.592413+0000","last_undegraded":"2024-09-20T20:29:57.592413+0000","last_fullsized":"2024-09-20T20:29:57.592413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591791+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:29:57.591791+0000","last_peered":"2024-09-20T20:29:57.591791+0000","last_clean":"2024-09-20T20:29:57.591791+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:29:57.591791+0000","last_undegraded":"2024-09-20T20:29:57.591791+0000","last_fullsized":"2024-09-20T20:29:57.591791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594458+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:29:57.594458+0000","last_peered":"2024-09-20T20:29:57.594458+0000","last_clean":"2024-09-20T20:29:57.594458+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:29:57.594458+0000","last_undegraded":"2024-09-20T20:29:57.594458+0000","last_fullsized":"2024-09-20T20:29:57.594458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592083+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:29:57.592083+0000","last_peered":"2024-09-20T20:29:57.592083+0000","last_clean":"2024-09-20T20:29:57.592083+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:29:57.592083+0000","last_undegraded":"2024-09-20T20:29:57.592083+0000","last_fullsized":"2024-09-20T20:29:57.592083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594387+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:29:57.594387+0000","last_peered":"2024-09-20T20:29:57.594387+0000","last_clean":"2024-09-20T20:29:57.594387+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:29:57.594387+0000","last_undegraded":"2024-09-20T20:29:57.594387+0000","last_fullsized":"2024-09-20T20:29:57.594387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592138+0000","last_change":"2024-09-20T20:29:55.006455+0000","last_active":"2024-09-20T20:29:57.592138+0000","last_peered":"2024-09-20T20:29:57.592138+0000","last_clean":"2024-09-20T20:29:57.592138+0000","last_became_active":"2024-09-20T20:29:55.004010+0000","last_became_peered":"2024-09-20T20:29:55.004010+0000","last_unstale":"2024-09-20T20:29:57.592138+0000","last_undegraded":"2024-09-20T20:29:57.592138+0000","last_fullsized":"2024-09-20T20:29:57.592138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:20.842224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594769+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:29:57.594769+0000","last_peered":"2024-09-20T20:29:57.594769+0000","last_clean":"2024-09-20T20:29:57.594769+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:29:57.594769+0000","last_undegraded":"2024-09-20T20:29:57.594769+0000","last_fullsized":"2024-09-20T20:29:57.594769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592379+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:29:57.592379+0000","last_peered":"2024-09-20T20:29:57.592379+0000","last_clean":"2024-09-20T20:29:57.592379+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:29:57.592379+0000","last_undegraded":"2024-09-20T20:29:57.592379+0000","last_fullsized":"2024-09-20T20:29:57.592379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594413+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:29:57.594413+0000","last_peered":"2024-09-20T20:29:57.594413+0000","last_clean":"2024-09-20T20:29:57.594413+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:29:57.594413+0000","last_undegraded":"2024-09-20T20:29:57.594413+0000","last_fullsized":"2024-09-20T20:29:57.594413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591064+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:29:57.591064+0000","last_peered":"2024-09-20T20:29:57.591064+0000","last_clean":"2024-09-20T20:29:57.591064+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:29:57.591064+0000","last_undegraded":"2024-09-20T20:29:57.591064+0000","last_fullsized":"2024-09-20T20:29:57.591064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591558+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:29:57.591558+0000","last_peered":"2024-09-20T20:29:57.591558+0000","last_clean":"2024-09-20T20:29:57.591558+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:29:57.591558+0000","last_undegraded":"2024-09-20T20:29:57.591558+0000","last_fullsized":"2024-09-20T20:29:57.591558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594239+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:29:57.594239+0000","last_peered":"2024-09-20T20:29:57.594239+0000","last_clean":"2024-09-20T20:29:57.594239+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:29:57.594239+0000","last_undegraded":"2024-09-20T20:29:57.594239+0000","last_fullsized":"2024-09-20T20:29:57.594239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592628+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:29:57.592628+0000","last_peered":"2024-09-20T20:29:57.592628+0000","last_clean":"2024-09-20T20:29:57.592628+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:29:57.592628+0000","last_undegraded":"2024-09-20T20:29:57.592628+0000","last_fullsized":"2024-09-20T20:29:57.592628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594505+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:29:57.594505+0000","last_peered":"2024-09-20T20:29:57.594505+0000","last_clean":"2024-09-20T20:29:57.594505+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:29:57.594505+0000","last_undegraded":"2024-09-20T20:29:57.594505+0000","last_fullsized":"2024-09-20T20:29:57.594505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592805+0000","last_change":"2024-09-20T20:29:54.001861+0000","last_active":"2024-09-20T20:29:57.592805+0000","last_peered":"2024-09-20T20:29:57.592805+0000","last_clean":"2024-09-20T20:29:57.592805+0000","last_became_active":"2024-09-20T20:29:54.000965+0000","last_became_peered":"2024-09-20T20:29:54.000965+0000","last_unstale":"2024-09-20T20:29:57.592805+0000","last_undegraded":"2024-09-20T20:29:57.592805+0000","last_fullsized":"2024-09-20T20:29:57.592805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:28.103332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593778+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:29:57.593778+0000","last_peered":"2024-09-20T20:29:57.593778+0000","last_clean":"2024-09-20T20:29:57.593778+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:29:57.593778+0000","last_undegraded":"2024-09-20T20:29:57.593778+0000","last_fullsized":"2024-09-20T20:29:57.593778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592180+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:29:57.592180+0000","last_peered":"2024-09-20T20:29:57.592180+0000","last_clean":"2024-09-20T20:29:57.592180+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:29:57.592180+0000","last_undegraded":"2024-09-20T20:29:57.592180+0000","last_fullsized":"2024-09-20T20:29:57.592180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592009+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:29:57.592009+0000","last_peered":"2024-09-20T20:29:57.592009+0000","last_clean":"2024-09-20T20:29:57.592009+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:29:57.592009+0000","last_undegraded":"2024-09-20T20:29:57.592009+0000","last_fullsized":"2024-09-20T20:29:57.592009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592119+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:29:57.592119+0000","last_peered":"2024-09-20T20:29:57.592119+0000","last_clean":"2024-09-20T20:29:57.592119+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:29:57.592119+0000","last_undegraded":"2024-09-20T20:29:57.592119+0000","last_fullsized":"2024-09-20T20:29:57.592119+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593368+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:29:57.593368+0000","last_peered":"2024-09-20T20:29:57.593368+0000","last_clean":"2024-09-20T20:29:57.593368+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:29:57.593368+0000","last_undegraded":"2024-09-20T20:29:57.593368+0000","last_fullsized":"2024-09-20T20:29:57.593368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591134+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:29:57.591134+0000","last_peered":"2024-09-20T20:29:57.591134+0000","last_clean":"2024-09-20T20:29:57.591134+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:29:57.591134+0000","last_undegraded":"2024-09-20T20:29:57.591134+0000","last_fullsized":"2024-09-20T20:29:57.591134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594567+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:29:57.594567+0000","last_peered":"2024-09-20T20:29:57.594567+0000","last_clean":"2024-09-20T20:29:57.594567+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:29:57.594567+0000","last_undegraded":"2024-09-20T20:29:57.594567+0000","last_fullsized":"2024-09-20T20:29:57.594567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592052+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:29:57.592052+0000","last_peered":"2024-09-20T20:29:57.592052+0000","last_clean":"2024-09-20T20:29:57.592052+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:29:57.592052+0000","last_undegraded":"2024-09-20T20:29:57.592052+0000","last_fullsized":"2024-09-20T20:29:57.592052+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590779+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:29:57.590779+0000","last_peered":"2024-09-20T20:29:57.590779+0000","last_clean":"2024-09-20T20:29:57.590779+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:29:57.590779+0000","last_undegraded":"2024-09-20T20:29:57.590779+0000","last_fullsized":"2024-09-20T20:29:57.590779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594373+0000","last_change":"2024-09-20T20:29:55.007379+0000","last_active":"2024-09-20T20:29:57.594373+0000","last_peered":"2024-09-20T20:29:57.594373+0000","last_clean":"2024-09-20T20:29:57.594373+0000","last_became_active":"2024-09-20T20:29:55.005006+0000","last_became_peered":"2024-09-20T20:29:55.005006+0000","last_unstale":"2024-09-20T20:29:57.594373+0000","last_undegraded":"2024-09-20T20:29:57.594373+0000","last_fullsized":"2024-09-20T20:29:57.594373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591245+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:29:57.591245+0000","last_peered":"2024-09-20T20:29:57.591245+0000","last_clean":"2024-09-20T20:29:57.591245+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:29:57.591245+0000","last_undegraded":"2024-09-20T20:29:57.591245+0000","last_fullsized":"2024-09-20T20:29:57.591245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:54.000434+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:53.999658+0000","last_became_peered":"2024-09-20T20:29:53.999658+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:31.923210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592275+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:29:57.592275+0000","last_peered":"2024-09-20T20:29:57.592275+0000","last_clean":"2024-09-20T20:29:57.592275+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:29:57.592275+0000","last_undegraded":"2024-09-20T20:29:57.592275+0000","last_fullsized":"2024-09-20T20:29:57.592275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592825+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:29:57.592825+0000","last_peered":"2024-09-20T20:29:57.592825+0000","last_clean":"2024-09-20T20:29:57.592825+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:29:57.592825+0000","last_undegraded":"2024-09-20T20:29:57.592825+0000","last_fullsized":"2024-09-20T20:29:57.592825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593206+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:29:57.593206+0000","last_peered":"2024-09-20T20:29:57.593206+0000","last_clean":"2024-09-20T20:29:57.593206+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:29:57.593206+0000","last_undegraded":"2024-09-20T20:29:57.593206+0000","last_fullsized":"2024-09-20T20:29:57.593206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591843+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:29:57.591843+0000","last_peered":"2024-09-20T20:29:57.591843+0000","last_clean":"2024-09-20T20:29:57.591843+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:29:57.591843+0000","last_undegraded":"2024-09-20T20:29:57.591843+0000","last_fullsized":"2024-09-20T20:29:57.591843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594707+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:29:57.594707+0000","last_peered":"2024-09-20T20:29:57.594707+0000","last_clean":"2024-09-20T20:29:57.594707+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:29:57.594707+0000","last_undegraded":"2024-09-20T20:29:57.594707+0000","last_fullsized":"2024-09-20T20:29:57.594707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592335+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:29:57.592335+0000","last_peered":"2024-09-20T20:29:57.592335+0000","last_clean":"2024-09-20T20:29:57.592335+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:29:57.592335+0000","last_undegraded":"2024-09-20T20:29:57.592335+0000","last_fullsized":"2024-09-20T20:29:57.592335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593023+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:29:57.593023+0000","last_peered":"2024-09-20T20:29:57.593023+0000","last_clean":"2024-09-20T20:29:57.593023+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:29:57.593023+0000","last_undegraded":"2024-09-20T20:29:57.593023+0000","last_fullsized":"2024-09-20T20:29:57.593023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592094+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:29:57.592094+0000","last_peered":"2024-09-20T20:29:57.592094+0000","last_clean":"2024-09-20T20:29:57.592094+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:29:57.592094+0000","last_undegraded":"2024-09-20T20:29:57.592094+0000","last_fullsized":"2024-09-20T20:29:57.592094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594126+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:29:57.594126+0000","last_peered":"2024-09-20T20:29:57.594126+0000","last_clean":"2024-09-20T20:29:57.594126+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:29:57.594126+0000","last_undegraded":"2024-09-20T20:29:57.594126+0000","last_fullsized":"2024-09-20T20:29:57.594126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593059+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:29:57.593059+0000","last_peered":"2024-09-20T20:29:57.593059+0000","last_clean":"2024-09-20T20:29:57.593059+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:29:57.593059+0000","last_undegraded":"2024-09-20T20:29:57.593059+0000","last_fullsized":"2024-09-20T20:29:57.593059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593061+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:29:57.593061+0000","last_peered":"2024-09-20T20:29:57.593061+0000","last_clean":"2024-09-20T20:29:57.593061+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:29:57.593061+0000","last_undegraded":"2024-09-20T20:29:57.593061+0000","last_fullsized":"2024-09-20T20:29:57.593061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592854+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:29:57.592854+0000","last_peered":"2024-09-20T20:29:57.592854+0000","last_clean":"2024-09-20T20:29:57.592854+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:29:57.592854+0000","last_undegraded":"2024-09-20T20:29:57.592854+0000","last_fullsized":"2024-09-20T20:29:57.592854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590342+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:29:57.590342+0000","last_peered":"2024-09-20T20:29:57.590342+0000","last_clean":"2024-09-20T20:29:57.590342+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:29:57.590342+0000","last_undegraded":"2024-09-20T20:29:57.590342+0000","last_fullsized":"2024-09-20T20:29:57.590342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592849+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:29:57.592849+0000","last_peered":"2024-09-20T20:29:57.592849+0000","last_clean":"2024-09-20T20:29:57.592849+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:29:57.592849+0000","last_undegraded":"2024-09-20T20:29:57.592849+0000","last_fullsized":"2024-09-20T20:29:57.592849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594408+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:29:57.594408+0000","last_peered":"2024-09-20T20:29:57.594408+0000","last_clean":"2024-09-20T20:29:57.594408+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:29:57.594408+0000","last_undegraded":"2024-09-20T20:29:57.594408+0000","last_fullsized":"2024-09-20T20:29:57.594408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592661+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:29:57.592661+0000","last_peered":"2024-09-20T20:29:57.592661+0000","last_clean":"2024-09-20T20:29:57.592661+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:29:57.592661+0000","last_undegraded":"2024-09-20T20:29:57.592661+0000","last_fullsized":"2024-09-20T20:29:57.592661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592767+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:29:57.592767+0000","last_peered":"2024-09-20T20:29:57.592767+0000","last_clean":"2024-09-20T20:29:57.592767+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:29:57.592767+0000","last_undegraded":"2024-09-20T20:29:57.592767+0000","last_fullsized":"2024-09-20T20:29:57.592767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594136+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:29:57.594136+0000","last_peered":"2024-09-20T20:29:57.594136+0000","last_clean":"2024-09-20T20:29:57.594136+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:29:57.594136+0000","last_undegraded":"2024-09-20T20:29:57.594136+0000","last_fullsized":"2024-09-20T20:29:57.594136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590881+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:29:57.590881+0000","last_peered":"2024-09-20T20:29:57.590881+0000","last_clean":"2024-09-20T20:29:57.590881+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:29:57.590881+0000","last_undegraded":"2024-09-20T20:29:57.590881+0000","last_fullsized":"2024-09-20T20:29:57.590881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594037+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:29:57.594037+0000","last_peered":"2024-09-20T20:29:57.594037+0000","last_clean":"2024-09-20T20:29:57.594037+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:29:57.594037+0000","last_undegraded":"2024-09-20T20:29:57.594037+0000","last_fullsized":"2024-09-20T20:29:57.594037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594030+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:29:57.594030+0000","last_peered":"2024-09-20T20:29:57.594030+0000","last_clean":"2024-09-20T20:29:57.594030+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:29:57.594030+0000","last_undegraded":"2024-09-20T20:29:57.594030+0000","last_fullsized":"2024-09-20T20:29:57.594030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590305+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:29:57.590305+0000","last_peered":"2024-09-20T20:29:57.590305+0000","last_clean":"2024-09-20T20:29:57.590305+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:29:57.590305+0000","last_undegraded":"2024-09-20T20:29:57.590305+0000","last_fullsized":"2024-09-20T20:29:57.590305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592804+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:29:57.592804+0000","last_peered":"2024-09-20T20:29:57.592804+0000","last_clean":"2024-09-20T20:29:57.592804+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:29:57.592804+0000","last_undegraded":"2024-09-20T20:29:57.592804+0000","last_fullsized":"2024-09-20T20:29:57.592804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590221+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:29:57.590221+0000","last_peered":"2024-09-20T20:29:57.590221+0000","last_clean":"2024-09-20T20:29:57.590221+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:29:57.590221+0000","last_undegraded":"2024-09-20T20:29:57.590221+0000","last_fullsized":"2024-09-20T20:29:57.590221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.594834+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:29:57.594834+0000","last_peered":"2024-09-20T20:29:57.594834+0000","last_clean":"2024-09-20T20:29:57.594834+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:29:57.594834+0000","last_undegraded":"2024-09-20T20:29:57.594834+0000","last_fullsized":"2024-09-20T20:29:57.594834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590499+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:29:57.590499+0000","last_peered":"2024-09-20T20:29:57.590499+0000","last_clean":"2024-09-20T20:29:57.590499+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:29:57.590499+0000","last_undegraded":"2024-09-20T20:29:57.590499+0000","last_fullsized":"2024-09-20T20:29:57.590499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592213+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:29:57.592213+0000","last_peered":"2024-09-20T20:29:57.592213+0000","last_clean":"2024-09-20T20:29:57.592213+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:29:57.592213+0000","last_undegraded":"2024-09-20T20:29:57.592213+0000","last_fullsized":"2024-09-20T20:29:57.592213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.590675+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:29:57.590675+0000","last_peered":"2024-09-20T20:29:57.590675+0000","last_clean":"2024-09-20T20:29:57.590675+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:29:57.590675+0000","last_undegraded":"2024-09-20T20:29:57.590675+0000","last_fullsized":"2024-09-20T20:29:57.590675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593420+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:29:57.593420+0000","last_peered":"2024-09-20T20:29:57.593420+0000","last_clean":"2024-09-20T20:29:57.593420+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:29:57.593420+0000","last_undegraded":"2024-09-20T20:29:57.593420+0000","last_fullsized":"2024-09-20T20:29:57.593420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593148+0000","last_change":"2024-09-20T20:29:53.995769+0000","last_active":"2024-09-20T20:29:57.593148+0000","last_peered":"2024-09-20T20:29:57.593148+0000","last_clean":"2024-09-20T20:29:57.593148+0000","last_became_active":"2024-09-20T20:29:53.994788+0000","last_became_peered":"2024-09-20T20:29:53.994788+0000","last_unstale":"2024-09-20T20:29:57.593148+0000","last_undegraded":"2024-09-20T20:29:57.593148+0000","last_fullsized":"2024-09-20T20:29:57.593148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:58.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593654+0000","last_change":"2024-09-20T20:29:55.004166+0000","last_active":"2024-09-20T20:29:57.593654+0000","last_peered":"2024-09-20T20:29:57.593654+0000","last_clean":"2024-09-20T20:29:57.593654+0000","last_became_active":"2024-09-20T20:29:55.002511+0000","last_became_peered":"2024-09-20T20:29:55.002511+0000","last_unstale":"2024-09-20T20:29:57.593654+0000","last_undegraded":"2024-09-20T20:29:57.593654+0000","last_fullsized":"2024-09-20T20:29:57.593654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593507+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:29:57.593507+0000","last_peered":"2024-09-20T20:29:57.593507+0000","last_clean":"2024-09-20T20:29:57.593507+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:29:57.593507+0000","last_undegraded":"2024-09-20T20:29:57.593507+0000","last_fullsized":"2024-09-20T20:29:57.593507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592500+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:29:57.592500+0000","last_peered":"2024-09-20T20:29:57.592500+0000","last_clean":"2024-09-20T20:29:57.592500+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:29:57.592500+0000","last_undegraded":"2024-09-20T20:29:57.592500+0000","last_fullsized":"2024-09-20T20:29:57.592500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593828+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:29:57.593828+0000","last_peered":"2024-09-20T20:29:57.593828+0000","last_clean":"2024-09-20T20:29:57.593828+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:29:57.593828+0000","last_undegraded":"2024-09-20T20:29:57.593828+0000","last_fullsized":"2024-09-20T20:29:57.593828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592557+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:29:57.592557+0000","last_peered":"2024-09-20T20:29:57.592557+0000","last_clean":"2024-09-20T20:29:57.592557+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:29:57.592557+0000","last_undegraded":"2024-09-20T20:29:57.592557+0000","last_fullsized":"2024-09-20T20:29:57.592557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593691+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:29:57.593691+0000","last_peered":"2024-09-20T20:29:57.593691+0000","last_clean":"2024-09-20T20:29:57.593691+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:29:57.593691+0000","last_undegraded":"2024-09-20T20:29:57.593691+0000","last_fullsized":"2024-09-20T20:29:57.593691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.593091+0000","last_change":"2024-09-20T20:29:55.001408+0000","last_active":"2024-09-20T20:29:57.593091+0000","last_peered":"2024-09-20T20:29:57.593091+0000","last_clean":"2024-09-20T20:29:57.593091+0000","last_became_active":"2024-09-20T20:29:55.000076+0000","last_became_peered":"2024-09-20T20:29:55.000076+0000","last_unstale":"2024-09-20T20:29:57.593091+0000","last_undegraded":"2024-09-20T20:29:57.593091+0000","last_fullsized":"2024-09-20T20:29:57.593091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592547+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:29:57.592547+0000","last_peered":"2024-09-20T20:29:57.592547+0000","last_clean":"2024-09-20T20:29:57.592547+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:29:57.592547+0000","last_undegraded":"2024-09-20T20:29:57.592547+0000","last_fullsized":"2024-09-20T20:29:57.592547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.591986+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:29:57.591986+0000","last_peered":"2024-09-20T20:29:57.591986+0000","last_clean":"2024-09-20T20:29:57.591986+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:29:57.591986+0000","last_undegraded":"2024-09-20T20:29:57.591986+0000","last_fullsized":"2024-09-20T20:29:57.591986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-20T20:29:57.592554+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:29:57.592554+0000","last_peered":"2024-09-20T20:29:57.592554+0000","last_clean":"2024-09-20T20:29:57.592554+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:29:57.592554+0000","last_undegraded":"2024-09-20T20:29:57.592554+0000","last_fullsized":"2024-09-20T20:29:57.592554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":258048,"data_stored":655436,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":270336,"data_stored":656071,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:30:19.078 INFO:tasks.thrashosds.thrasher:Setting 4.a to [2, 0, 1] 2024-09-20T20:30:19.079 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.a', '2', '0', '1'] 2024-09-20T20:30:19.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.a 2 0 1 2024-09-20T20:30:19.127 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.125+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:19.230 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.229+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:19.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:19.331 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.329+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:19.379 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:19.379 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:19.395 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-20T20:30:19.418 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T20:30:19.418 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-20T20:30:19.440 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.441+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:19.526 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:19.526 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:19.533 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.533+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:19.541 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:19.634 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.633+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:19.709 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:19.709 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:19.723 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:30:19.764 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.765+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:19.836 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.833+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:19.881 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:19.881 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:19.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:19.894 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:19.937 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:19.937+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:20.024 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:20.024 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:20.038 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:20.037+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:20.040 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:20.050 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:20.050 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:20.070 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:20.070 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:20.090 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:20.090 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:20.138 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:20.137+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:20.163 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:20.163 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:20.178 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:20.239 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:20.237+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:20.340 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:20.337+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:20.346 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:20.346 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.529572374000001, 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353971632, 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.351 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.356 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353883773, 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:20.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:20.361 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353842443000001, 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:20.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353773297, 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:20.367 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:20.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:20.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353723014, 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:20.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:20.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:20.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353687908000001, 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.378 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:20.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353636241, 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:20.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353559271999998, 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:20.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.353506906, 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:20.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:20.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.340936882000001, 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.396 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:20.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:20.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:20.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.340845562999998, 2024-09-20T20:30:20.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:20.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.340757784000001, 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:20.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.339897793999999, 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.409 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:20.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:20.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:20.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.335312316, 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:20.413 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:20.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:20.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.335243169999998, 2024-09-20T20:30:20.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.331926656, 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018859790000000001, 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:20.421 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012540+0000", 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8299999999999995e-07 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012547+0000", 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1729999999999998e-06 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012568+0000", 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0820000000000001e-05 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012798+0000", 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000230072 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013602+0000", 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080420999999999997 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014425+0000", 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000822721 2024-09-20T20:30:20.424 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.330735956000002, 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:20.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.428 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 23.364416636000001, 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:20.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:20.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.362075903, 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.434 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:20.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:20.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:20.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:20.439 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:20.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:20.441 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:20.441+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:20.542 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:20.541+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:20.570 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:20.570 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:20.570 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:20.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:20.643 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:20.641+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:20.707 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:20.707 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:20.707 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:20.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:20.769 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:20.768+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:20.845 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:20.845 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.306172046999997, 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:20.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:20.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.851 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.857854289999999, 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:20.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:20.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.857 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.857477335999999, 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:20.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:20.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.857373293999999, 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:20.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.868 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.856272055000002, 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:20.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:20.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.856181399, 2024-09-20T20:30:20.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:20.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.879 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.856108927000001, 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:20.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.85604678, 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:20.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:20.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.855984030999998, 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:20.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:20.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.855875487999999, 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:20.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:20.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:20.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.855810202000001, 2024-09-20T20:30:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:20.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:20.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.906 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.855748302999999, 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:20.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:20.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:20.912 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.853560533, 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:20.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.853462530000002, 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:20.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.852401201999999, 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:20.923 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:20.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:20.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.851958732, 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:20.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:20.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.851081788999998, 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:20.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:20.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:20.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.850992340000001, 2024-09-20T20:30:20.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:20.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:20.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.850926077, 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:20.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:20.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:20.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.849412775000001, 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:20.950 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:20.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:20.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:20.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:20.954 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:20.954 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:20.844+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:20.955 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:20.997 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:20.996+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:21.057 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:21.053+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:21.085 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:21.085 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:21.086 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:21.086 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:21.099 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:21.158 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:21.157+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:21.217 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:21.217 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:21.217 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:21.217 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:21.217 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:21.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:21.259 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:21.257+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:21.359 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:21.357+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:21.391 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.391 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.337694124999999, 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:21.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.337048756999998, 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.396 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:21.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.844738853999999, 2024-09-20T20:30:21.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:21.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:21.405 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.402431972999999, 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.406 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:21.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.402317354000001, 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:21.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.417 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.402218071, 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:21.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:21.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.402156599000001, 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.423 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:21.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.428 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.400005011000001, 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:21.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:21.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:21.434 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.397361266000001, 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:21.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:21.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.439 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.392767517999999, 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:21.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:21.445 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.392646934999998, 2024-09-20T20:30:21.446 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:21.446 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.446 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.446 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:21.446 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.446 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.446 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:21.447 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.448 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:21.449 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.450 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.392574436, 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.451 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:21.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.454 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.389231315, 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.456 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:21.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:21.459 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.386897170000001, 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:21.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.384807855999998, 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.464 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:21.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.468 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.384449745000001, 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:21.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:21.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.473 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.384329965999999, 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.475 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.477 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.384029694999999, 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:21.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.482 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.381518194000002, 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:21.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:21.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:21.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:21.487 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 26.377068788999999, 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:21.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:21.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:21.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:21.492 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.492 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.492 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.492 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:21.492 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:21.492 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:21.494 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:21.494 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:21.493+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:21.595 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:21.592+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:21.625 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:21.625 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:21.625 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:21.625 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:21.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:21.698 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:21.696+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:21.761 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:21.761 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:21.761 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:21.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:30:21.776 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:21.799 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:21.797+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:21.902 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:21.901+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:21.902 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 32.083497862999998, 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907897121000001, 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907809262000001, 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907767931999999, 2024-09-20T20:30:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907698786000001, 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907648503000001, 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.930 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.935 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907613396999999, 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:21.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:21.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907561730000001, 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.944 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907484760999999, 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.948 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.907432395000001, 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:21.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.894862370999999, 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:21.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.894771051999999, 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.957 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:21.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:21.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:21.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.894683272999998, 2024-09-20T20:30:21.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:21.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:21.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.893823283, 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:21.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:21.969 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.889237805, 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:21.973 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.889168658999999, 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-09-20T20:30:21.977 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.885852145000001, 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018859790000000001, 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012539+0000", 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012540+0000", 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8299999999999995e-07 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012547+0000", 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1729999999999998e-06 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012568+0000", 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0820000000000001e-05 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012798+0000", 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000230072 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013602+0000", 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080420999999999997 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014425+0000", 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000822721 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.884661444999999, 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.981 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.984 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 24.918342124999999, 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:21.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.9160013920000001, 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:21.990 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:21.995 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:21.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:22.045 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:22.044+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:22.102 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:22.100+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:22.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:22.127 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:22.127 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:22.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:22.203 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:22.201+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:22.255 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:22.255 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:22.275 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:22.296 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:22.304 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:22.301+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:22.310 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:22.310 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:22.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:22.405 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:22.401+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:22.444 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:22.444 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:22.458 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:22.506 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:22.504+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:22.585 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:22.585 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:22.598 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:22.607 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:22.604+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:22.707 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:22.707 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:22.707 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:22.705+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:22.719 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:22.750 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:30:22.808 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:22.805+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:22.827 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:22.827 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:22.839 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:22.908 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:22.909+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:22.971 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:23.049 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:23.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:23.051 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:23.048+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:23.151 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:23.148+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:23.175 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:23.175 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:23.191 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:23.252 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:23.253+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:23.313 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:23.313 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:23.327 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:23.353 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:23.353+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:23.454 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:23.453+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:23.458 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:23.458 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:23.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:23.555 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:23.552+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:23.590 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:23.590 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:23.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:23.689 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:23.688+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:23.757 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:23.756+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:23.769 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:23.769 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:23.783 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:23.858 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:23.857+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:23.916 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:23.916 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:23.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:23.960 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:23.957+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:24.052 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:24.052 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:24.061 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:24.057+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:24.066 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:24.162 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:24.160+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:24.182 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:24.182 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:24.196 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:24.262 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:24.261+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:24.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:24.328 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:24.328 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:24.342 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:24.366 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:24.360+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:24.419 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:24.419 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:24.419 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-20T20:30:24.419 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:30:24.420 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:30:24.420 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-20T20:30:24.465 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:24.464+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:24.474 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:24.474 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:24.495 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:24.495 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:24.513 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:24.514 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:24.514 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:24.514 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:24.514 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:24.514 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:24.514 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:24.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:24.550 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:24.550 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "" 2024-09-20T20:30:24.550 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:24.565 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:24.564+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:24.651 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:24.651 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:24.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:24.651 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:24.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.651 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:24.651 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:24.651 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.834271731999998, 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:24.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658670990000001, 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:24.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:24.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:24.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:24.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:24.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658583131, 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:24.662 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.667 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658541800999998, 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:24.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658472655000001, 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.678 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658422372, 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:24.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:24.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658387265999998, 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.684 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658335599000001, 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658258629999999, 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.658206264, 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.645636240000002, 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.645544920999999, 2024-09-20T20:30:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.645457142000001, 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.644597151999999, 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.640011674, 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.639942527999999, 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.635435313999999, 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.669115993999998, 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6667752609999997, 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.6662726609999998, 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:24.748 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:24.749 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:24.745+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:24.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:24.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:30:24.850 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:24.848+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:24.884 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:24.884 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:24.884 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:24.884 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:24.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:24.985 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:24.984+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:25.052 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:25.049+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:25.062 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:25.062 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:25.062 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:25.062 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:25.062 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:25.078 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:25.165 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:25.164+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:25.240 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.699568763999999, 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.251251007, 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.250874053, 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.250770011, 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.249668772, 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.249578115999999, 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.249505643999999, 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.249443497000001, 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.249380748, 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.249272205, 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.249206918999999, 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.24914502, 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.246957250000001, 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.309 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:25.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.314 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.246859247, 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:25.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:25.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.245797919000001, 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:25.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:25.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.245355449000002, 2024-09-20T20:30:25.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:25.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:25.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.244478506, 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:25.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:25.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:25.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.244389056999999, 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.336 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.341 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.244322793999999, 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.346 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.242809491999999, 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:25.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:25.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:25.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:25.351 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:25.351 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:25.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:25.352 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:25.297+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:25.398 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:25.397+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:25.483 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:25.483 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:25.483 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:25.483 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:25.497 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:25.499 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:25.497+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:25.600 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:25.597+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:25.619 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:25.619 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:25.619 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:25.620 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:25.620 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:25.633 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:25.720 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:25.721+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:25.771 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:30:25.801 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:25.797+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:25.805 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 40.751285742999997, 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.806 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.807 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:25.808 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:25.809 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.810 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 40.750640375000003, 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.811 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.812 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:25.814 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 40.258330471999997, 2024-09-20T20:30:25.815 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:25.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.819 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:25.820 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.816023591, 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:25.821 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.822 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:25.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:25.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.815908971999999, 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.826 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:25.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.829 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.830 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.831 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.815809688999998, 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.832 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:25.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:25.835 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.836 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.815748216999999, 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.837 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:25.841 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.813596628999999, 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:25.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.846 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.847 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.810952883999999, 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.848 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.849 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:25.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.851 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.852 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.853 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.806359136000001, 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.854 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:25.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:25.857 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.858 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.859 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.806238553, 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.860 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.861 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:25.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.806166053999998, 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.864 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:25.865 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.866 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.867 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.802822933000002, 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:25.868 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.869 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.800488787999999, 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.872 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.873 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:25.876 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.798399474, 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:25.880 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.798041362999999, 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:25.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:25.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.797921584000001, 2024-09-20T20:30:25.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:25.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.889 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.797621313, 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:25.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:25.894 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.795109812, 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.898 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 30.790660407000001, 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:25.899 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:25.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:25.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:25.903 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:25.905 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:25.905 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:25.904+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:26.006 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:26.005+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:26.037 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:26.037 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:26.037 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:26.038 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:26.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:26.106 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:26.105+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:26.168 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:26.168 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:26.168 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:26.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:26.208 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:26.208+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:26.309 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:26.309+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:26.354 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.536192569999997, 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:26.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:26.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.360591828, 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:26.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:26.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.364 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.360503969, 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:26.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:26.369 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.360462639000001, 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:26.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.360393493, 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.375 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:26.380 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.36034321, 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:26.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:26.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:26.385 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.360308104000001, 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.360256437, 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.391 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:26.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.360179467999998, 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:26.395 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:26.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.360127102, 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.399 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:26.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.347557078000001, 2024-09-20T20:30:26.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:26.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.407 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.347465758999999, 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:26.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:26.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:26.412 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.347377980000001, 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.346517989999999, 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.417 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.341932512, 2024-09-20T20:30:26.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:26.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:26.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.341863365999998, 2024-09-20T20:30:26.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:26.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:26.428 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.337356152000002, 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:26.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:26.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.371036832000001, 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:26.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:26.437 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.3686960989999992, 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.3681934990000002, 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:26.443 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:26.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:26.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:26.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:26.448 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:26.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:26.450 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:26.449+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:26.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:26.551 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:26.549+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:26.581 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:26.582 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:26.582 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:26.582 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:26.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:26.652 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:26.649+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:26.687 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:26.687 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:26.708 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:26.708 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:26.715 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:26.715 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:26.728 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:26.729 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:26.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:26.753 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:26.749+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:26.853 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:26.853 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:26.853 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:26.852+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:26.867 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:26.954 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:26.952+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:26.997 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:26.997 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:27.013 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:27.056 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:27.057+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:27.135 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:27.135 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:27.148 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:27.156 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:27.153+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:27.257 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:27.256+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:27.317 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:27.317 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:27.331 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:27.375 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:27.373+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:27.459 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:27.456+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:27.461 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:27.461 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:27.475 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:27.560 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:27.560+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:27.634 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:27.634 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:27.648 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:27.660 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:27.660+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:27.762 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:27.760+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:27.765 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:27.766 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:27.779 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:27.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:30:27.863 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:27.860+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:27.912 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:27.912 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:27.926 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:27.969 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:27.968+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:28.065 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:28.064+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:28.087 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:28.087 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:28.101 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:28.166 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:28.165+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:28.222 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:28.222 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:28.237 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:28.266 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:28.265+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:28.368 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:28.364+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:28.372 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:28.373 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:28.387 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:28.473 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:28.472+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:28.550 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:28.550 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:28.565 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:28.609 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:28.608+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:28.671 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:28.668+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:28.729 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:28.729 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:28.743 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:28.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:28.768 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:30:28.791 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:28.789+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:28.872 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:28.869+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:28.872 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:28.872 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:28.887 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:28.903 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:28.903 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:28.925 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:28.946 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:28.946 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:28.973 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:28.972+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:29.051 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:29.051 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:29.051 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:29.051 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:29.051 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:29.065 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:29.074 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:29.072+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:29.175 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:29.172+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.366297965000001, 2024-09-20T20:30:29.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:29.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.189 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190697223000001, 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:29.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:29.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190609363999997, 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:29.195 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:29.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.200 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190568034000002, 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:29.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:29.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.206 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190498888, 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:29.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190448605, 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:29.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:29.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.217 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190413499000002, 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:29.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190361832000001, 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:29.223 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:29.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190284863000002, 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.227 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.190232496999997, 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.231 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:29.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.177662472999998, 2024-09-20T20:30:29.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:29.239 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.177571153999999, 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.177483375000001, 2024-09-20T20:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:29.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.248 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.176623384999999, 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:29.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:29.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:29.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.172037907000004, 2024-09-20T20:30:29.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:29.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:29.257 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.171968761000002, 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.167461547000002, 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:29.261 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:29.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:29.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 32.201142226999998, 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:29.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:29.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:29.270 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.198801494, 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:29.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:29.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.1982988939999997, 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.276 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:29.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:29.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:29.281 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:29.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:29.283 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:29.280+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:29.384 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:29.380+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:29.415 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:29.416 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:29.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:29.485 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:29.480+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:29.565 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:29.566 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:29.566 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-20T20:30:29.566 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:30:29.566 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:30:29.566 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-20T20:30:29.586 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:29.584+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:29.594 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:29.594 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:29.608 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:29.686 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:29.684+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:29.699 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:29.699 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-20T20:30:29.699 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:29.734 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:29.734 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:29.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:29.734 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 44.193118663999996, 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:29.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:29.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:29.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.744800906999998, 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.744423953000002, 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:29.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.751 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.744319910999998, 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:29.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.743218671999998, 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:29.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.743128016, 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:29.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.768 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.743055544000001, 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:29.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.775 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.742993396999999, 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.742930647999998, 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.742822105000002, 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:29.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:29.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.742756819, 2024-09-20T20:30:29.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:29.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:29.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.742694919999998, 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.798 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:29.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.740507149999999, 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:29.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:29.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.809 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.740409147000001, 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.739347819000002, 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:29.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.738905348999999, 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:29.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.738028405999998, 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:29.826 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:29.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:29.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.737938956999997, 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:29.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.737872694000004, 2024-09-20T20:30:29.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:29.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:29.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:29.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:29.843 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.736359391999997, 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:29.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:29.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:29.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:29.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:29.848 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:29.849 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:29.850 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:29.848+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:29.950 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:29.948+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:29.974 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:29.974 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:29.974 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:29.975 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:29.988 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:30.051 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:30.048+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:30.105 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:30.105 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:30.105 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:30.105 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:30.105 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:30.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:30.161 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:30.160+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:30.253 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:30.248+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:30.285 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 45.233010307999997, 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.286 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:30.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 45.232364939999997, 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:30.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:30.295 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.740055036999998, 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:30.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:30.299 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.297748155999997, 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:30.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:30.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:30.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:30.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.297633537000003, 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.307 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.308 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:30.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.309 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:30.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.297534253999999, 2024-09-20T20:30:30.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:30.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:30.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.319 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.297472782, 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:30.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:30.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:30.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.295321194000003, 2024-09-20T20:30:30.325 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:30.326 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:30.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:30.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.292677449000003, 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.331 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:30.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:30.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.336 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.288083700999998, 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.337 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:30.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:30.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.287963118, 2024-09-20T20:30:30.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:30.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.287890619000002, 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:30.350 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.284547498000002, 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:30.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.282213353000003, 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:30.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.280124039, 2024-09-20T20:30:30.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:30.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:30.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:30.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.279765928000003, 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.368 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.279646149000001, 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:30.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:30.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.279345878000001, 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:30.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:30.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:30.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.276834377, 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.377 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:30.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:30.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:30.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.381 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 35.272384971999998, 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:30.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:30.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:30.386 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:30.388 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:30.388 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:30.384+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:30.489 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:30.488+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:30.520 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:30.520 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:30.521 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:30.521 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:30.535 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:30.589 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:30.588+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:30.657 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:30.657 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:30.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:30.714 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:30.712+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:30.791 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:30.787+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.974217809999999, 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:30.793 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:30.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798617067999999, 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:30.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:30.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.803 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798529209000002, 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:30.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:30.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.809 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.810 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:30.810 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798487879, 2024-09-20T20:30:30.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:30.810 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.810 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.810 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.810 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:30.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:30.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:30.815 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798418732999998, 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:30.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:30.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:30.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:30.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798368449999998, 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:30.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798333344, 2024-09-20T20:30:30.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798281676999999, 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.833 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:30.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:30.837 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798204708, 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:30.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.798152342000002, 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:30.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.785582318000003, 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:30.846 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:30.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:30.850 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.785490998999997, 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:30.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.785403219999999, 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:30.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.784543229999997, 2024-09-20T20:30:30.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.779957752000001, 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.865 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:30.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.779888606, 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.775381392, 2024-09-20T20:30:30.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:30.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.878 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.809062072000003, 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:30.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:30.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:30.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:30.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:30.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:30.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.806721338999999, 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.885 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:30.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:30.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8062187390000002, 2024-09-20T20:30:30.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:30.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:30.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:30.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:30.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:30.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:30.897 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:30.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:30:30.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:30.900 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:30.899+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:30.964 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:31.001 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:30.996+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:31.030 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:31.030 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:31.030 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:31.030 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:31.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:31.101 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:31.099+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:31.118 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:31.119 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:31.139 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:31.139 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:31.160 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:31.160 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:31.163 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:31.163 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:31.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:31.203 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:31.200+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:31.303 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:31.300+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:31.346 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:31.346 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:31.362 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:31.404 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:31.400+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:31.494 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:31.494 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:31.505 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:31.504+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:31.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:31.606 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:31.604+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:31.672 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:31.672 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:31.686 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:31.733 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:31.732+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:30:31.808 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:31.803+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:31.810 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:31.810 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:31.824 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:31.909 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:31.907+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:31.956 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:31.956 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:31.972 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:32.011 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:32.008+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:32.092 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:32.092 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:32.106 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:32.155 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:32.152+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:32.213 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:32.212+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:32.228 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:32.228 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:32.242 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:32.314 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:32.311+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:32.373 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:32.373 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:32.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:32.415 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:32.412+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:32.516 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:32.511+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:32.545 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:32.545 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:32.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:32.617 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:32.612+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:32.718 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:32.716+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:32.725 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:32.725 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:32.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:32.819 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:32.815+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:32.869 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:32.869 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:32.883 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:32.929 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:32.928+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:33.007 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:33.007 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:33.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:33.021 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:33.016+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:33.121 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:33.120+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:33.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:33.186 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:33.187 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:33.200 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:33.246 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:33.244+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:33.324 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:33.320+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:33.332 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:33.332 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:33.334 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:33.346 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:33.355 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:33.355 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:33.374 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:33.375 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:33.435 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:33.432+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:33.511 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:33.511 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:33.511 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:33.511 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:33.511 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:33.525 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:33.526 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:33.523+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:33.626 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:33.623+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:33.694 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:33.694 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:33.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:33.694 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:33.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.875416950999998, 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:33.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699816208999998, 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:33.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699728350000001, 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:33.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:33.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699687019999999, 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:33.710 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:33.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:33.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:33.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699617873999998, 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.716 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:33.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699567590999997, 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:33.721 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:33.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:33.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699532484999999, 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:33.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:33.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699480817999998, 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:33.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:33.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:33.735 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699403848999999, 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:33.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.699351483000001, 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:33.740 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:33.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.686781459000002, 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.744 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.748 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.686690140000003, 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:33.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.686602360999998, 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:33.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:33.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:33.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.685742371000003, 2024-09-20T20:30:33.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:33.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.681156893000001, 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.765 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.681087746999999, 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:33.769 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.676580532999999, 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.710261213000003, 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.773 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:33.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:33.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:33.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:33.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.707920479999999, 2024-09-20T20:30:33.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:33.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:33.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.783 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.707417879999999, 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:33.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:33.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:33.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:33.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:33.789 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:33.791 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:33.788+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:33.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:33.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:30:33.892 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:33.892+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:33.923 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:33.923 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:33.923 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:33.923 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:33.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:33.994 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:33.991+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:34.059 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:34.059 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:34.059 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:34.059 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:34.059 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:34.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:34.117 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:34.115+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:34.196 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:34.191+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.699191235999997, 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.250873478999999, 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.250496525000003, 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.250392482999999, 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:34.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.249291243999998, 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:34.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:34.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:34.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:34.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.249200588000001, 2024-09-20T20:30:34.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:34.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:34.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.249128116000001, 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:34.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.249065969, 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:34.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:34.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.249003219999999, 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.282 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:34.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:34.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:34.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:34.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.248894677000003, 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:34.292 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.248829391000001, 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.297 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.248767491999999, 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:34.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.246579722, 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.246481719000002, 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:34.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.313 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.245420391000003, 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.244977921, 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.244100977999999, 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.244011528999998, 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.243945265999997, 2024-09-20T20:30:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.242431963999998, 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:34.343 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:34.345 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:34.345 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:34.339+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:34.446 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:34.444+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:34.476 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:34.476 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:34.476 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:34.476 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:34.490 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:34.577 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:34.576+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:34.648 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:34.644+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:34.656 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:34.656 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:34.656 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:34.656 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:34.657 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:34.670 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:34.713 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:34.713 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:34.713 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-20T20:30:34.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-20T20:30:34.749 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:34.744+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:34.810 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:30:34.838 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 49.785755680000001, 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 49.785110312, 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.846 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 49.292800409000002, 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.848 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:34.849 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.850493528000001, 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:34.852 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.853 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:34.854 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.857 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.857 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.857 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:34.857 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:34.857 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.857 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.857 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.858 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:34.858 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:34.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.858 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.858 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.859 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.850378909, 2024-09-20T20:30:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.860 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:34.861 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:34.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.863 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.864 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.865 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.866 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.850279626000003, 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.867 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.868 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.869 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:34.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:34.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.872 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.850218153999997, 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.873 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.848066566, 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.878 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:34.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:34.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.845422821, 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.883 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:34.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:34.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:34.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.840829073000002, 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:34.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.894 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.840708489999997, 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:34.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:34.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:34.898 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.840635990999999, 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.899 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:34.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:34.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:34.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:34.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:34.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:34.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.904 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:34.905 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:34.905 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.837292869999999, 2024-09-20T20:30:34.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:34.905 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.905 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.905 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.905 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:34.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.907 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:34.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.907 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.907 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:34.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:34.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.908 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.908 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:34.908 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:34.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.909 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.909 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:34.909 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:34.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.909 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:34.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:34.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.910 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:34.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:34.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.911 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:34.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:34.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.912 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:34.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:34.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:34.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:34.913 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.913 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.913 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.914 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:34.914 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:34.914 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.834958725, 2024-09-20T20:30:34.915 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:34.915 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.915 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.915 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.915 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.915 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:34.916 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.916 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:34.917 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.917 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.917 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.917 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:34.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:34.918 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.918 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.918 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.918 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:34.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:34.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:34.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:34.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:34.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:34.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:34.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:34.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:34.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:34.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.923 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:34.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:34.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.923 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.923 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:34.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:34.924 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.924 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.924 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.924 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:34.925 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:34.925 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.832869410999997, 2024-09-20T20:30:34.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:34.925 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.925 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.925 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.926 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.926 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:34.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.927 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:34.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:34.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:34.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:34.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:34.929 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:34.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:34.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:34.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:34.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:34.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:34.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.8325113, 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:34.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:34.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.832391520999998, 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:34.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:34.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:34.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:34.942 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.832091249999998, 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:34.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:34.947 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.829579748999997, 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:34.948 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.949 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.949 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.949 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.949 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.949 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:34.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:34.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:34.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:34.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:34.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:34.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:34.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:34.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:34.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:34.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:34.955 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.955 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.955 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.955 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:34.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 39.825130344000002, 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:34.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:34.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.957 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:34.957 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:34.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:34.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:34.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:34.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:34.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:34.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:34.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:34.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:34.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:34.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:34.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:34.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:34.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:34.962 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:34.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:34.965 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:34.964+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:35.027 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:oload 110 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 0.05 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0003 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0004 2024-09-20T20:30:35.028 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:30:35.044 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-20T20:30:35.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-20T20:30:35.065 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:35.060+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:35.097 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:35.097 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:35.097 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:35.097 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:35.111 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:35.166 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:35.164+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:35.268 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:35.267+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:35.277 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:35.277 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:35.277 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:35.277 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:35.277 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:35.291 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:35.331 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:30:35.331 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout:oload 1000 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 0.05 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0003 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0032 2024-09-20T20:30:35.332 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:30:35.349 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-20T20:30:35.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-09-20T20:30:35.369 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:35.364+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:35.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:35.414 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:35.414 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.597399965000001, 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:35.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:35.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421799223000001, 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:35.419 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.425 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421711363999997, 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:35.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421670034000002, 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:35.431 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:35.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:35.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421600888, 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:35.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:35.441 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421550605, 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:35.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:35.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:35.447 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421515499000002, 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:35.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:35.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.452 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421463832000001, 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:35.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:35.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421386863000002, 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:35.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:35.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.421334496999997, 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:35.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:35.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.408764472999998, 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.468 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.408673153999999, 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:35.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:35.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:35.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.408585375000001, 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:35.473 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:35.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:35.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.407725384999999, 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:35.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:35.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:35.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.403139907000003, 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:35.482 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:35.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.403070761000002, 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:35.486 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:35.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:35.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.398563547000002, 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:35.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:35.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.432244226999998, 2024-09-20T20:30:35.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:35.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:35.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:35.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.429903494000001, 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:35.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:35.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.429400894, 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:35.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:35.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:35.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:35.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:35.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:35.509 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:35.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:35.511 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:35.507+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:35.534 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:35.554 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:35.555 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:35.587 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:35.588 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:35.611 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:35.608+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:35.643 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:35.643 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:35.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:35.659 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:oload 1000 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 1 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0003 2024-09-20T20:30:35.660 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0032 2024-09-20T20:30:35.661 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:30:35.677 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-20T20:30:35.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-09-20T20:30:35.712 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:35.708+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:35.777 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:35.777 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:35.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:35.813 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:35.808+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:35.913 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:35.913 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:35.914 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:35.911+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:35.928 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:35.965 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:30:35.965 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:30:35.965 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:30:35.965 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:30:35.965 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:30:35.965 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:35.965 INFO:teuthology.orchestra.run.smithi070.stdout:oload 1000 2024-09-20T20:30:35.965 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 1 2024-09-20T20:30:35.966 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:30:35.966 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0003 2024-09-20T20:30:35.966 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0032 2024-09-20T20:30:35.966 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:30:35.982 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-20T20:30:35.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-20T20:30:36.014 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:36.012+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:36.059 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:36.059 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:36.073 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:36.115 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:36.112+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:36.216 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:36.212+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:36.241 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:36.242 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:36.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:36.264 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:30:36.264 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:30:36.264 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:30:36.264 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:30:36.264 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:30:36.264 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:36.265 INFO:teuthology.orchestra.run.smithi070.stdout:oload 110 2024-09-20T20:30:36.265 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 3 2024-09-20T20:30:36.265 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:30:36.265 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0003 2024-09-20T20:30:36.265 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0004 2024-09-20T20:30:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:30:36.317 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:36.311+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:36.418 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:36.415+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:36.419 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:36.419 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:36.434 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:36.519 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:36.516+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:36.566 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:36.566 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:36.582 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:36.620 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:36.615+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:36.703 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:36.704 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:36.717 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:36.720 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:36.716+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:36.821 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:36.816+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:36.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:30:36.834 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:36.834 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:36.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:36.922 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:36.919+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:36.979 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:36.979 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:36.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:37.023 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:37.020+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:37.124 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:37.120+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:37.154 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:37.155 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:37.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:37.224 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:37.220+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:37.291 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:37.291 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:37.305 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:37.349 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:37.348+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:37.426 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:37.424+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:37.436 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:37.436 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:37.452 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:37.537 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:37.536+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:37.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:37.615 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:37.615 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:37.628 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:37.624+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:37.629 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:37.729 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:37.724+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:37.756 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:37.757 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:37.776 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:37.777 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:37.797 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:37.797 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:37.799 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 52.745047943000003, 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.800 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:37.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.802 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.803 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.804 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 52.744402575000002, 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.805 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.806 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:37.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:37.808 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 52.252092672000003, 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.809 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:37.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.809785791000003, 2024-09-20T20:30:37.813 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:37.814 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:37.815 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.816 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.817 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.818 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.809671172000002, 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.819 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:37.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:37.821 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:37.822 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.823 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.809571888999997, 2024-09-20T20:30:37.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.825 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.826 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:37.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:37.828 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.809510416999998, 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.830 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.831 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.832 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:37.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:37.835 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.807358829000002, 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.836 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.837 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.840 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.804715084000001, 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:37.841 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.842 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:37.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:37.846 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.800121335999997, 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:37.847 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.848 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.849 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:37.850 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:37.851 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.800000752999999, 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.852 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:37.853 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:37.854 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.855 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.799928254000001, 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:37.856 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:37.857 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.858 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.859 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.796585133000001, 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.860 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.861 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.862 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.863 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:37.864 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.794250988000002, 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.865 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:37.866 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:37.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.868 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.792161673999999, 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.869 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.872 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.872 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:37.872 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:37.873 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.873 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:37.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.791803563000002, 2024-09-20T20:30:37.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.879 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.791683784, 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:37.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.791383513, 2024-09-20T20:30:37.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.888 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.788872011999999, 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:37.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:37.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 42.784422607000003, 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:37.893 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:37.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.897 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:37.898 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:37.898 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:37.900 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:30:37.901 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:37.899+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:38.000 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:37.996+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:38.033 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:38.033 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:38.033 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:38.033 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:38.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:38.100 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:38.095+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:38.201 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:38.196+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:38.215 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:38.215 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:38.215 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:38.216 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:38.216 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:38.230 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:38.302 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:38.299+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 48.582896630999997, 2024-09-20T20:30:38.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:38.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:38.406 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.407295888999997, 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:38.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.412 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.40720803, 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:38.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:38.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:38.418 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.407166699999998, 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:38.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:38.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.407097554000003, 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.424 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.430 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.407047271000003, 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:38.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:38.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:38.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.407012164999998, 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:38.436 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:38.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.406960497999997, 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.442 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:38.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.406883528999998, 2024-09-20T20:30:38.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.450 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.406831163, 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.394261139000001, 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:38.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.394169820000002, 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.459 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:38.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.394082040999997, 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:38.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.393222051000002, 2024-09-20T20:30:38.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:38.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.388636572999999, 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:38.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.388567426999998, 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.477 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:38.480 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.384060212999998, 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:38.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.484 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 41.417740893000001, 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:38.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:38.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:38.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:38.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.415400160000001, 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:38.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:38.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:38.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:38.497 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.41489756, 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:38.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:38.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:38.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:38.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.503 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:38.503 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:38.503 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:38.505 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:38.500+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:38.505 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:38.605 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:38.600+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:38.638 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:38.638 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:38.638 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:38.638 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:38.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:38.706 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:38.704+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:38.775 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:38.776 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:38.776 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:38.776 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:38.776 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:38.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:38.807 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:38.804+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 53.366666803000001, 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.918349046000003, 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.917972091999999, 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.917868050000003, 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.916766811000002, 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.916676154999998, 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.916603682999998, 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.916541535999997, 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.916478787000003, 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.916370243999999, 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.916304957999998, 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.916243059000003, 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.914055288999997, 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.913957285999999, 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.912895958, 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.912453487999997, 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.911576545000003, 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.911487096000002, 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.911420833000001, 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.909907531000002, 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:39.020 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:39.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:39.022 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:39.016+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:39.123 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:39.120+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:39.152 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:39.152 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:39.153 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:39.153 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:39.168 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:39.223 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:39.220+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:39.324 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:39.320+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:39.330 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:39.330 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:39.330 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:39.330 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:39.330 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:39.344 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:39.425 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:39.424+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 54.414994190000002, 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.470 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:39.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.474 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 54.414348822000001, 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:39.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.922038919000002, 2024-09-20T20:30:39.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:39.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:39.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.479732038000002, 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:39.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:39.489 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.479617419, 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.492 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:39.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.479518136000003, 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.479456663999997, 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.500 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.501 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.505 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.477305076, 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:39.508 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:39.509 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.510 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.474661331, 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.511 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:39.512 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.513 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.514 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:39.515 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.516 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.470067583000002, 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.517 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.469946999999998, 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.522 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:39.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.469874501, 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:39.526 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:39.528 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:39.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.466531379999999, 2024-09-20T20:30:39.530 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:39.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:39.533 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.464197235, 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:39.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:39.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:39.538 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.462107920999998, 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.539 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:39.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.543 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.461749810000001, 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.547 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.461630030999999, 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:39.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.461329759999998, 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.552 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.555 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:39.556 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.458818258999997, 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:39.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:39.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 44.454368854000002, 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:39.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:39.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:39.565 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:39.567 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:39.567 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:39.563+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:39.668 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:39.664+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:39.699 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:39.699 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:39.699 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:39.699 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:39.714 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:39.799 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:39.796+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:39.869 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:39.864+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:39.877 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:39.877 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:39.877 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:39.878 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:39.878 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:39.891 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:39.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:39.902 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:30:39.983 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:39.980+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:40.049 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:40.049 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:40.065 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:40.065 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:40.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:40.065 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:40.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.065 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:40.065 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:40.065 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 50.246077833000001, 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:40.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:40.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:40.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:40.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.071 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.071 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:40.071 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070477091000001, 2024-09-20T20:30:40.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:40.071 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.071 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.072 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.072 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:40.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:40.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:40.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:40.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:40.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:40.077 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070389231999997, 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:40.078 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:40.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:40.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070347902000002, 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:40.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:40.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:40.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:40.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:40.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:40.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070278756, 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.090 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:40.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.095 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070228473, 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:40.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:40.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:40.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:40.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:40.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:40.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:40.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:40.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:40.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:40.102 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070193367000002, 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:40.103 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:40.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:40.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:40.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070141700000001, 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:40.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:40.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:40.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:40.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:40.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:40.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:40.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:40.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:40.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:40.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:40.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070064731000002, 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:40.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:40.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.070012364999997, 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:40.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:40.123 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.123 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.123 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.123 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:40.123 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:40.125 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.057442340999998, 2024-09-20T20:30:40.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:40.125 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.125 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.125 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.125 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:40.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.129 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.057351021999999, 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:40.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:40.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.057263243000001, 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:40.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:40.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.056403252999999, 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:40.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:40.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:40.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:40.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:40.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:40.145 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.051817775000004, 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:40.149 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.051748629000002, 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:40.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.047241415000002, 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:40.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:40.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:40.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:40.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:40.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:40.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:40.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:40.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:40.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.158 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.159 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:40.159 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:40.159 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.080922094999998, 2024-09-20T20:30:40.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:40.159 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.159 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.159 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.160 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:40.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:40.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:40.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:40.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:40.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:40.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:40.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:40.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:40.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:40.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:40.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:40.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:40.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:40.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:40.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:40.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:40.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:40.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:40.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:40.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:40.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:40.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:40.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:40.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:40.170 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.170 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.170 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.171 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:40.171 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:40.171 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 23.078581362000001, 2024-09-20T20:30:40.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:40.171 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.172 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.172 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.172 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:40.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:40.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:40.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:40.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:40.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:40.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:40.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:40.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:40.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:40.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:40.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:40.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:40.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:40.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:40.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:40.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:40.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:40.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:40.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:40.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:40.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:40.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:40.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:40.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:40.182 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.183 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.183 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.183 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:40.183 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:40.183 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.078078762000001, 2024-09-20T20:30:40.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:40.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:40.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:40.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:40.189 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:40.190 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:40.191 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:40.191 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:40.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:40.192 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:40.193 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:40.187+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:40.291 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:40.288+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:40.325 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:40.325 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:40.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:40.392 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:40.388+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:40.456 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:40.456 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:40.471 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:40.493 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:40.492+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:40.594 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:40.592+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:40.594 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:40.594 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:40.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:40.695 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:40.691+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:40.738 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:40.738 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:40.752 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:40.795 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:40.795+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:30:40.869 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:40.869 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:40.882 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:40.896 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:40.895+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:40.997 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:40.996+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:40.998 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:40.998 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:41.012 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:41.098 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:41.092+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:41.144 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:41.144 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:41.160 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:41.200 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:41.199+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:41.283 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:41.283 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:41.283 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-20T20:30:41.283 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:30:41.283 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:30:41.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-20T20:30:41.301 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:41.296+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:41.327 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:41.327 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:41.341 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:41.402 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:41.399+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:41.417 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:41.417 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-20T20:30:41.417 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:41.501 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:41.501 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:41.503 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:41.499+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:41.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:41.603 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:41.599+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:41.641 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:41.641 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:41.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:41.704 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:41.700+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:41.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:41.805 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:41.803+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:41.906 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:41.903+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:41.914 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:41.914 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:41.929 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:42.007 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:42.003+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:42.055 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:42.055 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:42.069 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:42.113 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:42.111+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:42.177 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:42.177 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:42.189 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:42.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:42.208 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:42.204+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:42.309 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:42.303+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:42.344 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:42.344 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:42.354 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:42.354 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:42.363 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:42.364 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:42.367 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:42.383 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:42.383 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:42.410 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:42.407+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:42.498 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:42.498 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:42.499 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:42.499 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:42.511 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:42.504+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:42.514 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:42.611 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:42.608+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:42.675 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:42.675 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:42.675 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:42.675 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:42.675 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:42.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:42.712 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:42.707+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:42.813 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:42.811+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:42.850 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:30:42.856 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:42.856 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:42.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.037598809999999, 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:42.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861998067999998, 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:42.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861910209000001, 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:42.866 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:42.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861868878999999, 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:42.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:42.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861799732999998, 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:42.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:42.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861749449999998, 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.882 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:42.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:42.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.887 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861714343999999, 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:42.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.892 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861662676999998, 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:42.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.896 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861585708, 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:42.900 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.861533342000001, 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:42.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:42.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.848963318000003, 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.905 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:42.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:42.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.848871998999996, 2024-09-20T20:30:42.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:42.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:42.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.848784219999999, 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:42.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.847924229999997, 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.843338752000001, 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.922 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:42.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.843269606, 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:42.926 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:42.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:42.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.838762392, 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.872443072000003, 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.933 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:42.938 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.870102338999999, 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:42.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.943 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.869599739000002, 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:42.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:42.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:42.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:42.949 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:42.951 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:42.948+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:42.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:43.051 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:43.048+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:43.084 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:43.084 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:43.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:43.151 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:43.147+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:43.216 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:43.216 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:43.216 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:43.216 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:43.216 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:43.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:43.274 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:43.271+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:43.353 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:43.347+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:43.402 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:43.402 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:43.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.860476957000003, 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:43.403 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:43.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:43.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:43.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:43.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.412159199999998, 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.410 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:43.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:43.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:43.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:43.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.416 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.416 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.416 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.411782246000001, 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:43.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:43.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:43.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:43.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:43.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.411678203999998, 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:43.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:43.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:43.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.428 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.410576964999997, 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:43.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:43.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:43.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:43.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.410486308999999, 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:43.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.410413837, 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.410351689999999, 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.410288940999997, 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.410180398000001, 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.410115112, 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.410053212999998, 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.407865442999999, 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.407767440000001, 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.406706112000002, 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.406263641999999, 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.405386698999997, 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.405297249999997, 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.405230987000003, 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.403717684999997, 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:43.514 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:43.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:43.516 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:43.511+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:43.617 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:43.612+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:43.645 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:43.645 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:43.645 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:43.646 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:43.659 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:43.718 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:43.715+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:43.779 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:43.779 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:43.779 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:43.779 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:43.779 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:43.794 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:43.818 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:43.815+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:43.851 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:30:43.917 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 58.862859825000001, 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.918 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:43.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:43.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 58.862214457, 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.923 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:43.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:43.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 58.369904554000001, 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:43.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.927597673000001, 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.932 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:43.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.937 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.927483054, 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:43.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:43.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.927383771000002, 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:43.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:43.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:43.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:43.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:43.949 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.927322298999997, 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:43.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:43.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.925170711, 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.955 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:43.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:43.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.960 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.922526966, 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:43.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:43.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.917933218000002, 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.966 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:43.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:43.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.917812634999997, 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:43.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.973 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:43.975 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.917740135999999, 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:43.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:43.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.914397014999999, 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:43.980 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:43.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.984 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.91206287, 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.985 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.986 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.987 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.988 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.909973555999997, 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.989 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.990 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.991 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.992 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.993 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:43.993 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:43.993 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.993 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.993 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.993 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.994 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.909615445, 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.995 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:43.996 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:43.997 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:43.998 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.909495665999998, 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:43.999 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:44.000 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:44.002 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:44.003 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.909195394999998, 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:44.004 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:44.005 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:44.006 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:44.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.906683893999997, 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.008 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.010 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.011 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.012 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 48.902234489000001, 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:44.013 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:44.014 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:44.015 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:44.016 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:44.017 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:44.019 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:44.019 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:44.015+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:44.120 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:44.119+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:44.151 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:44.151 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:44.152 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:44.152 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:44.167 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:44.221 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:44.216+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:44.289 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:44.289 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:44.289 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:44.289 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:44.289 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:44.303 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:44.321 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:44.319+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:44.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:44.422 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:44.419+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 54.656184517, 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:44.475 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:44.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:44.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480583774999999, 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:44.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:44.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480495916000002, 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:44.485 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:44.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:44.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.490 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480454586, 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:44.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:44.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480385439999999, 2024-09-20T20:30:44.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:44.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480335156999999, 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:44.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:44.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:44.507 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480300051, 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:44.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.512 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480248383999999, 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:44.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.516 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480171415000001, 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:44.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.520 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.480119049000002, 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:44.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.524 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.467549024999997, 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:44.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.467457705999998, 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.529 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:44.533 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.467369927, 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:44.537 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.466509936999998, 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:44.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:44.542 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.461924459000002, 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.546 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.461855313000001, 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:44.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.457348099000001, 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:44.550 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:44.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:44.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 47.491028778999997, 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:44.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:44.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:44.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 27.488688046, 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:44.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:44.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.565 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.488185445999999, 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:44.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:44.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:44.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.571 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:44.571 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:44.571 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:44.572 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:44.572 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:44.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:44.573 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:44.567+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:44.589 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:44.609 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:44.610 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:44.673 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:44.672+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:44.706 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:44.706 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:44.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:44.775 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:44.772+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:44.840 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:44.840 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:44.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:44.875 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:44.871+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:44.969 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:44.969 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:44.976 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:44.972+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:44.982 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:45.078 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:45.075+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:45.115 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:45.115 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:45.130 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:45.179 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:45.175+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:45.252 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:45.253 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:45.266 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:45.314 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:45.311+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:45.379 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:45.379+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:45.389 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:45.389 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:45.404 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:45.481 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:45.474+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:45.537 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:45.537 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:45.551 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:45.582 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:45.579+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:45.672 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:45.672 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:45.682 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:45.678+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:45.687 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:45.783 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:45.782+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:45.802 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:45.802 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:45.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:45.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:30:45.884 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:45.880+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:45.945 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:45.945 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:45.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:45.985 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:45.980+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:46.082 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:46.082 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:46.086 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:46.084+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:46.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:46.186 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:46.184+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:46.218 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:46.219 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:46.233 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:46.287 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:46.284+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:46.363 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:46.364 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:46.377 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:46.388 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:46.386+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:46.432 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:46.432 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:46.433 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-20T20:30:46.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-20T20:30:46.489 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:46.482+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:46.493 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:46.493 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:46.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:46.590 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:46.588+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:46.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:46.632 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:46.632 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:46.646 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:46.689 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:46.687+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 31, 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "49cfe37c-8fc4-44b8-a85f-d53d77eb9d19", 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-20T20:29:32.709374+0000", 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-20T20:30:43.840353+0000", 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-20T20:29:42.497975+0000", 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-20T20:29:33.925164+0000", 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-20T20:30:46.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 4, 2024-09-20T20:30:46.755 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:43.674922+0000", 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:46.756 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:46.757 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:46.758 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:46.759 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:46.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:46.761 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-20T20:30:46.762 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:48.243188+0000", 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:46.763 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "15", 2024-09-20T20:30:46.764 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 15, 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:46.765 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:46.766 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:46.767 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:52.828296+0000", 2024-09-20T20:30:46.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:46.769 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:46.771 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:46.772 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2024-09-20T20:30:46.773 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-20T20:30:46.774 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:53.322652+0000", 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:46.775 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:46.776 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "19", 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:46.777 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:46.778 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:46.779 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2024-09-20T20:30:46.780 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.781 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1faec90a-457d-4941-a408-c3a5b5f8e2f1", 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6800", 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6801", 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6802", 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6803", 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6806", 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6807", 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6804", 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6805", 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.79:6801/367188288", 2024-09-20T20:30:46.786 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.79:6803/367188288", 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.79:6807/367188288", 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.79:6805/367188288", 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "99ce4df8-04c8-4992-9306-22ca73b3e744", 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:46.787 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6800", 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:46.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6801", 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6802", 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:46.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6803", 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6806", 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:46.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6807", 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6804", 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:46.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6805", 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.90:6801/3440150315", 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.90:6803/3440150315", 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.90:6807/3440150315", 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.90:6805/3440150315", 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:46.792 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "9427eb75-9576-46b8-9123-f40e3ad555fc", 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:46.793 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6800", 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6801", 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:46.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6802", 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6803", 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6806", 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.796 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6807", 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6804", 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6805", 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.187:6801/3717183720", 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.187:6803/3717183720", 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3717183720", 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3717183720", 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:46.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:40.098836+0000", 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.799 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:39.812954+0000", 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:46.800 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:40.075239+0000", 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-20T20:30:46.801 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-20T20:30:46.802 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-20T20:30:46.803 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-20T20:30:46.803 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-20T20:30:46.803 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-20T20:30:46.803 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-20T20:30:46.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:46.803 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:30:46.804 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:46.805 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:46.805 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:46.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:46.806 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:46.800+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:46.807 INFO:tasks.thrashosds.thrasher:j is {'epoch': 31, 'fsid': '49cfe37c-8fc4-44b8-a85f-d53d77eb9d19', 'created': '2024-09-20T20:29:32.709374+0000', 'modified': '2024-09-20T20:30:43.840353+0000', 'last_up_change': '2024-09-20T20:29:42.497975+0000', 'last_in_change': '2024-09-20T20:29:33.925164+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-20T20:29:43.674922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-20T20:29:48.243188+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-20T20:29:52.828296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-20T20:29:53.322652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '1faec90a-457d-4941-a408-c3a5b5f8e2f1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 367188288}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 367188288}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 367188288}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 367188288}]}, 'public_addr': '172.21.15.79:6801/367188288', 'cluster_addr': '172.21.15.79:6803/367188288', 'heartbeat_back_addr': '172.21.15.79:6807/367188288', 'heartbeat_front_addr': '172.21.15.79:6805/367188288', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '99ce4df8-04c8-4992-9306-22ca73b3e744', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6800', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6801', 'nonce': 3440150315}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6802', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6803', 'nonce': 3440150315}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6806', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6807', 'nonce': 3440150315}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6804', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6805', 'nonce': 3440150315}]}, 'public_addr': '172.21.15.90:6801/3440150315', 'cluster_addr': '172.21.15.90:6803/3440150315', 'heartbeat_back_addr': '172.21.15.90:6807/3440150315', 'heartbeat_front_addr': '172.21.15.90:6805/3440150315', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9427eb75-9576-46b8-9123-f40e3ad555fc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 3717183720}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 3717183720}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 3717183720}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 3717183720}]}, 'public_addr': '172.21.15.187:6801/3717183720', 'cluster_addr': '172.21.15.187:6803/3717183720', 'heartbeat_back_addr': '172.21.15.187:6807/3717183720', 'heartbeat_front_addr': '172.21.15.187:6805/3717183720', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:40.098836+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:39.812954+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:40.075239+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-20T20:30:46.807 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-20T20:30:46.807 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:46.808 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:30:46.905 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:46.902+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:46.965 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:46.965 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:46.965 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:46.965 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:46.965 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:46.979 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:47.007 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:47.003+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:47.104 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:47.104 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:47.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:47.104 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:47.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.104 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:47.104 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:47.104 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.286315184999999, 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:47.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:47.108 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110714442999999, 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:47.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.114 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110626584000002, 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:47.119 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110585254, 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:47.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:47.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.125 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110516107999999, 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:47.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:47.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110465824999999, 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:47.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:47.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110430719, 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.136 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:47.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:47.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:47.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.141 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110379051999999, 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110302083000001, 2024-09-20T20:30:47.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:47.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.110249717000002, 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:47.149 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:47.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:47.153 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.097679693000003, 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.157 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.097588373999997, 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:47.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:47.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:47.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.097500595, 2024-09-20T20:30:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.166 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.096640604999997, 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:47.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.092055127000002, 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:47.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.091985981000001, 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.175 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.178 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.087478767, 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 50.121159446999997, 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:47.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:47.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:47.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.118818714, 2024-09-20T20:30:47.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:47.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:47.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.193 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.118316113999999, 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:47.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:47.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:47.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:47.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.198 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:47.199 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:47.199 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:47.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:47.201 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:47.198+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:47.301 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:47.300+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:47.331 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:47.331 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:47.331 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:47.331 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:47.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:47.402 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:47.399+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:47.464 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:47.465 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:47.465 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:47.465 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:47.465 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:47.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:47.502 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:47.496+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:47.599 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:47.599 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:47.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:47.599 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.057351089999997, 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.609033332999999, 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.608656379000003, 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.608552336999999, 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.607451097999999, 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.607360442000001, 2024-09-20T20:30:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.607287970000002, 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.607225823, 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.607163073999999, 2024-09-20T20:30:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.607054531000003, 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.606989245000001, 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.606927345999999, 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.604739576, 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.604641573000002, 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.603580245000003, 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.603137775, 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.602260831999999, 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.602171382999998, 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.602105119999997, 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.600591817999998, 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:47.706 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:47.707 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:47.708 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:47.703+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:47.809 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:47.806+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:47.842 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:47.842 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:47.842 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:47.842 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:47.856 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:47.909 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:47.903+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:47.974 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:47.974 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:47.974 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:47.974 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:47.974 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:47.988 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:48.010 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:48.004+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:48.111 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:48.106+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:48.159 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 63.104459067999997, 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.160 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:48.161 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.162 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.163 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:48.164 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 63.103813700000003, 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.165 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.168 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.611503796999997, 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:48.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.170 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.169196915999997, 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.173 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:48.175 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:48.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:48.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.169082297000003, 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:48.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:48.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:48.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.168983013999998, 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:48.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.168921542, 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.192 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.194 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.166769954000003, 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.196 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.198 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.199 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.164126209000003, 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.200 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.201 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.203 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.159532460999998, 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.205 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:48.209 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.210 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.159411878, 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.211 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:48.213 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.214 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.159339379000002, 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:48.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:48.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:48.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.155996258000002, 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:48.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:48.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:48.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.153662113000003, 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:48.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.151572799, 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.227 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.151214688000003, 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.235 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.151094909000001, 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:48.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.240 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.150794638000001, 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:48.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:48.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.148283137, 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 53.143833731999997, 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:48.249 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:48.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:48.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:48.253 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:48.255 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:48.255 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:48.250+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:48.355 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:48.351+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:48.387 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:48.387 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:48.387 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:48.387 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:48.402 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:48.456 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:48.455+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:48.528 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:48.528 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:48.528 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:48.528 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:48.528 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:48.543 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:48.557 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:48.555+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:48.658 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:48.655+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.845079986000002, 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:48.664 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:48.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:48.668 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669479244000001, 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:48.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669391384999997, 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:48.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:48.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.680 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669350055000002, 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:48.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:48.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:48.686 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669280909000001, 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:48.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:48.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669230626000001, 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:48.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:48.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669195520000002, 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:48.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:48.703 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669143853000001, 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:48.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:48.707 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669066884000003, 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.669014517999997, 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:48.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:48.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:48.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.656444493999999, 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:48.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.656353175, 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:48.720 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:48.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:48.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.656265396000002, 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:48.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:48.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.729 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.655405406, 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:48.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:48.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:48.734 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.650819927999997, 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:48.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.738 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.650750782000003, 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:48.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.646243568000003, 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:48.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 51.679924247999999, 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:48.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:48.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:48.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.677583514999998, 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:48.752 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:48.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.677080915000001, 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:48.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:48.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:48.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:48.764 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:48.764 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:48.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:48.766 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:48.763+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:48.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:48.866 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:48.863+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:48.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:30:48.897 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:48.898 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:48.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:48.967 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:48.964+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:48.978 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:48.979 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:49.009 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:49.009 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:49.029 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:49.030 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:49.030 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:49.031 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:49.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:49.068 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:49.063+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:49.161 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:49.161 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:49.168 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:49.164+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:49.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:49.269 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:49.263+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:49.311 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:49.311 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:49.327 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:49.370 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:49.364+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:49.471 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:49.470+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:49.494 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:49.494 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:49.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:49.572 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:49.567+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:49.628 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:49.628 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:49.642 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:49.687 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:49.684+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:49.773 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:49.770+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:49.775 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:49.775 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:49.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:49.879 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:49.876+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:49.957 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:49.957 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:49.972 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:50.015 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:50.012+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:50.018 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:30:50.074 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:50.070+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:50.138 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:50.138 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:50.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:50.198 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:50.194+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:50.276 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:50.272+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:50.277 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:50.277 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:50.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:50.377 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:50.376+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:50.456 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:50.456 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:50.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:50.478 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:50.476+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:50.579 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:50.575+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:50.592 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:50.592 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:50.606 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:50.680 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:50.675+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:50.738 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:50.738 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:50.754 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:50.780 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:50.778+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:50.881 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:50.876+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:50.924 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:50.924 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:50.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:50.982 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:50.978+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:51.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:51.063 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:51.063 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:51.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:51.082 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:51.079+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:51.184 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:51.178+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:51.189 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:51.208 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:51.208 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:51.210 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:51.210 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:51.223 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:51.227 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:51.285 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:51.278+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:51.339 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:51.339 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:51.339 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:51.339 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:51.339 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:51.354 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:51.399 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:51.396+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:51.482 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:51.482 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:51.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:51.482 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:51.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.483 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:51.483 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:51.483 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.662294363999997, 2024-09-20T20:30:51.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:51.483 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.483 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.483 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.483 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:51.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:51.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486693621999997, 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486605763, 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.493 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:51.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:51.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:51.498 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486564432999998, 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:51.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:51.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.504 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486495286999997, 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:51.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.510 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486445003999997, 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:51.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486409897999998, 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:51.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:51.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.522 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486358230999997, 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:51.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486281261999999, 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.527 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:51.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.486228896, 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:51.531 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:51.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:51.535 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.473658872000001, 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:51.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:51.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.473567553000002, 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:51.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:51.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.473479773999998, 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.545 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.472619784000003, 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:51.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:51.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:51.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:51.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:51.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:51.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:51.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:51.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.468034306, 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.556 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.557 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:51.557 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:51.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:51.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:51.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:51.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.467965159999999, 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:51.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.463457945999998, 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:51.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 54.497138626000002, 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:51.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.494797892999998, 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:51.574 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:51.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:51.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:51.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.494295293, 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:51.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:51.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:51.585 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:51.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:51.587 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:51.583+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:51.688 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:51.687+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:51.719 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:51.719 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:51.719 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:51.719 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:51.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:51.789 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:51.787+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:51.808 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:51.809 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:51.809 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-20T20:30:51.809 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:30:51.809 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:30:51.809 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-20T20:30:51.852 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:51.852 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:51.852 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:51.852 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:51.852 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:51.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:51.914 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:51.910+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:51.940 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:51.940 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "" 2024-09-20T20:30:51.940 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:51.990 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.449492720999999, 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.001174964000001, 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:51.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:51.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:51.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.000798009999997, 2024-09-20T20:30:52.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:52.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:52.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:52.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.008 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.000693968, 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:52.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:52.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:52.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.999592729, 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.014 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:52.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:52.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:52.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.019 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.999502073000002, 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.999429601000003, 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:52.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:52.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.999367454000001, 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.999304705, 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.035 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:52.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.040 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.999196161999997, 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:52.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:52.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.999130876000002, 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:52.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:52.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:52.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.999068977, 2024-09-20T20:30:52.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:52.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.996881207000001, 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.057 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:52.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:52.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:52.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:52.062 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.996783204000003, 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.995721875999998, 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:52.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:52.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:52.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.995279406000002, 2024-09-20T20:30:52.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:52.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.994402463, 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:52.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:52.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.994313013999999, 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:52.084 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:52.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:52.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:52.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.089 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.994246750999999, 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:52.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:52.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:52.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.992733448999999, 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:52.095 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:52.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:52.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:52.099 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:52.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:30:52.100 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:51.984+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:52.101 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:52.102 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:52.094+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:52.202 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:52.198+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:52.237 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:52.237 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:52.237 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:52.237 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:52.252 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:52.303 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:52.299+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:52.372 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:52.372 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:52.372 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:52.372 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:52.372 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:52.386 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:52.404 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:52.400+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:52.504 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:52.499+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:52.557 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:52.557 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:52.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 67.502231172999998, 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:52.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 67.501585805000005, 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.562 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 67.009275901999999, 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.566969020999998, 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.571 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:52.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.576 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.566854401999997, 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.577 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:52.578 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.579 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.580 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:52.581 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.566755119, 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:52.582 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:52.583 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.584 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.585 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.586 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:52.587 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.566693647000001, 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:52.588 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:52.589 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.590 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.591 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:52.592 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.564542058999997, 2024-09-20T20:30:52.593 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.594 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:52.595 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.596 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.597 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.598 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.561898313999997, 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.599 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.600 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.601 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:52.602 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:52.603 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.557304565999999, 2024-09-20T20:30:52.604 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.605 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:52.606 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.607 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.608 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.609 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.557183983000002, 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.610 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.611 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.612 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.613 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.557111484000004, 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.614 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.615 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:52.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.553768363000003, 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.618 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:52.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.551434217999997, 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.622 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:52.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.626 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.549344904000002, 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:52.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:52.628 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:52.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:52.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.548986792999997, 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:52.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.548867014000002, 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:52.635 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:52.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:52.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.548566743000002, 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.640 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.641 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.546055242000001, 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.644 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:52.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.648 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 57.541605836999999, 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:52.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:52.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:52.653 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:52.653 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:52.654 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:52.655 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:52.650+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:52.755 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:52.751+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:52.788 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:52.788 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:52.788 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:52.788 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:52.802 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:52.856 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:52.855+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:52.927 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:52.927 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:52.927 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:52.927 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:52.927 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:52.941 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:52.957 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:52.954+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:30:53.059 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:53.058+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 63.244573256999999, 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.064 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:53.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:53.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068972514999999, 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:53.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068884656000002, 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:53.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:53.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068843326, 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.079 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:53.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:53.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068774179999998, 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:53.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:53.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:53.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:53.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068723896999998, 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:53.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068688791, 2024-09-20T20:30:53.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:53.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:53.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068637123999999, 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068560155, 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:53.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.068507789000002, 2024-09-20T20:30:53.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:53.112 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.055937765000003, 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:53.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.055846445999997, 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:53.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:53.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:53.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.055758666999999, 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.121 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:53.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:53.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.054898676999997, 2024-09-20T20:30:53.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:53.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.129 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.050313199000001, 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:53.133 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.050244053, 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.045736839, 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:53.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:53.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.140 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.079417519000003, 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.077076785999999, 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:53.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:53.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:53.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:53.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:53.150 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 31.076574185999998, 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:53.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:53.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:53.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:53.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:53.156 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:53.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:53.159 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:53.156+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:53.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:53.260 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:53.255+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:53.292 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:53.292 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:53.292 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:53.292 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:53.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:53.361 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:53.359+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:53.390 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:53.390 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:53.422 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:53.423 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:53.427 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:53.427 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:53.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:53.443 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:53.443 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:53.490 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:53.486+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:53.562 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:53.558+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:53.563 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:53.563 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:53.577 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:53.663 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:53.659+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:53.709 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:53.777 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:53.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:53.780 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:53.775+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:53.880 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:53.875+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:53.949 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:53.949 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:53.965 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:53.981 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:53.978+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:54.082 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:54.080+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:54.128 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:54.129 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:54.142 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:54.183 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:54.179+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:54.275 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:54.275 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:54.284 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:54.278+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:54.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:54.384 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:54.380+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:54.405 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:54.405 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:54.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:54.486 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:54.482+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:54.586 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:54.586 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:54.586 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:54.580+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:54.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:54.687 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:54.682+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:54.729 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:54.729 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:54.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:54.788 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:54.787+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:54.889 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:54.882+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:54.906 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:54.906 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:54.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:54.990 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:54.987+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:55.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:30:55.090 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:55.090 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:55.091 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:55.087+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:55.105 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:55.191 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:55.187+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:55.250 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:55.292 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:55.288+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:55.393 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:55.387+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:55.423 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:55.423 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:55.423 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:30:55.438 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:55.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:30:55.493 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:55.490+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:55.593 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:55.594 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:55.594 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:55.592+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:55.612 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:55.613 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 70.560670337999994, 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.616 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.618 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:55.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 70.560024970000001, 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:55.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 70.067715066999995, 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.625 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:55.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:55.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.628 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.629 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.625408186000001, 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:55.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:55.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.625293567, 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.635 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:55.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.640 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.625194284000003, 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:55.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:55.646 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.625132811999997, 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:55.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.648 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:55.651 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.622981224, 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:55.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.654 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:55.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.620337479, 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.658 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.660 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.661 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:55.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.615743731000002, 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:55.663 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.664 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:55.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:55.666 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:55.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.668 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.615623147999997, 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:55.669 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:55.672 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.615550648999999, 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.673 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:55.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:55.676 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.612207527999999, 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.677 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:55.678 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:55.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:55.681 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.609873383, 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.682 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.684 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:55.685 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.607784068999997, 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.686 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:55.687 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:55.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.689 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:55.690 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.607425958, 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.692 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.693 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:55.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.607306178999998, 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:55.696 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:55.698 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.700 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.607005907999998, 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:55.701 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.702 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.703 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.604494406999997, 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.705 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.706 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.709 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 60.600045002000002, 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.710 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.711 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.712 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:55.713 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.714 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.714 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.714 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:55.714 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:55.714 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:55.715 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:55.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:55.716 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:55.711+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:55.717 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:55.816 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:55.815+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:55.848 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:55.848 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:55.862 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:55.917 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:55.914+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:55.974 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:55.974 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:55.974 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:55.974 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:55.974 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:55.986 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:56.018 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:56.015+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:56.109 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:56.109 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:56.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:56.109 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:56.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 66.290503361000006, 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:56.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.114902618999999, 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.114 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.114814760000002, 2024-09-20T20:30:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.11477343, 2024-09-20T20:30:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.114704283999998, 2024-09-20T20:30:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.114654000999998, 2024-09-20T20:30:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.114618895, 2024-09-20T20:30:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.114567227999999, 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.114490259, 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.114437893000002, 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.101867869000003, 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.101776549999997, 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.101688770999999, 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.100828780999997, 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.096243303000001, 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.096174157, 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.091666943, 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 59.125347623000003, 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.230 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.123006889999999, 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:56.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 34.122504290000002, 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:56.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:56.241 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:56.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:56.243 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:56.242+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:56.344 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:56.338+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:56.375 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:30:56.376 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:56.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:56.445 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:56.443+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:56.546 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:56.543+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:56.552 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:56.552 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:30:56.552 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:30:56.552 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:30:56.552 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:56.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:56.647 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:56.643+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.149034041999997, 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.700716284999999, 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.700339331000002, 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:30:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:30:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:30:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:30:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:30:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:30:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:30:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:30:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:30:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:30:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.700235288999998, 2024-09-20T20:30:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:30:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:30:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:30:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:30:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:30:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:30:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:30:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:30:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:30:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:30:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:30:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:30:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:30:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:30:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:30:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:30:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:30:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:30:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:30:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:30:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:30:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:30:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:30:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:30:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.699134049999998, 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:30:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:30:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.699043394, 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:30:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:30:56.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.698970922000001, 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:30:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.698908775, 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:30:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:30:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.698846025999998, 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.698737483000002, 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.698672197, 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:30:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.698610297999998, 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:30:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:30:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.696422527999999, 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:30:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:30:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.696324525000001, 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:30:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.695263197000003, 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:30:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:30:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.694820727, 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:30:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:30:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:30:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.693943783999998, 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.693854334999997, 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:30:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:30:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.693788071999997, 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:30:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.692274769999997, 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:30:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:30:56.808 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:30:56.810 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:56.811 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:56.807+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:56.911 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:56.907+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:56.940 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:56.940 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:56.940 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:30:56.940 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:56.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:56.955 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:30:56.955 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:30:56.955 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-20T20:30:56.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-20T20:30:57.038 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:57.035+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:57.113 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:57.106+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:57.117 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:57.117 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:30:57.117 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:30:57.117 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:30:57.117 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:57.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:57.214 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:57.212+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:57.298 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:57.298 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 35, 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "49cfe37c-8fc4-44b8-a85f-d53d77eb9d19", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-20T20:29:32.709374+0000", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-20T20:30:55.420209+0000", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-20T20:29:42.497975+0000", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-20T20:29:33.925164+0000", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5804032, 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "nodeep-scrub", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-20T20:30:57.299 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 4, 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 4, 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 3, 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "jewel", 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-20T20:30:57.300 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:43.674922+0000", 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:57.301 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:57.302 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "11", 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:57.303 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:57.304 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:57.305 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2.9900000095367432, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2.9900000095367432, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.67000001668930054, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:57.306 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:48.243188+0000", 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:57.307 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:57.308 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "15", 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 15, 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:57.309 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:57.310 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:57.311 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:57.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_metadata", 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:52.828296+0000", 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:57.313 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:57.314 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "18", 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:57.315 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:57.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4, 2024-09-20T20:30:57.317 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 16, 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_priority": 5 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": "cephfs" 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-20T20:30:57.318 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "cephfs_data", 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-20T20:29:53.322652+0000", 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-20T20:30:57.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-20T20:30:57.320 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "19", 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-20T20:30:57.321 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-20T20:30:57.322 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-20T20:30:57.323 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-20T20:30:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-20T20:30:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-20T20:30:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-20T20:30:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 64, 2024-09-20T20:30:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: "target_size_ratio": 0.89999997615814209 2024-09-20T20:30:57.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-20T20:30:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs": { 2024-09-20T20:30:57.325 INFO:teuthology.orchestra.run.smithi070.stdout: "data": "cephfs" 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.1299999952316284, 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.1299999952316284, 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.326 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "1faec90a-457d-4941-a408-c3a5b5f8e2f1", 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:57.327 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6800", 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6801", 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.328 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6802", 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6803", 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.329 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6806", 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6807", 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.330 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6804", 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.79:6805", 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 367188288 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.79:6801/367188288", 2024-09-20T20:30:57.331 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.79:6803/367188288", 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.79:6807/367188288", 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.79:6805/367188288", 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "99ce4df8-04c8-4992-9306-22ca73b3e744", 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:57.332 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6800", 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6801", 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6802", 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6803", 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6806", 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6807", 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6804", 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.336 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.90:6805", 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3440150315 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.90:6801/3440150315", 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.90:6803/3440150315", 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.90:6807/3440150315", 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.90:6805/3440150315", 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.337 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "9427eb75-9576-46b8-9123-f40e3ad555fc", 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 8, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 17, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6800", 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6801", 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6802", 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6803", 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6806", 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6807", 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-20T20:30:57.341 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6804", 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.187:6805", 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3717183720 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.187:6801/3717183720", 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.187:6803/3717183720", 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3717183720", 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3717183720", 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-20T20:30:57.342 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:40.098836+0000", 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:57.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:39.812954+0000", 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-20T20:30:57.344 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540701547738038271, 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-20T20:29:40.075239+0000", 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [], 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-20T20:30:57.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-20T20:30:57.346 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-20T20:30:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-20T20:30:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-20T20:30:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-20T20:30:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-20T20:30:57.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-20T20:30:57.347 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:30:57.350 INFO:tasks.thrashosds.thrasher:j is {'epoch': 35, 'fsid': '49cfe37c-8fc4-44b8-a85f-d53d77eb9d19', 'created': '2024-09-20T20:29:32.709374+0000', 'modified': '2024-09-20T20:30:55.420209+0000', 'last_up_change': '2024-09-20T20:29:42.497975+0000', 'last_in_change': '2024-09-20T20:29:33.925164+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-20T20:29:43.674922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-20T20:29:48.243188+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-20T20:29:52.828296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-20T20:29:53.322652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '1faec90a-457d-4941-a408-c3a5b5f8e2f1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 367188288}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 367188288}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 367188288}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 367188288}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 367188288}]}, 'public_addr': '172.21.15.79:6801/367188288', 'cluster_addr': '172.21.15.79:6803/367188288', 'heartbeat_back_addr': '172.21.15.79:6807/367188288', 'heartbeat_front_addr': '172.21.15.79:6805/367188288', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '99ce4df8-04c8-4992-9306-22ca73b3e744', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6800', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6801', 'nonce': 3440150315}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6802', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6803', 'nonce': 3440150315}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6806', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6807', 'nonce': 3440150315}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6804', 'nonce': 3440150315}, {'type': 'v1', 'addr': '172.21.15.90:6805', 'nonce': 3440150315}]}, 'public_addr': '172.21.15.90:6801/3440150315', 'cluster_addr': '172.21.15.90:6803/3440150315', 'heartbeat_back_addr': '172.21.15.90:6807/3440150315', 'heartbeat_front_addr': '172.21.15.90:6805/3440150315', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9427eb75-9576-46b8-9123-f40e3ad555fc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 3717183720}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 3717183720}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 3717183720}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 3717183720}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 3717183720}]}, 'public_addr': '172.21.15.187:6801/3717183720', 'cluster_addr': '172.21.15.187:6803/3717183720', 'heartbeat_back_addr': '172.21.15.187:6807/3717183720', 'heartbeat_front_addr': '172.21.15.187:6805/3717183720', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:40.098836+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:39.812954+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-20T20:29:40.075239+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-20T20:30:57.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:30:57.350 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:30:57.350 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:30:57.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:30:57.350 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 72.246163744, 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 72.245518376000007, 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.355 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:30:57.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.359 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.753208473000001, 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:30:57.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:30:57.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.310901592, 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:30:57.364 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:30:57.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:30:57.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:30:57.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.310786972999999, 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:30:57.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:30:57.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:30:57.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:30:57.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.310687690000002, 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.375 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:30:57.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:30:57.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.310626218000003, 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:30:57.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:30:57.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:30:57.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.308474629999999, 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.386 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.387 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.388 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:30:57.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.391 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.305830884999999, 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.301237137000001, 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.397 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.402 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.301116553999996, 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.301044054999998, 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:57.410 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.297700933999998, 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:30:57.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:30:57.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:30:57.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.295366788999999, 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:30:57.418 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.293277474999996, 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:30:57.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.292919363999999, 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.423 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.427 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.292799584999997, 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.431 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.292499313999997, 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:57.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:30:57.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.289987813000003, 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:30:57.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:30:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 62.285538408000001, 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:30:57.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:30:57.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:30:57.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.444 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:30:57.445 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:30:57.445 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:30:57.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:57.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:30:57.446 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:57.346+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:57.449 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:57.444+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:57.549 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:57.546+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:57.573 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:57.573 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:57.573 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:30:57.573 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:57.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:57.650 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:57.646+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:57.695 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:57.695 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:30:57.695 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:30:57.695 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:30:57.695 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:57.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:57.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:30:57.750 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:57.747+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:57.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:30:57.757 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:30:57.772 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-09-20T20:30:57.623172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597740,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":258,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90420,"kb_used_data":1016,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025100,"statfs":{"total":289910292480,"available":289817702400,"internally_reserved":0,"allocated":1040384,"data_stored":1549570,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.601149"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025948+0000","last_change":"2024-09-20T20:29:55.007075+0000","last_active":"2024-09-20T20:30:50.025948+0000","last_peered":"2024-09-20T20:30:50.025948+0000","last_clean":"2024-09-20T20:30:50.025948+0000","last_became_active":"2024-09-20T20:29:55.005105+0000","last_became_peered":"2024-09-20T20:29:55.005105+0000","last_unstale":"2024-09-20T20:30:50.025948+0000","last_undegraded":"2024-09-20T20:30:50.025948+0000","last_fullsized":"2024-09-20T20:30:50.025948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025447+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:30:50.025447+0000","last_peered":"2024-09-20T20:30:50.025447+0000","last_clean":"2024-09-20T20:30:50.025447+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:30:50.025447+0000","last_undegraded":"2024-09-20T20:30:50.025447+0000","last_fullsized":"2024-09-20T20:30:50.025447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026467+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:30:50.026467+0000","last_peered":"2024-09-20T20:30:50.026467+0000","last_clean":"2024-09-20T20:30:50.026467+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:30:50.026467+0000","last_undegraded":"2024-09-20T20:30:50.026467+0000","last_fullsized":"2024-09-20T20:30:50.026467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025177+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:30:50.025177+0000","last_peered":"2024-09-20T20:30:50.025177+0000","last_clean":"2024-09-20T20:30:50.025177+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:30:50.025177+0000","last_undegraded":"2024-09-20T20:30:50.025177+0000","last_fullsized":"2024-09-20T20:30:50.025177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024702+0000","last_change":"2024-09-20T20:29:55.001482+0000","last_active":"2024-09-20T20:30:50.024702+0000","last_peered":"2024-09-20T20:30:50.024702+0000","last_clean":"2024-09-20T20:30:50.024702+0000","last_became_active":"2024-09-20T20:29:55.000290+0000","last_became_peered":"2024-09-20T20:29:55.000290+0000","last_unstale":"2024-09-20T20:30:50.024702+0000","last_undegraded":"2024-09-20T20:30:50.024702+0000","last_fullsized":"2024-09-20T20:30:50.024702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024434+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:30:50.024434+0000","last_peered":"2024-09-20T20:30:50.024434+0000","last_clean":"2024-09-20T20:30:50.024434+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:30:50.024434+0000","last_undegraded":"2024-09-20T20:30:50.024434+0000","last_fullsized":"2024-09-20T20:30:50.024434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024520+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:30:50.024520+0000","last_peered":"2024-09-20T20:30:50.024520+0000","last_clean":"2024-09-20T20:30:50.024520+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:30:50.024520+0000","last_undegraded":"2024-09-20T20:30:50.024520+0000","last_fullsized":"2024-09-20T20:30:50.024520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.023616+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:30:50.023616+0000","last_peered":"2024-09-20T20:30:50.023616+0000","last_clean":"2024-09-20T20:30:50.023616+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:30:50.023616+0000","last_undegraded":"2024-09-20T20:30:50.023616+0000","last_fullsized":"2024-09-20T20:30:50.023616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021462+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:30:50.021462+0000","last_peered":"2024-09-20T20:30:50.021462+0000","last_clean":"2024-09-20T20:30:50.021462+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:30:50.021462+0000","last_undegraded":"2024-09-20T20:30:50.021462+0000","last_fullsized":"2024-09-20T20:30:50.021462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025663+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:30:50.025663+0000","last_peered":"2024-09-20T20:30:50.025663+0000","last_clean":"2024-09-20T20:30:50.025663+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:30:50.025663+0000","last_undegraded":"2024-09-20T20:30:50.025663+0000","last_fullsized":"2024-09-20T20:30:50.025663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026522+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:30:50.026522+0000","last_peered":"2024-09-20T20:30:50.026522+0000","last_clean":"2024-09-20T20:30:50.026522+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:30:50.026522+0000","last_undegraded":"2024-09-20T20:30:50.026522+0000","last_fullsized":"2024-09-20T20:30:50.026522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024898+0000","last_change":"2024-09-20T20:29:55.012467+0000","last_active":"2024-09-20T20:30:50.024898+0000","last_peered":"2024-09-20T20:30:50.024898+0000","last_clean":"2024-09-20T20:30:50.024898+0000","last_became_active":"2024-09-20T20:29:55.011686+0000","last_became_peered":"2024-09-20T20:29:55.011686+0000","last_unstale":"2024-09-20T20:30:50.024898+0000","last_undegraded":"2024-09-20T20:30:50.024898+0000","last_fullsized":"2024-09-20T20:30:50.024898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024391+0000","last_change":"2024-09-20T20:29:55.006208+0000","last_active":"2024-09-20T20:30:50.024391+0000","last_peered":"2024-09-20T20:30:50.024391+0000","last_clean":"2024-09-20T20:30:50.024391+0000","last_became_active":"2024-09-20T20:29:55.002864+0000","last_became_peered":"2024-09-20T20:29:55.002864+0000","last_unstale":"2024-09-20T20:30:50.024391+0000","last_undegraded":"2024-09-20T20:30:50.024391+0000","last_fullsized":"2024-09-20T20:30:50.024391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024689+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:30:50.024689+0000","last_peered":"2024-09-20T20:30:50.024689+0000","last_clean":"2024-09-20T20:30:50.024689+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:30:50.024689+0000","last_undegraded":"2024-09-20T20:30:50.024689+0000","last_fullsized":"2024-09-20T20:30:50.024689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024527+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:30:50.024527+0000","last_peered":"2024-09-20T20:30:50.024527+0000","last_clean":"2024-09-20T20:30:50.024527+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:30:50.024527+0000","last_undegraded":"2024-09-20T20:30:50.024527+0000","last_fullsized":"2024-09-20T20:30:50.024527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.023665+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:30:50.023665+0000","last_peered":"2024-09-20T20:30:50.023665+0000","last_clean":"2024-09-20T20:30:50.023665+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:30:50.023665+0000","last_undegraded":"2024-09-20T20:30:50.023665+0000","last_fullsized":"2024-09-20T20:30:50.023665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021776+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:30:50.021776+0000","last_peered":"2024-09-20T20:30:50.021776+0000","last_clean":"2024-09-20T20:30:50.021776+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:30:50.021776+0000","last_undegraded":"2024-09-20T20:30:50.021776+0000","last_fullsized":"2024-09-20T20:30:50.021776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025897+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:30:50.025897+0000","last_peered":"2024-09-20T20:30:50.025897+0000","last_clean":"2024-09-20T20:30:50.025897+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:30:50.025897+0000","last_undegraded":"2024-09-20T20:30:50.025897+0000","last_fullsized":"2024-09-20T20:30:50.025897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021360+0000","last_change":"2024-09-20T20:29:54.999350+0000","last_active":"2024-09-20T20:30:50.021360+0000","last_peered":"2024-09-20T20:30:50.021360+0000","last_clean":"2024-09-20T20:30:50.021360+0000","last_became_active":"2024-09-20T20:29:54.998741+0000","last_became_peered":"2024-09-20T20:29:54.998741+0000","last_unstale":"2024-09-20T20:30:50.021360+0000","last_undegraded":"2024-09-20T20:30:50.021360+0000","last_fullsized":"2024-09-20T20:30:50.021360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025452+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:30:50.025452+0000","last_peered":"2024-09-20T20:30:50.025452+0000","last_clean":"2024-09-20T20:30:50.025452+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:30:50.025452+0000","last_undegraded":"2024-09-20T20:30:50.025452+0000","last_fullsized":"2024-09-20T20:30:50.025452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025196+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:30:50.025196+0000","last_peered":"2024-09-20T20:30:50.025196+0000","last_clean":"2024-09-20T20:30:50.025196+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:30:50.025196+0000","last_undegraded":"2024-09-20T20:30:50.025196+0000","last_fullsized":"2024-09-20T20:30:50.025196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024194+0000","last_change":"2024-09-20T20:29:55.015082+0000","last_active":"2024-09-20T20:30:50.024194+0000","last_peered":"2024-09-20T20:30:50.024194+0000","last_clean":"2024-09-20T20:30:50.024194+0000","last_became_active":"2024-09-20T20:29:55.012708+0000","last_became_peered":"2024-09-20T20:29:55.012708+0000","last_unstale":"2024-09-20T20:30:50.024194+0000","last_undegraded":"2024-09-20T20:30:50.024194+0000","last_fullsized":"2024-09-20T20:30:50.024194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:24.045731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020079+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:30:50.020079+0000","last_peered":"2024-09-20T20:30:50.020079+0000","last_clean":"2024-09-20T20:30:50.020079+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:30:50.020079+0000","last_undegraded":"2024-09-20T20:30:50.020079+0000","last_fullsized":"2024-09-20T20:30:50.020079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.023911+0000","last_change":"2024-09-20T20:29:55.002784+0000","last_active":"2024-09-20T20:30:50.023911+0000","last_peered":"2024-09-20T20:30:50.023911+0000","last_clean":"2024-09-20T20:30:50.023911+0000","last_became_active":"2024-09-20T20:29:55.001575+0000","last_became_peered":"2024-09-20T20:29:55.001575+0000","last_unstale":"2024-09-20T20:30:50.023911+0000","last_undegraded":"2024-09-20T20:30:50.023911+0000","last_fullsized":"2024-09-20T20:30:50.023911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:45.086905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026031+0000","last_change":"2024-09-20T20:29:55.014653+0000","last_active":"2024-09-20T20:30:50.026031+0000","last_peered":"2024-09-20T20:30:50.026031+0000","last_clean":"2024-09-20T20:30:50.026031+0000","last_became_active":"2024-09-20T20:29:55.013806+0000","last_became_peered":"2024-09-20T20:29:55.013806+0000","last_unstale":"2024-09-20T20:30:50.026031+0000","last_undegraded":"2024-09-20T20:30:50.026031+0000","last_fullsized":"2024-09-20T20:30:50.026031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021955+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:30:50.021955+0000","last_peered":"2024-09-20T20:30:50.021955+0000","last_clean":"2024-09-20T20:30:50.021955+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:30:50.021955+0000","last_undegraded":"2024-09-20T20:30:50.021955+0000","last_fullsized":"2024-09-20T20:30:50.021955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026736+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:30:50.026736+0000","last_peered":"2024-09-20T20:30:50.026736+0000","last_clean":"2024-09-20T20:30:50.026736+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:30:50.026736+0000","last_undegraded":"2024-09-20T20:30:50.026736+0000","last_fullsized":"2024-09-20T20:30:50.026736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025373+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:30:50.025373+0000","last_peered":"2024-09-20T20:30:50.025373+0000","last_clean":"2024-09-20T20:30:50.025373+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:30:50.025373+0000","last_undegraded":"2024-09-20T20:30:50.025373+0000","last_fullsized":"2024-09-20T20:30:50.025373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021085+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:30:50.021085+0000","last_peered":"2024-09-20T20:30:50.021085+0000","last_clean":"2024-09-20T20:30:50.021085+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:30:50.021085+0000","last_undegraded":"2024-09-20T20:30:50.021085+0000","last_fullsized":"2024-09-20T20:30:50.021085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024503+0000","last_change":"2024-09-20T20:29:55.014505+0000","last_active":"2024-09-20T20:30:50.024503+0000","last_peered":"2024-09-20T20:30:50.024503+0000","last_clean":"2024-09-20T20:30:50.024503+0000","last_became_active":"2024-09-20T20:29:55.012721+0000","last_became_peered":"2024-09-20T20:29:55.012721+0000","last_unstale":"2024-09-20T20:30:50.024503+0000","last_undegraded":"2024-09-20T20:30:50.024503+0000","last_fullsized":"2024-09-20T20:30:50.024503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020129+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:30:50.020129+0000","last_peered":"2024-09-20T20:30:50.020129+0000","last_clean":"2024-09-20T20:30:50.020129+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:30:50.020129+0000","last_undegraded":"2024-09-20T20:30:50.020129+0000","last_fullsized":"2024-09-20T20:30:50.020129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.023880+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:30:50.023880+0000","last_peered":"2024-09-20T20:30:50.023880+0000","last_clean":"2024-09-20T20:30:50.023880+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:30:50.023880+0000","last_undegraded":"2024-09-20T20:30:50.023880+0000","last_fullsized":"2024-09-20T20:30:50.023880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025272+0000","last_change":"2024-09-20T20:29:55.001960+0000","last_active":"2024-09-20T20:30:50.025272+0000","last_peered":"2024-09-20T20:30:50.025272+0000","last_clean":"2024-09-20T20:30:50.025272+0000","last_became_active":"2024-09-20T20:29:55.001033+0000","last_became_peered":"2024-09-20T20:29:55.001033+0000","last_unstale":"2024-09-20T20:30:50.025272+0000","last_undegraded":"2024-09-20T20:30:50.025272+0000","last_fullsized":"2024-09-20T20:30:50.025272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025428+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:30:50.025428+0000","last_peered":"2024-09-20T20:30:50.025428+0000","last_clean":"2024-09-20T20:30:50.025428+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:30:50.025428+0000","last_undegraded":"2024-09-20T20:30:50.025428+0000","last_fullsized":"2024-09-20T20:30:50.025428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025413+0000","last_change":"2024-09-20T20:29:55.006411+0000","last_active":"2024-09-20T20:30:50.025413+0000","last_peered":"2024-09-20T20:30:50.025413+0000","last_clean":"2024-09-20T20:30:50.025413+0000","last_became_active":"2024-09-20T20:29:55.004960+0000","last_became_peered":"2024-09-20T20:29:55.004960+0000","last_unstale":"2024-09-20T20:30:50.025413+0000","last_undegraded":"2024-09-20T20:30:50.025413+0000","last_fullsized":"2024-09-20T20:30:50.025413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020723+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:30:50.020723+0000","last_peered":"2024-09-20T20:30:50.020723+0000","last_clean":"2024-09-20T20:30:50.020723+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:30:50.020723+0000","last_undegraded":"2024-09-20T20:30:50.020723+0000","last_fullsized":"2024-09-20T20:30:50.020723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.022395+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:30:50.022395+0000","last_peered":"2024-09-20T20:30:50.022395+0000","last_clean":"2024-09-20T20:30:50.022395+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:30:50.022395+0000","last_undegraded":"2024-09-20T20:30:50.022395+0000","last_fullsized":"2024-09-20T20:30:50.022395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024277+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:30:50.024277+0000","last_peered":"2024-09-20T20:30:50.024277+0000","last_clean":"2024-09-20T20:30:50.024277+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:30:50.024277+0000","last_undegraded":"2024-09-20T20:30:50.024277+0000","last_fullsized":"2024-09-20T20:30:50.024277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021513+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:30:50.021513+0000","last_peered":"2024-09-20T20:30:50.021513+0000","last_clean":"2024-09-20T20:30:50.021513+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:30:50.021513+0000","last_undegraded":"2024-09-20T20:30:50.021513+0000","last_fullsized":"2024-09-20T20:30:50.021513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.023968+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:30:50.023968+0000","last_peered":"2024-09-20T20:30:50.023968+0000","last_clean":"2024-09-20T20:30:50.023968+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:30:50.023968+0000","last_undegraded":"2024-09-20T20:30:50.023968+0000","last_fullsized":"2024-09-20T20:30:50.023968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026205+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:30:50.026205+0000","last_peered":"2024-09-20T20:30:50.026205+0000","last_clean":"2024-09-20T20:30:50.026205+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:30:50.026205+0000","last_undegraded":"2024-09-20T20:30:50.026205+0000","last_fullsized":"2024-09-20T20:30:50.026205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.023911+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:30:50.023911+0000","last_peered":"2024-09-20T20:30:50.023911+0000","last_clean":"2024-09-20T20:30:50.023911+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:30:50.023911+0000","last_undegraded":"2024-09-20T20:30:50.023911+0000","last_fullsized":"2024-09-20T20:30:50.023911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026147+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:30:50.026147+0000","last_peered":"2024-09-20T20:30:50.026147+0000","last_clean":"2024-09-20T20:30:50.026147+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:30:50.026147+0000","last_undegraded":"2024-09-20T20:30:50.026147+0000","last_fullsized":"2024-09-20T20:30:50.026147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.023982+0000","last_change":"2024-09-20T20:29:55.006455+0000","last_active":"2024-09-20T20:30:50.023982+0000","last_peered":"2024-09-20T20:30:50.023982+0000","last_clean":"2024-09-20T20:30:50.023982+0000","last_became_active":"2024-09-20T20:29:55.004010+0000","last_became_peered":"2024-09-20T20:29:55.004010+0000","last_unstale":"2024-09-20T20:30:50.023982+0000","last_undegraded":"2024-09-20T20:30:50.023982+0000","last_fullsized":"2024-09-20T20:30:50.023982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:20.842224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026966+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:30:50.026966+0000","last_peered":"2024-09-20T20:30:50.026966+0000","last_clean":"2024-09-20T20:30:50.026966+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:30:50.026966+0000","last_undegraded":"2024-09-20T20:30:50.026966+0000","last_fullsized":"2024-09-20T20:30:50.026966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024933+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:30:50.024933+0000","last_peered":"2024-09-20T20:30:50.024933+0000","last_clean":"2024-09-20T20:30:50.024933+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:30:50.024933+0000","last_undegraded":"2024-09-20T20:30:50.024933+0000","last_fullsized":"2024-09-20T20:30:50.024933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026330+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:30:50.026330+0000","last_peered":"2024-09-20T20:30:50.026330+0000","last_clean":"2024-09-20T20:30:50.026330+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:30:50.026330+0000","last_undegraded":"2024-09-20T20:30:50.026330+0000","last_fullsized":"2024-09-20T20:30:50.026330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021227+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:30:50.021227+0000","last_peered":"2024-09-20T20:30:50.021227+0000","last_clean":"2024-09-20T20:30:50.021227+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:30:50.021227+0000","last_undegraded":"2024-09-20T20:30:50.021227+0000","last_fullsized":"2024-09-20T20:30:50.021227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021508+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:30:50.021508+0000","last_peered":"2024-09-20T20:30:50.021508+0000","last_clean":"2024-09-20T20:30:50.021508+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:30:50.021508+0000","last_undegraded":"2024-09-20T20:30:50.021508+0000","last_fullsized":"2024-09-20T20:30:50.021508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025716+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:30:50.025716+0000","last_peered":"2024-09-20T20:30:50.025716+0000","last_clean":"2024-09-20T20:30:50.025716+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:30:50.025716+0000","last_undegraded":"2024-09-20T20:30:50.025716+0000","last_fullsized":"2024-09-20T20:30:50.025716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025570+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:30:50.025570+0000","last_peered":"2024-09-20T20:30:50.025570+0000","last_clean":"2024-09-20T20:30:50.025570+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:30:50.025570+0000","last_undegraded":"2024-09-20T20:30:50.025570+0000","last_fullsized":"2024-09-20T20:30:50.025570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026811+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:30:50.026811+0000","last_peered":"2024-09-20T20:30:50.026811+0000","last_clean":"2024-09-20T20:30:50.026811+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:30:50.026811+0000","last_undegraded":"2024-09-20T20:30:50.026811+0000","last_fullsized":"2024-09-20T20:30:50.026811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024464+0000","last_change":"2024-09-20T20:29:54.001861+0000","last_active":"2024-09-20T20:30:50.024464+0000","last_peered":"2024-09-20T20:30:50.024464+0000","last_clean":"2024-09-20T20:30:50.024464+0000","last_became_active":"2024-09-20T20:29:54.000965+0000","last_became_peered":"2024-09-20T20:29:54.000965+0000","last_unstale":"2024-09-20T20:30:50.024464+0000","last_undegraded":"2024-09-20T20:30:50.024464+0000","last_fullsized":"2024-09-20T20:30:50.024464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:28.103332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025295+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:30:50.025295+0000","last_peered":"2024-09-20T20:30:50.025295+0000","last_clean":"2024-09-20T20:30:50.025295+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:30:50.025295+0000","last_undegraded":"2024-09-20T20:30:50.025295+0000","last_fullsized":"2024-09-20T20:30:50.025295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024291+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:30:50.024291+0000","last_peered":"2024-09-20T20:30:50.024291+0000","last_clean":"2024-09-20T20:30:50.024291+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:30:50.024291+0000","last_undegraded":"2024-09-20T20:30:50.024291+0000","last_fullsized":"2024-09-20T20:30:50.024291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021576+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:30:50.021576+0000","last_peered":"2024-09-20T20:30:50.021576+0000","last_clean":"2024-09-20T20:30:50.021576+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:30:50.021576+0000","last_undegraded":"2024-09-20T20:30:50.021576+0000","last_fullsized":"2024-09-20T20:30:50.021576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":252,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024420+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:30:50.024420+0000","last_peered":"2024-09-20T20:30:50.024420+0000","last_clean":"2024-09-20T20:30:50.024420+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:30:50.024420+0000","last_undegraded":"2024-09-20T20:30:50.024420+0000","last_fullsized":"2024-09-20T20:30:50.024420+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025936+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:30:50.025936+0000","last_peered":"2024-09-20T20:30:50.025936+0000","last_clean":"2024-09-20T20:30:50.025936+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:30:50.025936+0000","last_undegraded":"2024-09-20T20:30:50.025936+0000","last_fullsized":"2024-09-20T20:30:50.025936+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020862+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:30:50.020862+0000","last_peered":"2024-09-20T20:30:50.020862+0000","last_clean":"2024-09-20T20:30:50.020862+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:30:50.020862+0000","last_undegraded":"2024-09-20T20:30:50.020862+0000","last_fullsized":"2024-09-20T20:30:50.020862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026969+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:30:50.026969+0000","last_peered":"2024-09-20T20:30:50.026969+0000","last_clean":"2024-09-20T20:30:50.026969+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:30:50.026969+0000","last_undegraded":"2024-09-20T20:30:50.026969+0000","last_fullsized":"2024-09-20T20:30:50.026969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024252+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:30:50.024252+0000","last_peered":"2024-09-20T20:30:50.024252+0000","last_clean":"2024-09-20T20:30:50.024252+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:30:50.024252+0000","last_undegraded":"2024-09-20T20:30:50.024252+0000","last_fullsized":"2024-09-20T20:30:50.024252+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020361+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:30:50.020361+0000","last_peered":"2024-09-20T20:30:50.020361+0000","last_clean":"2024-09-20T20:30:50.020361+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:30:50.020361+0000","last_undegraded":"2024-09-20T20:30:50.020361+0000","last_fullsized":"2024-09-20T20:30:50.020361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026141+0000","last_change":"2024-09-20T20:29:55.007379+0000","last_active":"2024-09-20T20:30:50.026141+0000","last_peered":"2024-09-20T20:30:50.026141+0000","last_clean":"2024-09-20T20:30:50.026141+0000","last_became_active":"2024-09-20T20:29:55.005006+0000","last_became_peered":"2024-09-20T20:29:55.005006+0000","last_unstale":"2024-09-20T20:30:50.026141+0000","last_undegraded":"2024-09-20T20:30:50.026141+0000","last_fullsized":"2024-09-20T20:30:50.026141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020477+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:30:50.020477+0000","last_peered":"2024-09-20T20:30:50.020477+0000","last_clean":"2024-09-20T20:30:50.020477+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:30:50.020477+0000","last_undegraded":"2024-09-20T20:30:50.020477+0000","last_fullsized":"2024-09-20T20:30:50.020477+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024430+0000","last_change":"2024-09-20T20:29:54.000434+0000","last_active":"2024-09-20T20:30:50.024430+0000","last_peered":"2024-09-20T20:30:50.024430+0000","last_clean":"2024-09-20T20:30:50.024430+0000","last_became_active":"2024-09-20T20:29:53.999658+0000","last_became_peered":"2024-09-20T20:29:53.999658+0000","last_unstale":"2024-09-20T20:30:50.024430+0000","last_undegraded":"2024-09-20T20:30:50.024430+0000","last_fullsized":"2024-09-20T20:30:50.024430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:31.923210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021627+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:30:50.021627+0000","last_peered":"2024-09-20T20:30:50.021627+0000","last_clean":"2024-09-20T20:30:50.021627+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:30:50.021627+0000","last_undegraded":"2024-09-20T20:30:50.021627+0000","last_fullsized":"2024-09-20T20:30:50.021627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025890+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:30:50.025890+0000","last_peered":"2024-09-20T20:30:50.025890+0000","last_clean":"2024-09-20T20:30:50.025890+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:30:50.025890+0000","last_undegraded":"2024-09-20T20:30:50.025890+0000","last_fullsized":"2024-09-20T20:30:50.025890+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025672+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:30:50.025672+0000","last_peered":"2024-09-20T20:30:50.025672+0000","last_clean":"2024-09-20T20:30:50.025672+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:30:50.025672+0000","last_undegraded":"2024-09-20T20:30:50.025672+0000","last_fullsized":"2024-09-20T20:30:50.025672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021222+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:30:50.021222+0000","last_peered":"2024-09-20T20:30:50.021222+0000","last_clean":"2024-09-20T20:30:50.021222+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:30:50.021222+0000","last_undegraded":"2024-09-20T20:30:50.021222+0000","last_fullsized":"2024-09-20T20:30:50.021222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.027104+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:30:50.027104+0000","last_peered":"2024-09-20T20:30:50.027104+0000","last_clean":"2024-09-20T20:30:50.027104+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:30:50.027104+0000","last_undegraded":"2024-09-20T20:30:50.027104+0000","last_fullsized":"2024-09-20T20:30:50.027104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021363+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:30:50.021363+0000","last_peered":"2024-09-20T20:30:50.021363+0000","last_clean":"2024-09-20T20:30:50.021363+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:30:50.021363+0000","last_undegraded":"2024-09-20T20:30:50.021363+0000","last_fullsized":"2024-09-20T20:30:50.021363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024416+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:30:50.024416+0000","last_peered":"2024-09-20T20:30:50.024416+0000","last_clean":"2024-09-20T20:30:50.024416+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:30:50.024416+0000","last_undegraded":"2024-09-20T20:30:50.024416+0000","last_fullsized":"2024-09-20T20:30:50.024416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021247+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:30:50.021247+0000","last_peered":"2024-09-20T20:30:50.021247+0000","last_clean":"2024-09-20T20:30:50.021247+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:30:50.021247+0000","last_undegraded":"2024-09-20T20:30:50.021247+0000","last_fullsized":"2024-09-20T20:30:50.021247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026499+0000","last_change":"2024-09-20T20:29:51.834038+0000","last_active":"2024-09-20T20:30:50.026499+0000","last_peered":"2024-09-20T20:30:50.026499+0000","last_clean":"2024-09-20T20:30:50.026499+0000","last_became_active":"2024-09-20T20:29:49.815409+0000","last_became_peered":"2024-09-20T20:29:49.815409+0000","last_unstale":"2024-09-20T20:30:50.026499+0000","last_undegraded":"2024-09-20T20:30:50.026499+0000","last_fullsized":"2024-09-20T20:30:50.026499+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:30.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082766700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025123+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:30:50.025123+0000","last_peered":"2024-09-20T20:30:50.025123+0000","last_clean":"2024-09-20T20:30:50.025123+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:30:50.025123+0000","last_undegraded":"2024-09-20T20:30:50.025123+0000","last_fullsized":"2024-09-20T20:30:50.025123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021848+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:30:50.021848+0000","last_peered":"2024-09-20T20:30:50.021848+0000","last_clean":"2024-09-20T20:30:50.021848+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:30:50.021848+0000","last_undegraded":"2024-09-20T20:30:50.021848+0000","last_fullsized":"2024-09-20T20:30:50.021848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.022604+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:30:50.022604+0000","last_peered":"2024-09-20T20:30:50.022604+0000","last_clean":"2024-09-20T20:30:50.022604+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:30:50.022604+0000","last_undegraded":"2024-09-20T20:30:50.022604+0000","last_fullsized":"2024-09-20T20:30:50.022604+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020293+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:30:50.020293+0000","last_peered":"2024-09-20T20:30:50.020293+0000","last_clean":"2024-09-20T20:30:50.020293+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:30:50.020293+0000","last_undegraded":"2024-09-20T20:30:50.020293+0000","last_fullsized":"2024-09-20T20:30:50.020293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.022531+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:30:50.022531+0000","last_peered":"2024-09-20T20:30:50.022531+0000","last_clean":"2024-09-20T20:30:50.022531+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:30:50.022531+0000","last_undegraded":"2024-09-20T20:30:50.022531+0000","last_fullsized":"2024-09-20T20:30:50.022531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026398+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:30:50.026398+0000","last_peered":"2024-09-20T20:30:50.026398+0000","last_clean":"2024-09-20T20:30:50.026398+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:30:50.026398+0000","last_undegraded":"2024-09-20T20:30:50.026398+0000","last_fullsized":"2024-09-20T20:30:50.026398+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024035+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:30:50.024035+0000","last_peered":"2024-09-20T20:30:50.024035+0000","last_clean":"2024-09-20T20:30:50.024035+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:30:50.024035+0000","last_undegraded":"2024-09-20T20:30:50.024035+0000","last_fullsized":"2024-09-20T20:30:50.024035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024788+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:30:50.024788+0000","last_peered":"2024-09-20T20:30:50.024788+0000","last_clean":"2024-09-20T20:30:50.024788+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:30:50.024788+0000","last_undegraded":"2024-09-20T20:30:50.024788+0000","last_fullsized":"2024-09-20T20:30:50.024788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'10","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026217+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:30:50.026217+0000","last_peered":"2024-09-20T20:30:50.026217+0000","last_clean":"2024-09-20T20:30:50.026217+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:30:50.026217+0000","last_undegraded":"2024-09-20T20:30:50.026217+0000","last_fullsized":"2024-09-20T20:30:50.026217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020610+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:30:50.020610+0000","last_peered":"2024-09-20T20:30:50.020610+0000","last_clean":"2024-09-20T20:30:50.020610+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:30:50.020610+0000","last_undegraded":"2024-09-20T20:30:50.020610+0000","last_fullsized":"2024-09-20T20:30:50.020610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026057+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:30:50.026057+0000","last_peered":"2024-09-20T20:30:50.026057+0000","last_clean":"2024-09-20T20:30:50.026057+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:30:50.026057+0000","last_undegraded":"2024-09-20T20:30:50.026057+0000","last_fullsized":"2024-09-20T20:30:50.026057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025671+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:30:50.025671+0000","last_peered":"2024-09-20T20:30:50.025671+0000","last_clean":"2024-09-20T20:30:50.025671+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:30:50.025671+0000","last_undegraded":"2024-09-20T20:30:50.025671+0000","last_fullsized":"2024-09-20T20:30:50.025671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020226+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:30:50.020226+0000","last_peered":"2024-09-20T20:30:50.020226+0000","last_clean":"2024-09-20T20:30:50.020226+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:30:50.020226+0000","last_undegraded":"2024-09-20T20:30:50.020226+0000","last_fullsized":"2024-09-20T20:30:50.020226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021765+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:30:50.021765+0000","last_peered":"2024-09-20T20:30:50.021765+0000","last_clean":"2024-09-20T20:30:50.021765+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:30:50.021765+0000","last_undegraded":"2024-09-20T20:30:50.021765+0000","last_fullsized":"2024-09-20T20:30:50.021765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020323+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:30:50.020323+0000","last_peered":"2024-09-20T20:30:50.020323+0000","last_clean":"2024-09-20T20:30:50.020323+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:30:50.020323+0000","last_undegraded":"2024-09-20T20:30:50.020323+0000","last_fullsized":"2024-09-20T20:30:50.020323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026194+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:30:50.026194+0000","last_peered":"2024-09-20T20:30:50.026194+0000","last_clean":"2024-09-20T20:30:50.026194+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:30:50.026194+0000","last_undegraded":"2024-09-20T20:30:50.026194+0000","last_fullsized":"2024-09-20T20:30:50.026194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020418+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:30:50.020418+0000","last_peered":"2024-09-20T20:30:50.020418+0000","last_clean":"2024-09-20T20:30:50.020418+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:30:50.020418+0000","last_undegraded":"2024-09-20T20:30:50.020418+0000","last_fullsized":"2024-09-20T20:30:50.020418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.022066+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:30:50.022066+0000","last_peered":"2024-09-20T20:30:50.022066+0000","last_clean":"2024-09-20T20:30:50.022066+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:30:50.022066+0000","last_undegraded":"2024-09-20T20:30:50.022066+0000","last_fullsized":"2024-09-20T20:30:50.022066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.020378+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:30:50.020378+0000","last_peered":"2024-09-20T20:30:50.020378+0000","last_clean":"2024-09-20T20:30:50.020378+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:30:50.020378+0000","last_undegraded":"2024-09-20T20:30:50.020378+0000","last_fullsized":"2024-09-20T20:30:50.020378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025359+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:30:50.025359+0000","last_peered":"2024-09-20T20:30:50.025359+0000","last_clean":"2024-09-20T20:30:50.025359+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:30:50.025359+0000","last_undegraded":"2024-09-20T20:30:50.025359+0000","last_fullsized":"2024-09-20T20:30:50.025359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024898+0000","last_change":"2024-09-20T20:29:53.995769+0000","last_active":"2024-09-20T20:30:50.024898+0000","last_peered":"2024-09-20T20:30:50.024898+0000","last_clean":"2024-09-20T20:30:50.024898+0000","last_became_active":"2024-09-20T20:29:53.994788+0000","last_became_peered":"2024-09-20T20:29:53.994788+0000","last_unstale":"2024-09-20T20:30:50.024898+0000","last_undegraded":"2024-09-20T20:30:50.024898+0000","last_fullsized":"2024-09-20T20:30:50.024898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:58.792966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025003+0000","last_change":"2024-09-20T20:29:55.004166+0000","last_active":"2024-09-20T20:30:50.025003+0000","last_peered":"2024-09-20T20:30:50.025003+0000","last_clean":"2024-09-20T20:30:50.025003+0000","last_became_active":"2024-09-20T20:29:55.002511+0000","last_became_peered":"2024-09-20T20:29:55.002511+0000","last_unstale":"2024-09-20T20:30:50.025003+0000","last_undegraded":"2024-09-20T20:30:50.025003+0000","last_fullsized":"2024-09-20T20:30:50.025003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024952+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:30:50.024952+0000","last_peered":"2024-09-20T20:30:50.024952+0000","last_clean":"2024-09-20T20:30:50.024952+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:30:50.024952+0000","last_undegraded":"2024-09-20T20:30:50.024952+0000","last_fullsized":"2024-09-20T20:30:50.024952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026366+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:30:50.026366+0000","last_peered":"2024-09-20T20:30:50.026366+0000","last_clean":"2024-09-20T20:30:50.026366+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:30:50.026366+0000","last_undegraded":"2024-09-20T20:30:50.026366+0000","last_fullsized":"2024-09-20T20:30:50.026366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.026004+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:30:50.026004+0000","last_peered":"2024-09-20T20:30:50.026004+0000","last_clean":"2024-09-20T20:30:50.026004+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:30:50.026004+0000","last_undegraded":"2024-09-20T20:30:50.026004+0000","last_fullsized":"2024-09-20T20:30:50.026004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025332+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:30:50.025332+0000","last_peered":"2024-09-20T20:30:50.025332+0000","last_clean":"2024-09-20T20:30:50.025332+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:30:50.025332+0000","last_undegraded":"2024-09-20T20:30:50.025332+0000","last_fullsized":"2024-09-20T20:30:50.025332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.025611+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:30:50.025611+0000","last_peered":"2024-09-20T20:30:50.025611+0000","last_clean":"2024-09-20T20:30:50.025611+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:30:50.025611+0000","last_undegraded":"2024-09-20T20:30:50.025611+0000","last_fullsized":"2024-09-20T20:30:50.025611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024568+0000","last_change":"2024-09-20T20:29:55.001408+0000","last_active":"2024-09-20T20:30:50.024568+0000","last_peered":"2024-09-20T20:30:50.024568+0000","last_clean":"2024-09-20T20:30:50.024568+0000","last_became_active":"2024-09-20T20:29:55.000076+0000","last_became_peered":"2024-09-20T20:29:55.000076+0000","last_unstale":"2024-09-20T20:30:50.024568+0000","last_undegraded":"2024-09-20T20:30:50.024568+0000","last_fullsized":"2024-09-20T20:30:50.024568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.022279+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:30:50.022279+0000","last_peered":"2024-09-20T20:30:50.022279+0000","last_clean":"2024-09-20T20:30:50.022279+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:30:50.022279+0000","last_undegraded":"2024-09-20T20:30:50.022279+0000","last_fullsized":"2024-09-20T20:30:50.022279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.024136+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:30:50.024136+0000","last_peered":"2024-09-20T20:30:50.024136+0000","last_clean":"2024-09-20T20:30:50.024136+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:30:50.024136+0000","last_undegraded":"2024-09-20T20:30:50.024136+0000","last_fullsized":"2024-09-20T20:30:50.024136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-20T20:30:50.021651+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:30:50.021651+0000","last_peered":"2024-09-20T20:30:50.021651+0000","last_clean":"2024-09-20T20:30:50.021651+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:30:50.021651+0000","last_undegraded":"2024-09-20T20:30:50.021651+0000","last_fullsized":"2024-09-20T20:30:50.021651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7353,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":118665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":368640,"data_stored":715135,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":715770,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:30:57.776 INFO:tasks.thrashosds.thrasher:Setting 4.2d to [1, 2] 2024-09-20T20:30:57.776 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.2d', '1', '2'] 2024-09-20T20:30:57.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.2d 1 2 2024-09-20T20:30:57.829 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.010286590000007, 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:57.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:57.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:30:57.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834685847999999, 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:30:57.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:30:57.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834597989000002, 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.841 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834556659, 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:30:57.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:30:57.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834487512999999, 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:30:57.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:30:57.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:57.857 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834437229999999, 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834402124, 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834350456999999, 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.868 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:30:57.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834273488000001, 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:30:57.872 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:30:57.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.834221122000002, 2024-09-20T20:30:57.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:30:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.821651097999997, 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:30:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.821559778999998, 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.821472, 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:30:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.820612009999998, 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.816026532000002, 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:30:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.815957386000001, 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.811450172000001, 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:30:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:30:57.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 60.845130851999997, 2024-09-20T20:30:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:30:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.914 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.842790119, 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:57.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:30:57.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.842287519000003, 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:30:57.920 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:30:57.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:30:57.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:30:57.925 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:30:57.926 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:30:57.927 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:30:57.927 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:57.924+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:57.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:57.938 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:30:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:30:57.973 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:30:57.973 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:30:58.027 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:58.027+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:58.060 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:58.060 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:58.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:58.129 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:58.124+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:58.197 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:58.197 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:58.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:58.229 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:58.227+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:58.330 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:58.327+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:58.331 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:58.331 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:58.345 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:58.431 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:58.428+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:58.435 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:30:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:set 4.2d pg_upmap mapping to [1,2] 2024-09-20T20:30:58.479 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:58.479 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:58.495 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:58.532 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:58.530+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:58.615 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:58.615 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:58.631 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:30:58.632 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:58.627+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:58.733 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:58.726+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:58.755 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:58.755 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:58.769 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:30:58.834 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:58.831+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:58.898 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:58.898 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:58.911 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:30:58.955 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:30:58.952+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:30:59.024 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:59.024 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:59.035 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:59.034+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:59.037 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:30:59.137 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:59.131+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:59.199 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:59.199 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:59.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:30:59.262 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:30:59.258+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:30:59.338 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:59.335+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:59.347 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:59.347 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:59.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:30:59.439 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:59.439+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:59.529 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:59.529 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:59.541 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:59.539+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:59.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:30:59.641 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:59.639+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:59.659 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:59.659 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:59.673 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:30:59.742 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:59.739+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:59.804 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:59.804 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:59.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:30:59.862 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:59.859+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:59.944 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:30:59.939+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:30:59.988 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:30:59.988 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:30:59.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:00.004 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:00.045 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:00.042+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:00.145 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:00.140+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:00.167 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:00.167 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:00.181 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:00.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:00.188 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:00.219 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:00.219 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:00.246 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:00.240+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:00.250 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:00.251 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:00.308 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:00.309 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:00.323 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:00.347 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:00.343+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:00.447 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:00.443+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:00.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:31:00.494 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:00.494 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:00.494 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:00.494 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:00.494 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:00.508 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:00.548 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:00.546+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:00.632 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:00.632 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:00.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.814960356, 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:00.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.639359614, 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.637 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:00.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.639271754999996, 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.643 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:00.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:00.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:00.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:00.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:00.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.639230424999994, 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.649 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.654 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.639161279000007, 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.659 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.639110995999999, 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.639075890000001, 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:00.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:00.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:00.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:00.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.671 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.639024223000007, 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:00.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:00.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:00.676 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.676 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.676 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.677 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.677 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:00.677 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.638947254000001, 2024-09-20T20:31:00.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:00.677 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.677 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.677 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:00.677 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:00.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:00.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.638894887999996, 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:00.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.626324863999997, 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.626233545000005, 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.689 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:00.693 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.626145765999993, 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:00.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.625285775999998, 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.698 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.702 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.620700298000003, 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:00.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:31:00.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:31:00.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.620631152000001, 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:31:00.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:31:00.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.616123938000001, 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:31:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:31:00.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 63.649804617999997, 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.714 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:31:00.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:31:00.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.647463885000001, 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.719 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:31:00.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:31:00.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.724 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 38.646961285000003, 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:31:00.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:31:00.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:31:00.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:00.732 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:00.728+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:00.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:00.832 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:00.826+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:00.865 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:00.865 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:00.865 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:00.865 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:00.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:00.933 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:00.928+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:01.034 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:01.032+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:01.038 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:01.039 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:01.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:01.135 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:01.131+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:01.177 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.635295443999993, 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:31:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:31:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.186977686999995, 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.186600733000006, 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.186496691000002, 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.185395451999995, 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.185304795999997, 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:01.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.185232323999998, 2024-09-20T20:31:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.185170177000003, 2024-09-20T20:31:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.185107427999995, 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.184998884999999, 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.184933599000004, 2024-09-20T20:31:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.184871700000002, 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:01.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.182683929999996, 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:01.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:01.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:01.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:01.255 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.182585927000005, 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:01.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.181524598999999, 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.181082129000004, 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:01.266 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:01.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.180205185999995, 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:01.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:01.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.180115736999994, 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.277 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:01.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.180049474, 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:01.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:01.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:01.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.178536171999994, 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:01.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:01.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:01.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:01.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:01.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:01.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.292 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:01.292 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:01.292 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:01.293 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:01.294 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:01.287+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:01.395 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:01.390+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:01.427 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:01.427 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:01.427 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:01.427 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:01.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:01.452 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:31:01.495 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:01.490+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:01.562 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:01.563 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:01.563 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:01.563 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:01.563 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:01.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:01.596 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:01.591+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:01.696 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:01.691+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:01.744 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:01.744 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:01.744 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 76.690327379999999, 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:01.745 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.746 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.747 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.748 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 76.689682012000006, 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.749 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.750 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.751 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.752 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:01.753 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 76.197372109, 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.754 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.755 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.756 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.757 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.755065228000007, 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:01.758 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:31:01.759 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:31:01.760 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:31:01.761 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:31:01.762 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.754950609000005, 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.763 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.764 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.765 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.766 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:31:01.767 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.768 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.754851325999994, 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.769 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.770 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.771 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.772 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:31:01.773 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.754789853999995, 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.774 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:31:01.775 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:01.776 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:31:01.777 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:31:01.778 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.752638266000005, 2024-09-20T20:31:01.779 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.780 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:31:01.781 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:31:01.782 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:31:01.783 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.784 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.749994521000005, 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.785 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.786 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:31:01.787 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:31:01.788 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:31:01.789 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.745400773, 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.790 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.791 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:31:01.792 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:31:01.793 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.794 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:01.795 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.745280190000003, 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.796 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:31:01.797 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.798 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:01.799 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.745207691000005, 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.800 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.801 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.802 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:01.803 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.741864570000004, 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.804 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:31:01.805 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:31:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.739530424999998, 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.808 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:31:01.809 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.810 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.811 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.737441110999995, 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.812 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:31:01.813 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.814 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.815 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.816 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.737082999999998, 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:31:01.818 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.819 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:31:01.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.736963220999996, 2024-09-20T20:31:01.821 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:31:01.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:31:01.824 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:31:01.825 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.736662949999996, 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.826 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.827 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.828 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.829 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.734151448999995, 2024-09-20T20:31:01.830 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.831 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.832 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.832 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.832 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:01.832 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.833 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:31:01.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:31:01.835 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 66.729702044000007, 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:01.836 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.837 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:31:01.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:31:01.839 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:01.840 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:01.841 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:01.842 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:01.843 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:01.838+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:01.943 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:01.942+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:01.976 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:01.976 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:01.976 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:01.976 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:01.991 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:02.044 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:02.042+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:02.114 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:02.114 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:02.114 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:02.114 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:02.114 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:02.128 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:02.144 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:02.142+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:02.247 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:02.246+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 72.429188659000005, 2024-09-20T20:31:02.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:31:02.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:31:02.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:31:02.252 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253587917000004, 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:02.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:02.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:02.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:02.258 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253500058, 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:02.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:02.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253458727999998, 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.264 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253389581999997, 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:02.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:02.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253339299000004, 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253304193000005, 2024-09-20T20:31:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253252525999997, 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:02.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:02.290 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253175557000006, 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:02.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:02.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.253123191, 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.294 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:02.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:02.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:02.298 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.240553167000002, 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:02.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.240461847999995, 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:02.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:02.307 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.240374068999998, 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:02.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:02.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.239514079000003, 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:02.312 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:02.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.234928600999993, 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.317 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:31:02.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.234859455000006, 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:02.325 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 67.230352241000006, 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:31:02.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.264032920999995, 2024-09-20T20:31:02.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:31:02.330 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.330 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.330 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.330 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:02.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:02.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:31:02.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.261692187999998, 2024-09-20T20:31:02.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:31:02.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 40.261189588000001, 2024-09-20T20:31:02.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:31:02.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:31:02.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:31:02.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:02.348 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:02.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:02.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:02.352 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:02.346+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:02.452 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:02.447+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:02.483 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:02.483 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:02.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:02.548 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:02.548 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:02.552 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:02.546+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:02.581 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:02.582 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:02.614 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:02.614 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:02.621 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:02.621 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:02.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:02.653 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:02.647+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:02.753 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:02.751+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:02.803 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:02.803 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:02.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:02.870 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:02.866+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:02.950 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:02.950 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:02.956 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:02.954+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:02.964 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:03.057 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:03.051+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:03.128 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:03.129 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:03.142 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:03.186 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:03.182+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:03.258 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:03.258 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:03.259 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:03.254+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:03.272 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:03.359 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:03.354+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:03.406 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:03.406 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:03.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:03.460 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:03.458+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:03.465 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:31:03.465 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:31:03.466 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-20T20:31:03.466 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:31:03.466 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:31:03.466 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-20T20:31:03.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:31:03.544 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:03.544 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:03.558 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:03.560 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:03.558+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:03.587 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:03.587 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "" 2024-09-20T20:31:03.587 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:03.660 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:03.658+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:03.674 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:03.675 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:03.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:03.762 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:03.755+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:03.820 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:03.820 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:03.834 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:03.862 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:03.855+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:03.952 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:03.952 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:03.963 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:03.959+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:03.966 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:04.065 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:04.063+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:04.083 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:04.083 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:04.097 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:04.166 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:04.162+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:04.228 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:04.228 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:04.242 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:04.286 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:04.282+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:04.363 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:04.363 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:04.368 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:04.366+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:04.377 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:04.460 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:31:04.468 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:04.462+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:04.544 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:04.544 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:04.558 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:04.602 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:04.598+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:04.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:04.670 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:04.663+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:04.694 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:04.695 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:04.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:04.771 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:04.766+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:04.835 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:04.836 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:04.869 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:04.869 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:04.872 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:04.870+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:04.872 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:04.872 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:04.887 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:04.900 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:04.973 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:04.966+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:05.014 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:31:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.194583661999999, 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:31:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018982919999999, 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018895060999995, 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018853730999993, 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018784585000006, 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018734301999999, 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018699196, 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018647529000006, 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018570560000001, 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.018518193999995, 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.005948169999996, 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.005856851000004, 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.071 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.005769072000007, 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:05.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:05.075 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.004909081999998, 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:05.080 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.000323604000002, 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:31:05.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:05.084 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 70.000254458000001, 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 69.995747244, 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.088 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.091 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 68.029427924000004, 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 48.027087191, 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.097 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:31:05.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:31:05.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:31:05.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.026584591000002, 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:05.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:05.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:05.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:05.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:31:05.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:31:05.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:05.109 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:05.111 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:05.107+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:05.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:05.211 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:05.206+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:05.241 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:05.242 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:05.242 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:05.242 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:05.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:05.342 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:05.338+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:05.413 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:05.406+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:05.419 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:05.419 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:05.419 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:05.419 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:05.419 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:05.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:05.514 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:05.507+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:05.605 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:05.605 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:05.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:05.605 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:05.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.062628204000006, 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:31:05.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:31:05.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:31:05.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:05.611 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.614310446999994, 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:05.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.613933493000005, 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:05.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:05.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.613829451000001, 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:05.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.612728211999993, 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:05.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.612637555999996, 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:05.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:05.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.612565083999996, 2024-09-20T20:31:05.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:05.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.612502937000002, 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:05.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:05.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:05.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.612440187999994, 2024-09-20T20:31:05.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:05.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:05.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.612331644999998, 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:05.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.612266359000003, 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:05.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:05.665 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.612204460000001, 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:05.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:05.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.610016689999995, 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:05.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:05.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:05.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:05.676 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.609918687000004, 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:05.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.608857358999998, 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:05.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:05.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:05.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.608414889000002, 2024-09-20T20:31:05.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:05.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.607537945999994, 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:05.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.607448497000007, 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:05.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:05.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.607382233999999, 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:05.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:05.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:05.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.605868932000007, 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:05.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:05.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:05.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:05.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:05.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:05.713 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:05.714 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:05.715 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:05.710+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:05.816 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:05.814+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:05.846 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:05.846 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:05.846 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:05.846 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:05.860 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:05.916 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:05.910+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:05.975 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:05.975 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:05.976 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:05.976 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:05.976 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:05.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:06.034 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:06.030+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:06.119 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:06.118+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:06.150 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 81.096476694000003, 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.151 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:31:06.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:31:06.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 81.095831325999995, 2024-09-20T20:31:06.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.159 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 80.603521423000004, 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:06.160 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.162 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.163 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.161214541999996, 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.164 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:31:06.165 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.169 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.161099922999995, 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.170 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:31:06.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:31:06.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.161000639999997, 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:31:06.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:31:06.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.160939167999999, 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:31:06.180 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:31:06.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.185 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.158787579999995, 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.187 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.189 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.190 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.156143834999995, 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.192 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.193 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.151550087000004, 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.196 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.198 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:06.201 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.151429504000006, 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.202 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:31:06.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:31:06.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.151357004999994, 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:31:06.205 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.148013883999994, 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.209 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.210 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.211 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:06.213 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.145679739000002, 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:06.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:31:06.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:31:06.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.143590424999999, 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.143232314000002, 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.222 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.226 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.143112535, 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:31:06.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:31:06.230 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.142812264, 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:31:06.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.140300762999999, 2024-09-20T20:31:06.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:31:06.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.135851357999996, 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:31:06.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:31:06.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:31:06.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:31:06.244 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.244 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.244 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.244 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:06.244 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:06.244 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:06.245 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:06.246 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:06.243+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:06.347 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:06.346+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:06.377 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:06.377 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:06.377 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:06.377 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:06.392 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:06.448 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:06.446+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:06.487 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:31:06.515 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:06.516 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:06.516 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:06.516 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:06.516 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:06.531 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:06.575 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:06.571+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:06.650 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:06.646+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:06.655 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:06.655 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:06.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:06.655 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:06.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.655 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.836523581999998, 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:31:06.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:31:06.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:31:06.659 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660922839999998, 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:06.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660834980999994, 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:06.665 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:06.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660793651000006, 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:06.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660724505000005, 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.676 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:06.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.681 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660674221999997, 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.686 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660639115999999, 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:06.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:06.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660587449000005, 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.695 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660510479999999, 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:06.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.660458113999994, 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:06.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:06.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:06.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:06.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.647888089999995, 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.704 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:06.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:06.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:06.708 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.647796771000003, 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.647708992000005, 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:06.717 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.646849001999996, 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:06.721 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.642263524000001, 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.642194377999999, 2024-09-20T20:31:06.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:31:06.727 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.728 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.728 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:06.728 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.637687163999999, 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:31:06.735 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 69.671367844000002, 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:31:06.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.669027110999998, 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:31:06.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.668524511000001, 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:06.749 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:31:06.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:31:06.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:06.755 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:06.756 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:06.751+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:06.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:06.857 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:06.851+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:06.888 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:06.889 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:06.903 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:06.922 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:06.958 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:06.954+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:07.021 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:07.022 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:07.022 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:07.022 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:07.022 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:07.036 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:07.059 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:07.055+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:07.118 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:07.118 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:07.151 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:07.156 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:07.156 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:07.160 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:07.154+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:07.170 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:07.183 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:07.183 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:07.261 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:07.255+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:07.300 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:07.300 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:07.316 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:07.362 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:07.358+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:07.432 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:07.432 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:07.445 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:07.474 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:31:07.486 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:07.482+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:07.566 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:07.563+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:07.607 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:07.607 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:07.621 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:07.667 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:07.662+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:07.752 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:07.753 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:07.767 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:07.768 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:07.763+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:07.869 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:07.866+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:07.885 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:07.885 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:07.900 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:07.970 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:07.970+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:08.022 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:08.022 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:08.036 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:08.071 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:08.067+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:08.168 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:08.168 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:08.173 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:08.167+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:08.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:08.273 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:08.270+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:08.305 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:08.305 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:08.319 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:08.374 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:08.374+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:08.443 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:08.443 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:08.456 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:08.498 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:08.498+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:08.576 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:08.570+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:08.586 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:08.586 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:08.600 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:08.603 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:31:08.603 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:31:08.603 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-20T20:31:08.603 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.534677 2024-09-20T20:31:08.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.5346773659333793 2024-09-20T20:31:08.686 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:08.682+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:08.758 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:08.758 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:08.772 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:08.778 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:08.778+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:08.878 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:08.875+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:08.937 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:08.937 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:08.951 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:08.979 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:08.978+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:09.079 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:09.078+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:09.081 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:09.081 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:09.095 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:09.180 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:09.175+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:09.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:09.214 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:09.214 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:09.229 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:09.281 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:09.278+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:09.382 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:09.378+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:09.395 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:09.395 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:09.401 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:09.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:09.434 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:09.434 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:09.466 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:09.466 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:09.483 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:09.482+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:09.484 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.1 primary-affinity to 0.534677 (8350402) 2024-09-20T20:31:09.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:31:09.542 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:09.543 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:09.543 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:09.543 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:09.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:09.598 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:09.598+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:09.685 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:09.682+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:09.719 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:09.719 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:09.719 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:09.719 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:09.719 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:09.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:09.785 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:09.783+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:09.886 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:09.882+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.355729613999998, 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:31:09.898 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:31:09.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:31:09.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.907411857, 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:09.909 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.907034902999996, 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:09.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:09.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.906930861000006, 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:09.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.905829621999999, 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:09.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:09.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.905738966000001, 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:09.926 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:09.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:09.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.905666494000002, 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:09.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:09.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:09.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:09.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.905604346999993, 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:09.937 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:09.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:09.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:09.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.905541597999999, 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:09.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:09.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.905433055000003, 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:09.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:09.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:09.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.905367768999994, 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.954 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:09.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.905305870000007, 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.9031181, 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:09.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:09.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:09.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.903020096999995, 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:09.970 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:09.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.975 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.901958769000004, 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:09.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:09.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:09.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.901516298999994, 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:09.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.900639355999999, 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:09.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.900549906999998, 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:09.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:09.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.900483644000005, 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:09.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:09.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:10.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:10.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:10.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:10.003 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.898970341999998, 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:10.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:10.008 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:10.009 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:10.010 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:10.002+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:10.110 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:10.110+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:10.138 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:10.139 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:10.139 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:10.139 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:10.154 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:10.211 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:10.210+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:10.272 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:10.272 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:10.272 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:10.272 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:10.272 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:10.287 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:10.311 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:10.310+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 85.353951123000002, 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.408 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.412 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 85.353305754999994, 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:31:10.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:31:10.416 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.860995852000002, 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.418688970999995, 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.421 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:31:10.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:31:10.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:31:10.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.426 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.418574351999993, 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:10.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:31:10.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.418475068999996, 2024-09-20T20:31:10.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:31:10.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:31:10.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.418413596999997, 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.438 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:31:10.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.440 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:31:10.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.416262008999993, 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.445 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.446 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:10.446 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.446 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.446 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.446 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.446 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:31:10.446 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.447 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:31:10.448 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:31:10.450 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.413618263999993, 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.451 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:31:10.452 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.409024516000002, 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:31:10.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.459 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:31:10.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:31:10.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.408903933000005, 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:31:10.465 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.408831434000007, 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:31:10.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.405488313000006, 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:31:10.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:10.474 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.403154168, 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:31:10.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.401064853999998, 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:31:10.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:31:10.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.400706743000001, 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:31:10.483 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:31:10.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.487 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.400586963999999, 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:10.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.400286692999998, 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.492 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:31:10.496 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.397775191999997, 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:31:10.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 75.393325786999995, 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:10.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:31:10.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:31:10.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:31:10.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:10.505 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:10.506 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:31:10.507 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:10.508 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:10.506+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:10.607 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:10.603+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:10.637 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:10.637 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:10.637 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:10.637 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:10.651 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:10.739 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:10.735+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:10.808 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:10.803+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:10.817 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:10.818 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:10.818 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:10.818 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:10.818 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:10.832 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:10.919 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:10.915+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:11.003 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:11.003 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:11.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:11.003 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:11.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.003 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:31:11.003 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:11.003 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 81.183718247000002, 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:11.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:11.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:31:11.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:31:11.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.008 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.008117505000001, 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:11.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:11.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.008029645999997, 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:11.015 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:11.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.007988315999995, 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:11.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:11.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.007919169999994, 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:11.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:11.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:11.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.031 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.007868887000001, 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:11.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:11.036 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.007833781000002, 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:11.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:11.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.042 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.007782113999994, 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:11.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:11.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.007705145000003, 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 76.007652778999997, 2024-09-20T20:31:11.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:11.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:11.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:11.054 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.995082754999999, 2024-09-20T20:31:11.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:11.055 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.055 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.055 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.055 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:11.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:11.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.994991436000007, 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.061 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:11.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.994903656999995, 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:11.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:11.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.994043667, 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.070 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.074 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.989458189000004, 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:31:11.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.989389043000003, 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:31:11.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:31:11.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.984881829000003, 2024-09-20T20:31:11.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:31:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.018562509000006, 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.086 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:31:11.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.091 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 54.016221776000002, 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:31:11.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:31:11.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:31:11.097 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.015719175999998, 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:11.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:31:11.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:31:11.102 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.103 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.103 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.103 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:11.103 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:11.103 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:11.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:11.105 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:11.101+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:11.205 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:11.201+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:11.235 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:11.235 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:11.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:11.306 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:11.302+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:11.407 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:11.405+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:11.414 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:11.414 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:11.414 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:11.414 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:11.415 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:11.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:11.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:11.508 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:11.503+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:11.595 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 86.054906880000004, 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:11.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:31:11.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:31:11.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.606589123000006, 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:11.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.606212169000003, 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:11.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:11.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:11.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.606108126999999, 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:11.613 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:11.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:11.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.605006888000005, 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:11.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.604916231999994, 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:11.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:11.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:11.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.604843759999994, 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:11.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:11.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.604781613, 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:11.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:11.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.604718864000006, 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:11.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:11.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:11.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.604610320999996, 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:11.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:11.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:11.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.604545035000001, 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:11.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:11.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:11.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.604483135999999, 2024-09-20T20:31:11.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.662 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.602295366000007, 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:11.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:11.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:11.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.602197363000002, 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:11.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:11.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.601136034999996, 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:11.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:11.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:11.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:11.678 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.600693565, 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:11.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:11.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.599816622000006, 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.599727173000005, 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.599660909999997, 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.598147608000005, 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:11.704 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:11.705 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:11.705 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:11.706 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:11.707 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:11.698+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:11.718 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:11.751 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:11.751 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:11.806 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:11.802+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:11.839 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:11.839 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:11.853 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:11.938 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:11.934+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:12.008 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:12.005+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:12.018 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:12.018 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:12.032 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:12.109 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:12.105+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:12.199 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:12.200 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:12.210 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:12.209+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:12.213 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:12.311 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:12.306+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:12.345 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:12.345 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:12.360 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:12.412 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:12.409+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:12.482 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:12.482 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:12.497 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:12.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:31:12.512 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:12.509+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:12.614 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:12.610+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:12.619 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:12.620 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:12.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:12.714 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:12.711+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:12.768 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:12.768 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:12.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:12.815 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:12.814+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:12.904 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:12.904 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:12.916 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:12.910+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:12.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:13.016 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:13.013+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:13.039 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:13.040 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:13.054 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:13.117 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:13.113+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:13.186 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:13.187 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:13.202 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:13.246 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:13.242+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:13.320 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:13.317+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:13.321 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:13.321 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:13.337 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:13.422 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:13.418+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:13.498 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:31:13.504 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:13.504 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:13.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:13.522 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:13.515+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:13.622 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:13.621+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:13.651 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:13.651 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:13.665 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:13.723 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:13.718+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:13.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:13.782 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:13.782 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:13.797 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:13.847 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:13.843+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:13.919 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:13.920 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:13.925 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:13.919+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:13.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:13.969 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:13.970 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:14.003 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:14.003 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:14.025 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:14.019+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:14.035 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:14.035 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:14.065 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:14.065 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:14.065 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:14.065 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:14.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:14.126 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:14.119+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:14.201 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:14.202 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:14.202 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:14.202 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:14.202 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:14.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:14.227 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:14.223+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:14.328 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:14.323+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:14.341 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:14.341 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.799239126000003, 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:31:14.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:14.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:31:14.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:31:14.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:14.348 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.350921369000005, 2024-09-20T20:31:14.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:14.349 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.349 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.349 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:14.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:14.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:14.356 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.350544415000002, 2024-09-20T20:31:14.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:14.356 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.356 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:14.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:14.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:14.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:14.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.362 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.363 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:14.363 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.350440372999998, 2024-09-20T20:31:14.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:14.363 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.363 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.363 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.363 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:14.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:14.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:14.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:14.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:14.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:14.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:14.370 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.349339134000004, 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:14.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:14.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:14.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.349248478000007, 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:14.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:14.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:14.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:14.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:14.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:14.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:14.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.349176005999993, 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:14.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:14.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:14.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:14.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:14.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:14.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:14.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:14.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:14.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:14.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:14.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:14.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:14.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:14.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:14.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:14.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:14.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.349113858999999, 2024-09-20T20:31:14.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:14.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.349051110000005, 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:14.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:14.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.348942566999995, 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.403 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:14.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:14.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:14.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:14.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:14.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:14.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:14.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.409 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.348877281, 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.410 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:14.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:14.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:14.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.417 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.348815381999998, 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:14.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:14.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.346627612000006, 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:14.423 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:14.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:14.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:14.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:14.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:14.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:14.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:14.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:14.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.346529609000001, 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.431 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:14.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:14.437 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.345468280999995, 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.345025810999999, 2024-09-20T20:31:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.344148868000005, 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.344059419000004, 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.343993155999996, 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.342479854000004, 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:14.472 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:14.474 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:14.474 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:14.469+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:14.510 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:31:14.510 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:31:14.510 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-20T20:31:14.510 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:31:14.511 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:31:14.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-20T20:31:14.575 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:14.571+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:14.608 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:14.608 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:14.608 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:14.609 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:14.624 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:14.644 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:14.644 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "" 2024-09-20T20:31:14.644 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:14.675 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:14.673+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:14.746 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:14.746 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:14.746 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:14.746 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:14.747 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:14.760 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:14.776 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:14.773+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:14.877 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:14.873+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.825320254000005, 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.881 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:14.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:31:14.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.824674885999997, 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.886 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:14.890 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.332364983000005, 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:31:14.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:31:14.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:31:14.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:14.895 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.890058101999998, 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:31:14.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.899 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.889943482999996, 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.901 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.904 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.905 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:14.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:31:14.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:31:14.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:31:14.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:31:14.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.889844199999999, 2024-09-20T20:31:14.908 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:14.909 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.910 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.913 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.889782728, 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.914 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.915 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.915 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.915 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:14.915 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.915 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.915 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:14.916 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.916 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:31:14.917 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:31:14.918 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.918 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.918 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.918 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:31:14.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:14.918 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.918 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:14.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.887631139999996, 2024-09-20T20:31:14.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.923 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:14.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:31:14.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:31:14.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.926 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:31:14.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:31:14.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.928 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.884987394999996, 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:31:14.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:31:14.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.934 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.880393647000005, 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:14.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:14.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:31:14.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.940 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.880273063999994, 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:14.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:31:14.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:31:14.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.880200564999996, 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:31:14.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:31:14.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.876857443999995, 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.949 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.874523299000003, 2024-09-20T20:31:14.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:14.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:31:14.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.957 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.872433985000001, 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:14.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:14.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.872075874000004, 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.963 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:31:14.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.871956095000002, 2024-09-20T20:31:14.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:14.968 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.871655824000001, 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.973 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:31:14.976 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.869144323, 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:31:14.980 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 79.864694917999998, 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:14.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:31:14.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:14.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.984 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:14.985 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:14.987 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:14.987 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:14.979+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:15.087 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:15.083+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:15.118 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:15.118 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:15.118 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:15.118 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:15.132 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:15.219 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:15.215+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:15.290 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:15.286+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:15.296 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:15.296 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:15.296 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:15.296 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:15.296 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:15.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:15.395 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:15.391+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:15.472 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 85.654965249, 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.479364507, 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:15.477 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:15.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:15.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.479276647999995, 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:15.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:15.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.479235317999994, 2024-09-20T20:31:15.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:15.493 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.479166172000006, 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:15.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:15.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:15.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.479115888999999, 2024-09-20T20:31:15.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:15.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.504 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.479080783000001, 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:15.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:15.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:15.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.479029116000007, 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:15.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:15.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:15.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.478952147000001, 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:15.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:15.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:15.517 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.478899780999996, 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:15.521 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.466329756999997, 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.466238438000005, 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.526 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.530 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.466150658999993, 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.534 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.465290668999998, 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:15.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.460705191000002, 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:31:15.539 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:31:15.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.460636045000001, 2024-09-20T20:31:15.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:31:15.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 80.456128831000001, 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:15.547 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 78.489809511000004, 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:15.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 58.487468778, 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.556 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:31:15.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:31:15.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.561 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.486966178000003, 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:15.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:31:15.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:15.567 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:15.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:31:15.569 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:15.566+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:15.570 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:15.670 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:15.666+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:15.701 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:15.701 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:15.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:15.771 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:15.767+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:15.832 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:15.833 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:15.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:15.871 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:15.866+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:15.972 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 90.429456615000007, 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:31:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.981138857999994, 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.980761904000005, 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.980657862000001, 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.979556622999993, 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.979465966999996, 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.979393494999997, 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.979331348000002, 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.979268598999994, 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.979160055999998, 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.979094770000003, 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.979032871000001, 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.976845100999995, 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.976747098000004, 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.975685769999998, 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.975243300000002, 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.974366356999994, 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.974276907999993, 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.974210644999999, 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.972697342999993, 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:16.080 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:16.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:16.082 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:15.967+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:16.082 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:16.083 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:16.078+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:16.183 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:16.179+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:16.214 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:16.215 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:16.215 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:16.215 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:16.226 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:16.226 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:16.228 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:16.243 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:16.263 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:16.263 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:16.283 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:16.278+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:16.352 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:16.352 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:16.368 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:16.410 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:16.406+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:16.486 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:16.483+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:16.536 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:16.537 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:16.552 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:16.587 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:16.585+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:16.685 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:31:16.685 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:16.686 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:16.689 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:16.685+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:16.700 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:16.788 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:16.782+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:16.817 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:16.817 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:16.831 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:16.889 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:16.885+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:16.948 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:16.948 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:16.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:16.990 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:16.986+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:17.091 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:17.089+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:17.092 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:17.092 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:17.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:17.198 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:17.197+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:17.271 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:17.271 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:17.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:17.293 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:17.291+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:17.393 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:17.386+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:17.447 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:17.447 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:17.461 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:17.506 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:17.502+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:17.595 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:17.593+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:17.597 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:17.597 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:17.612 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:17.696 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:17.693+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:17.779 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:17.779 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:17.793 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:17.797 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:17.795+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:17.897 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:17.890+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:17.910 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:17.911 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:17.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:17.999 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:17.997+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:18.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:18.123 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:18.119+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:18.200 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:18.197+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:18.203 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:18.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:18.301 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:18.297+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:18.362 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to 'ed8ee0f26ef720e6504cefa8be1a2d0872192de7'. 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-20T20:31:18.363 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-20T20:31:18.364 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-20T20:31:18.364 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-20T20:31:18.364 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-20T20:31:18.364 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at ed8ee0f26ef Merge pull request #59879 from rhcs-dashboard/test-image 2024-09-20T20:31:18.367 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:18.368 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:18.370 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-20T20:31:18.375 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-20T20:31:18.377 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-20T20:31:18.377 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-20T20:31:18.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:18.402 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:18.395+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:18.420 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:18.440 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:18.459 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:18.503 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:18.501+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:18.514 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:18.515 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:18.515 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:18.515 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:18.529 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:18.604 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:18.598+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:18.690 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:18.690 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:18.690 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:18.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:18.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:31:18.705 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:18.701+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:18.807 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:18.803+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:18.822 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:31:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:18.822 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.281285527999998, 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:31:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.832967771, 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.832590816999996, 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.833 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:18.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:18.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:18.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.832486775000007, 2024-09-20T20:31:18.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.843 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.831385535999999, 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:18.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.831294880000002, 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:18.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:18.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.831222408000002, 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.860 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.831160260999994, 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.831097511999999, 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.830988969000003, 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.830923682999995, 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.830861784000007, 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.828674014000001, 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.828576010999996, 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.827514683000004, 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.827072212999994, 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.826195269999999, 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.826105820999999, 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.826039558000005, 2024-09-20T20:31:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.824526255999999, 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:18.929 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:18.931 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:18.931 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:18.929+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:19.032 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:19.029+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:19.063 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:19.063 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:19.063 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:19.063 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:19.078 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:19.133 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:19.131+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:19.150 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-20T20:31:19.204 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:19.204 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:19.204 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:19.204 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:19.204 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:19.218 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:19.231 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-20T20:31:19.233 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:19.229+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:19.284 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-20T20:31:19.286 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-20T20:31:19.286 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-20T20:31:19.334 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-20T20:31:19.335 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:19.330+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:19.337 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:31:19.338 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-20T20:31:19.339 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:19.339 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:19.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:19.339 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:19.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.339 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:31:19.339 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.282621421000002, 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:31:19.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:31:19.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:31:19.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:31:19.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:31:19.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:31:19.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:31:19.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:31:19.346 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.346 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.346 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:117 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'79, mlcod=10'66)", 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.281976052999994, 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0094129009999999996, 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052340+0000", 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052341+0000", 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052350+0000", 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5359999999999992e-06 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052365+0000", 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4977000000000001e-05 2024-09-20T20:31:19.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.052376+0000", 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.101e-05 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057230+0000", 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048542890000000003 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.057265+0000", 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.519e-05 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061648+0000", 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043828360000000002 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061753+0000", 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000104876 2024-09-20T20:31:19.351 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'126)", 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 93.789666150000002, 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090144370000000001, 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544650+0000", 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544652+0000", 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6670000000000001e-06 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544711+0000", 2024-09-20T20:31:19.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9725000000000002e-05 2024-09-20T20:31:19.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544742+0000", 2024-09-20T20:31:19.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0589999999999997e-05 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.544755+0000", 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.328e-05 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545434+0000", 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00067879500000000005 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.545491+0000", 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7099000000000003e-05 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553567+0000", 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080755879999999999 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.553664+0000", 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7693000000000001e-05 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.347359268999995, 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:31:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:31:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:31:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:31:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.347244649999993, 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:31:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:31:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.347145366999996, 2024-09-20T20:31:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:31:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:31:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:31:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:31:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.347083894999997, 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:31:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.344932306999993, 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.342288561999993, 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:31:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:31:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:31:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.337694814000002, 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:31:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:31:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.337574231000005, 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:31:19.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:31:19.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:31:19.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.337501732000007, 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:31:19.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.406 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.334158611000007, 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:31:19.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:31:19.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:36 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.331824466, 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092276460000000008, 2024-09-20T20:31:19.412 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002492+0000", 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002493+0000", 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.59e-06 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002505+0000", 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2320000000000001e-05 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002530+0000", 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4660000000000001e-05 2024-09-20T20:31:19.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002547+0000", 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7207e-05 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001032952 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003628+0000", 2024-09-20T20:31:19.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8081999999999998e-05 2024-09-20T20:31:19.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011615+0000", 2024-09-20T20:31:19.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079869959999999997 2024-09-20T20:31:19.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.011719+0000", 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010383900000000001 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:19.417 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.329735151999998, 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:19.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.421 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.329377041000001, 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:31:19.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:19.426 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.329257261999999, 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:19.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.431 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:19.431 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:19.431 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.328956990999998, 2024-09-20T20:31:19.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:31:19.431 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.431 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:19.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.435 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.326445489999998, 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:19.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.440 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 84.321996084999995, 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:19.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:19.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:19.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:19.445 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:31:19.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:31:19.445 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.445 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.445 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.445 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:19.445 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:19.446 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:19.450 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:19.445+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:19.452 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:19.453 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-20T20:31:19.454 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-20T20:31:19.454 DEBUG:teuthology.orchestra.run.smithi070:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ed8ee0f26ef720e6504cefa8be1a2d0872192de7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-20T20:31:19.510 INFO:tasks.workunit.client.0.smithi070.stderr:+ mkdir -p fsstress 2024-09-20T20:31:19.512 INFO:tasks.workunit.client.0.smithi070.stderr:+ pushd fsstress 2024-09-20T20:31:19.514 INFO:tasks.workunit.client.0.smithi070.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T20:31:19.514 INFO:tasks.workunit.client.0.smithi070.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-20T20:31:19.548 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:19.546+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:19.587 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:19.587 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:19.587 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:19.588 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:19.601 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:19.649 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:19.643+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:19.661 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:31:19.661 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:31:19.661 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-20T20:31:19.661 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:31:19.661 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:31:19.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-20T20:31:19.712 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:31:19.720 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:19.720 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:19.720 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:19.720 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:19.721 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:19.735 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:19.779 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:19.775+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:19.793 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:19.793 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "" 2024-09-20T20:31:19.793 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:19.850 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:19.846+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:19.904 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4198.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.086960243999997, 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002135114, 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814894+0000", 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:19.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814910+0000", 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5812999999999999e-05 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814932+0000", 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1642999999999999e-05 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.814946+0000", 2024-09-20T20:31:19.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4579999999999999e-05 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815040+0000", 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3554999999999995e-05 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.815092+0000", 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2024000000000002e-05 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.816936+0000", 2024-09-20T20:31:19.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001844119 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:49.817029+0000", 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2670000000000006e-05 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.911359501999996, 2024-09-20T20:31:19.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:19.914 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.911271643000006, 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.911230313000004, 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.911161167000003, 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.911110883999996, 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.911075777999997, 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.911024111000003, 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.910947141999998, 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.910894776000006, 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.898324751999994, 2024-09-20T20:31:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.898233433000001, 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.898145654000004, 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.897285663999995, 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e18/16 ondisk, result = 0)", 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.892700185999999, 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002267622, 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009154+0000", 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009161+0000", 2024-09-20T20:31:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3770000000000001e-06 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009178+0000", 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6963e-05 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009193+0000", 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.535e-05 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.010245+0000", 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001051595 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011011+0000", 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000766071 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011421+0000", 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00041057000000000002 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.892631039999998, 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043784649999999998, 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009223+0000", 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8899999999999998e-07 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009229+0000", 2024-09-20T20:31:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2000000000000002e-06 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009246+0000", 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6837000000000002e-05 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009263+0000", 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6969999999999998e-05 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011518+0000", 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022559429999999998 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013601+0000", 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002082726 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 84.888123825999998, 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036388829999999999, 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013730+0000", 2024-09-20T20:31:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013731+0000", 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5999999999999991e-07 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013748+0000", 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6847e-05 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013787+0000", 2024-09-20T20:31:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9592999999999999e-05 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013825+0000", 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7969999999999997e-05 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013998+0000", 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017289200000000001 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033706209999999999 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 82.921804506000001, 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033909309999999998, 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980049+0000", 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980052+0000", 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7470000000000001e-06 2024-09-20T20:31:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980066+0000", 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3920000000000001e-05 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980099+0000", 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2805999999999997e-05 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980118+0000", 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9539999999999999e-05 2024-09-20T20:31:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980249+0000", 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013034599999999999 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980490+0000", 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024117799999999999 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.980694+0000", 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000203792 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.982025+0000", 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013311029999999999 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983280+0000", 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001255733 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983367+0000", 2024-09-20T20:31:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6426000000000002e-05 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:56.983440+0000", 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3339999999999999e-05 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.919463772999997, 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031042719999999999, 2024-09-20T20:31:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982390+0000", 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982392+0000", 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.446e-06 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982405+0000", 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2574e-05 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982438+0000", 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3113e-05 2024-09-20T20:31:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982456+0000", 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7659000000000002e-05 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982643+0000", 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018743199999999999 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.982794+0000", 2024-09-20T20:31:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000150469 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.983010+0000", 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000216732 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.984338+0000", 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001327363 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985333+0000", 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0009955649999999999 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985426+0000", 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3018999999999998e-05 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:16.985494+0000", 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7899999999999997e-05 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.918961173, 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003005382, 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982893+0000", 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982896+0000", 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9399999999999998e-06 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982913+0000", 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7149000000000001e-05 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982951+0000", 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8340999999999998e-05 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.982978+0000", 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6842000000000002e-05 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983131+0000", 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015325899999999999 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983281+0000", 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015012200000000001 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.983500+0000", 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000219118 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.984719+0000", 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001219014 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985611+0000", 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089128199999999997 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985774+0000", 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016340500000000001 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:30:21.985898+0000", 2024-09-20T20:31:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012391 2024-09-20T20:31:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:19.998 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:20.000 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:19.995+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:20.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:20.100 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:20.095+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:20.131 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:20.131 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:20.131 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:20.131 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:20.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:20.201 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:20.198+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:20.270 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:20.270 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:20.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:20.330 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:20.329+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:20.403 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:20.402+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:20.409 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4167.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 94.869053737000002, 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021711847999999999, 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4167", 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.70:0/3375055735", 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 189 2024-09-20T20:31:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538537+0000", 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538538+0000", 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8599999999999997e-07 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538554+0000", 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6137000000000002e-05 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538565+0000", 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0546e-05 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.538573+0000", 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552770+0000", 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014197253999999999 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.552919+0000", 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014916199999999999 2024-09-20T20:31:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.553111+0000", 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000192115 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.554654+0000", 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001543141 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560117+0000", 2024-09-20T20:31:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054628610000000003 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560193+0000", 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6339000000000002e-05 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:45.560249+0000", 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5909999999999998e-05 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.420735980000003, 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.420359026, 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.420254983999996, 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.419153745000003, 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.419063089000005, 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.418990617000006, 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.418928469999997, 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.418865721000003, 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.418757178000007, 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.418691891999998, 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.418629992999996, 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.416442223000004, 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.416344219999999, 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.415282891999993, 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.414840421999997, 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.413963479000003, 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.413874030000002, 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.413807766999994, 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.412294465000002, 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:20.521 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:20.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:20.524 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:20.524 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:20.519+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:20.624 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:20.618+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:20.657 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:20.657 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:20.658 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:20.658 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:20.665 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xzf ltp-full.tgz 2024-09-20T20:31:20.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:20.685 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:20.685 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:20.707 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:20.707 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:20.734 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:20.734 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:20.758 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:20.754+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:20.825 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:20.821+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:20.850 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:20.850 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:20.864 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:20.950 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:20.946+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:21.028 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:21.025+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:21.041 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:21.041 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:21.056 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:21.129 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:21.123+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:21.194 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:21.194 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:21.210 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:21.231 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:21.229+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:21.332 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:21.329+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:21.378 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:21.379 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:21.394 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:21.443 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:21.439+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:21.526 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:21.526 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:21.533 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:21.527+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:21.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:21.634 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:21.627+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:21.681 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:21.681 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:21.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:21.735 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:21.727+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:21.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:31:21.828 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:21.828 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:21.836 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:21.833+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:21.845 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:21.936 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:21.931+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:22.021 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:22.021 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:22.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:22.037 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:22.031+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:22.137 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:22.130+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:22.172 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:22.172 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:22.187 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:22.238 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:22.231+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:22.339 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:22.334+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:22.360 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:22.361 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:22.375 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:22.466 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:22.462+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:22.542 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:22.541+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:22.544 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:22.544 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:22.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:22.643 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:22.641+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:22.696 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:22.697 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:22.708 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:31:22.712 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:22.744 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:22.738+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:22.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:22.843 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:22.843 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:22.845 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:22.841+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:22.859 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:22.908 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:22.933 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:22.933 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:22.946 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:22.938+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:22.954 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:22.954 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:22.997 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:22.997 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003514554000006, 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:22.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:22.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:23.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:23.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.003 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003426695000002, 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:23.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003385365, 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.009 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:23.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:23.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.014 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003316218999998, 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:23.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:23.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.020 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003265936000005, 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:23.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:23.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003230830000007, 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.026 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:23.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003179162999999, 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:23.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.035 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003102193999993, 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:23.039 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.003049828000002, 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:23.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 87.990479804000003, 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.044 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:23.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.048 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 87.990388484999997, 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:23.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 87.990300705999999, 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:23.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:23.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:23.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 87.989440716000004, 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:23.057 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:23.061 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.3257601409999999, 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.031810205000000001, 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668251+0000", 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1670000000000002e-06 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678059+0000", 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098083630000000005 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678091+0000", 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2264999999999997e-05 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678107+0000", 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5237e-05 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678284+0000", 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017715400000000001 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678614+0000", 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033010199999999998 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678862+0000", 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024798300000000001 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693888+0000", 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015026042 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.699770+0000", 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005881977 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.699932+0000", 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016219300000000001 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.700059+0000", 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012672200000000001 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:10 4.19 4:992a6246:::10000000200.00000000:head [write 0~1162] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678414+0000", 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.3155949439999999, 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0075135330000000002, 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.067 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 10 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678414+0000", 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678414+0000", 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678415+0000", 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678444+0000", 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8223000000000001e-05 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678462+0000", 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8026999999999999e-05 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678474+0000", 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2782999999999999e-05 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678581+0000", 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010642200000000001 2024-09-20T20:31:23.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678769+0000", 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000188087 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.679032+0000", 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026315900000000001 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681473+0000", 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024408910000000002 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.685597+0000", 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0041245049999999997 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.685742+0000", 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000144392 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.685927+0000", 2024-09-20T20:31:23.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000185544 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.3155012849999999, 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015489401999999999, 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:23.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678509+0000", 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1930000000000001e-06 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678531+0000", 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2330000000000001e-05 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678555+0000", 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3643e-05 2024-09-20T20:31:23.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678569+0000", 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4606e-05 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678672+0000", 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010277600000000001 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678920+0000", 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024821899999999999 2024-09-20T20:31:23.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.679469+0000", 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00054898600000000001 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.688799+0000", 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0093301949999999995 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693821+0000", 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211240000000001 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693890+0000", 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9154999999999998e-05 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693997+0000", 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107175 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.078 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.315413436, 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01562446, 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678597+0000", 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2669999999999999e-06 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678605+0000", 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3629999999999994e-06 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678632+0000", 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7382e-05 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678646+0000", 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3869999999999999e-05 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682178+0000", 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003531494 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682531+0000", 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035335800000000001 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682918+0000", 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038688500000000001 2024-09-20T20:31:23.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.688860+0000", 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059416829999999997 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694011+0000", 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051511639999999997 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694101+0000", 2024-09-20T20:31:23.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0092000000000004e-05 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694220+0000", 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011890199999999999 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:23.084 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.3123092619999999, 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012760664999999999, 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 15 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:23.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681703+0000", 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0960000000000001e-06 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681724+0000", 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1605999999999999e-05 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681754+0000", 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9954000000000002e-05 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681773+0000", 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9286000000000001e-05 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.683826+0000", 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020528230000000001 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.684134+0000", 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030764600000000002 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.684381+0000", 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024691200000000001 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.687821+0000", 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034405070000000002 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694239+0000", 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064180419999999997 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694363+0000", 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012394199999999999 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694460+0000", 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6850999999999998e-05 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4469.0:20 4.20 e45/17 4:05552577:::1000000020b.00000000:head v 45'1, mlcod=0'0)", 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.686876+0000", 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.3071325580000002, 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076896100000000004, 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.090 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686876+0000", 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686876+0000", 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686877+0000", 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1060000000000001e-06 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686887+0000", 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8670000000000006e-06 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686909+0000", 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2129000000000001e-05 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686928+0000", 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8227e-05 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.687043+0000", 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115065 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.687088+0000", 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5546000000000001e-05 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694466+0000", 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073776550000000003 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694566+0000", 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000100015 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.094 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:30 4.17 4:eace0b58:::10000000215.00000000:head [write 0~3744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.695458+0000", 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.2985512309999998, 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007595325, 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 30 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695458+0000", 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695458+0000", 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695459+0000", 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6559999999999999e-06 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695469+0000", 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0233e-05 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695493+0000", 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3577000000000001e-05 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695504+0000", 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.137e-05 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695619+0000", 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011431500000000001 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695796+0000", 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017698 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.695974+0000", 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000178565 2024-09-20T20:31:23.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.698181+0000", 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022071069999999998 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.702891+0000", 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0047094909999999997 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.702983+0000", 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1842000000000006e-05 2024-09-20T20:31:23.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.703053+0000", 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0189000000000002e-05 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:23.100 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:23.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:23.102 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:23.097+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:23.202 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:23.201+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:23.245 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:23.245 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:23.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.245 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:1818 4.38 4:1ce05b93:::10000000a1d.00000000:head [write 0~2499 in=2499b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T20:31:23.245 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:23.243343+0000", 2024-09-20T20:31:23.245 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00075207200000000001, 2024-09-20T20:31:23.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080751399999999995, 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1818 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243343+0000", 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243343+0000", 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243345+0000", 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1330000000000002e-06 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243356+0000", 2024-09-20T20:31:23.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0723999999999999e-05 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243386+0000", 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0219e-05 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243400+0000", 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4015999999999999e-05 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243493+0000", 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2328000000000001e-05 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243615+0000", 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012219299999999999 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.243743+0000", 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012851 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:1819 4.1b 4:d8148e7a:::10000000a1e.00000000:head [write 0~2473 in=2473b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:23.244131+0000", 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9999638, 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027119399999999999, 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1819 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.244131+0000", 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.244131+0000", 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.244133+0000", 2024-09-20T20:31:23.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8470000000000001e-06 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.244145+0000", 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1583000000000001e-05 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.244204+0000", 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9018999999999999e-05 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.244238+0000", 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4032999999999998e-05 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.244299+0000", 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1264000000000002e-05 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:23.244372+0000", 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3139000000000006e-05 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.254 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-20T20:31:23.254 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 2 2024-09-20T20:31:23.254 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:23.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:23.303 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:23.299+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:23.404 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:23.399+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:23.433 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:23.433 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:23.448 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:23.506 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:23.498+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:23.583 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:23.583 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:23.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:23.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:23.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.591936036000007, 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:23.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:23.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:23.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.591559082000003, 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:23.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:23.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:23.594 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.59145504, 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:23.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:23.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.590353801000006, 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:23.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:23.605 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.590263144999994, 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.610 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.590190672999995, 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:23.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.590128526000001, 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:23.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:23.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:23.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.590065777000007, 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:23.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:23.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.589957233999996, 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:23.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:23.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.589891948000002, 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:23.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:23.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.589830049, 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:23.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:23.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.587642278999994, 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:23.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:23.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.587544276000003, 2024-09-20T20:31:23.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:23.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.586482947999997, 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:23.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:23.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.586040478000001, 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:23.659 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:23.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:23.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.585163535000007, 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.585074086000006, 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:23.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:23.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.585007822999998, 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.675 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:23.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:23.680 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.583494521000006, 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:23.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:23.684 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.0389598470000001, 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029882941, 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:23.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539835+0000", 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547409+0000", 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075741580000000001 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547449+0000", 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9165999999999997e-05 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547467+0000", 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:23.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547722+0000", 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025469099999999998 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547987+0000", 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026537400000000002 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.548388+0000", 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040049399999999999 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.566710+0000", 2024-09-20T20:31:23.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018322767 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569495+0000", 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027841799999999998 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569587+0000", 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2744000000000005e-05 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569714+0000", 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127021 2024-09-20T20:31:23.689 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:23.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:23.690 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:23.691 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:23.692 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:23.687+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:23.792 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:23.787+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:23.827 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:23.828 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:23.828 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:23.828 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:23.844 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:23.894 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:23.890+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:23.969 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:23.969 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:23.969 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:23.969 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:23.969 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:23.985 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:23.994 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:23.993+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:24.095 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:24.091+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:24.165 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:24.165 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 99.109624306000001, 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:31:24.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:31:24.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.174362153999994, 2024-09-20T20:31:24.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:31:24.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.173 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:31:24.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:31:24.175 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.174247535000006, 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.174148251999995, 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:31:24.181 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:31:24.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.184 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.186 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.174086779999996, 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.187 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:31:24.190 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:31:24.191 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.171935192000007, 2024-09-20T20:31:24.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:31:24.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:24.196 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.197 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.169291447000006, 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:24.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.199 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:31:24.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:31:24.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.164697699000001, 2024-09-20T20:31:24.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:31:24.205 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.208 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.164577116000004, 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.209 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.210 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.212 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.164504617000006, 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.213 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.216 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.161161496000005, 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.217 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:31:24.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.156738036999997, 2024-09-20T20:31:24.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:24.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.223 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.225 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.156379926, 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.156260146999998, 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.230 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.234 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.155959875999997, 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:31:24.238 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.153448374999996, 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:31:24.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:09401a81:::601.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 89.148998969999994, 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00949675, 2024-09-20T20:31:24.243 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012320+0000", 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012321+0000", 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6300000000000005e-07 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012343+0000", 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2480000000000002e-05 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012361+0000", 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7547e-05 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012377+0000", 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6192999999999999e-05 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012853+0000", 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00047639299999999998 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.012902+0000", 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8739999999999998e-05 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021711+0000", 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088095050000000005 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.021817+0000", 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010522900000000001 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.247 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:4 4.32 e45/17 4:4def72d4:::10000000003.00000000:head v 45'2, mlcod=0'0)", 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 3.6131003489999998, 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.020462423, 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548220+0000", 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.81e-06 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553045+0000", 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048248470000000002 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553077+0000", 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1278000000000001e-05 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553090+0000", 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3484e-05 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553205+0000", 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115056 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553246+0000", 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0606999999999999e-05 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.568587+0000", 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015341119 2024-09-20T20:31:24.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.568681+0000", 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4221999999999993e-05 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:5 4.10 e45/17 4:09a4c37f:::10000000003.00000001:head v 45'1, mlcod=0'0)", 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 3.4820154639999998, 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013069620000000001, 2024-09-20T20:31:24.252 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679304+0000", 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6000000000000003e-07 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684127+0000", 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048228960000000001 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684141+0000", 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:24.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684149+0000", 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.9640000000000003e-06 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684203+0000", 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4724e-05 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684217+0000", 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3716999999999999e-05 2024-09-20T20:31:24.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.692319+0000", 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081022100000000003 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.692373+0000", 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3735e-05 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4469.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.33469887300000001, 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010936259, 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4469", 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 2315 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:24.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826621+0000", 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.04e-06 2024-09-20T20:31:24.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827873+0000", 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0012518060000000001 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827892+0000", 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8771999999999999e-05 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827901+0000", 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2119999999999992e-06 2024-09-20T20:31:24.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828029+0000", 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128243 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828401+0000", 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037188500000000002 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828772+0000", 2024-09-20T20:31:24.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037055900000000001 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.835475+0000", 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0067039179999999997 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837284+0000", 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001808713 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837423+0000", 2024-09-20T20:31:24.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013917399999999999 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837556+0000", 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013293699999999999 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:24.262 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:24.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:24.264 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:24.259+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:24.365 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:24.358+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:24.397 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:24.397 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:24.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:2710 4.26 4:64bfa412:::10000000dee.00000000:head [write 0~1719 in=1719b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:24.394722+0000", 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0015304100000000001, 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015485550000000001, 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 2710 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.398 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.394722+0000", 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.394722+0000", 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.394724+0000", 2024-09-20T20:31:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7799999999999999e-06 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.394732+0000", 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4970000000000001e-06 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.394753+0000", 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.069e-05 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.394764+0000", 2024-09-20T20:31:24.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1355999999999999e-05 2024-09-20T20:31:24.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.394859+0000", 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4644999999999999e-05 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.395062+0000", 2024-09-20T20:31:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020327100000000001 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.395257+0000", 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000194678 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396145+0000", 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00088848400000000004 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:2711 4.21 4:844c3305:::10000000def.00000000:head [write 0~1725 in=1725b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:24.396090+0000", 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00016190900000000001, 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023250300000000001, 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 2711 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396090+0000", 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396090+0000", 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396092+0000", 2024-09-20T20:31:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0040000000000002e-06 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396102+0000", 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0073e-05 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396123+0000", 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0590000000000001e-05 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396137+0000", 2024-09-20T20:31:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3943e-05 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396216+0000", 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9153999999999995e-05 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.396314+0000", 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8009000000000003e-05 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-09-20T20:31:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 2 2024-09-20T20:31:24.709 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:24.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:24.711 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:24.702+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:24.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:31:24.807 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:31:24.808 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:31:24.808 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-20T20:31:24.808 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:31:24.808 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:31:24.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-20T20:31:24.810 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:24.809+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:24.853 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:24.854 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:24.854 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:24.854 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:24.854 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:24.872 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:24.911 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:24.909+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:24.946 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:24.946 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "" 2024-09-20T20:31:24.946 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:24.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:25.010 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:25.010 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.014406175000005, 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:25.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:25.016 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.014318316000001, 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:25.017 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:25.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.014276985999999, 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.023 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:25.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.030 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.014207839999997, 2024-09-20T20:31:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:25.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:25.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:25.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.014157557000004, 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.039 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:25.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.014122451000006, 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:25.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.014070783999998, 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.050 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.013993815000006, 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.054 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:25.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.058 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.013941449000001, 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:25.062 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.001371425000002, 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:25.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.066 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.001280105999996, 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:25.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:25.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:25.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.001192326999998, 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090959530000000004, 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.071 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003708+0000", 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003709+0000", 2024-09-20T20:31:25.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7599999999999997e-07 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003736+0000", 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7699999999999999e-05 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003754+0000", 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7606999999999999e-05 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003767+0000", 2024-09-20T20:31:25.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2697000000000001e-05 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003862+0000", 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5038999999999996e-05 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003905+0000", 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2756000000000002e-05 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012722+0000", 2024-09-20T20:31:25.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088170680000000008 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012804+0000", 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2410000000000005e-05 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:16 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 90.000332337000003, 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083156689999999995, 2024-09-20T20:31:25.075 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004568+0000", 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004569+0000", 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004603+0000", 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4446000000000002e-05 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004622+0000", 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8946000000000001e-05 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004639+0000", 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6246999999999999e-05 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004780+0000", 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140949 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.004827+0000", 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6986e-05 2024-09-20T20:31:25.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012811+0000", 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079847749999999995 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.012884+0000", 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2362999999999998e-05 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.3366517619999998, 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.031810205000000001, 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668251+0000", 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1670000000000002e-06 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678059+0000", 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098083630000000005 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678091+0000", 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2264999999999997e-05 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678107+0000", 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5237e-05 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678284+0000", 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017715400000000001 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678614+0000", 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033010199999999998 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678862+0000", 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024798300000000001 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693888+0000", 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015026042 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.699770+0000", 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005881977 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.699932+0000", 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016219300000000001 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.700059+0000", 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012672200000000001 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.3263929059999997, 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015489401999999999, 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.085 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:25.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678509+0000", 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1930000000000001e-06 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678531+0000", 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2330000000000001e-05 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678555+0000", 2024-09-20T20:31:25.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3643e-05 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678569+0000", 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4606e-05 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678672+0000", 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010277600000000001 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678920+0000", 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024821899999999999 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.679469+0000", 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00054898600000000001 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.688799+0000", 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0093301949999999995 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693821+0000", 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211240000000001 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693890+0000", 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9154999999999998e-05 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693997+0000", 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107175 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.3263050569999999, 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01562446, 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12 2024-09-20T20:31:25.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678597+0000", 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2669999999999999e-06 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678605+0000", 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3629999999999994e-06 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678632+0000", 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7382e-05 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678646+0000", 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3869999999999999e-05 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682178+0000", 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003531494 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682531+0000", 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035335800000000001 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:25.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682918+0000", 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038688500000000001 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.688860+0000", 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059416829999999997 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694011+0000", 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051511639999999997 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694101+0000", 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0092000000000004e-05 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694220+0000", 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011890199999999999 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:25.096 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.3232008830000002, 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012760664999999999, 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 15 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:25.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681703+0000", 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0960000000000001e-06 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681724+0000", 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1605999999999999e-05 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681754+0000", 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9954000000000002e-05 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681773+0000", 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9286000000000001e-05 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.683826+0000", 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020528230000000001 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.684134+0000", 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030764600000000002 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.684381+0000", 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024691200000000001 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.687821+0000", 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034405070000000002 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694239+0000", 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064180419999999997 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694363+0000", 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012394199999999999 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694460+0000", 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6850999999999998e-05 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4469.0:20 4.20 e45/17 4:05552577:::1000000020b.00000000:head v 45'1, mlcod=0'0)", 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.686876+0000", 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.318024179, 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076896100000000004, 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.102 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686876+0000", 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686876+0000", 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686877+0000", 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1060000000000001e-06 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686887+0000", 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8670000000000006e-06 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686909+0000", 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2129000000000001e-05 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.686928+0000", 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8227e-05 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.687043+0000", 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115065 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.687088+0000", 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5546000000000001e-05 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694466+0000", 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073776550000000003 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694566+0000", 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000100015 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.106 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:57 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:22.995426+0000", 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.0094740369999999, 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0093663289999999996, 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995426+0000", 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995426+0000", 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995428+0000", 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9130000000000001e-06 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995569+0000", 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140972 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995599+0000", 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0113000000000001e-05 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995614+0000", 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4819e-05 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995713+0000", 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8898000000000001e-05 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995764+0000", 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0479000000000002e-05 2024-09-20T20:31:25.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.997657+0000", 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018934209999999999 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.000135+0000", 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024778769999999999 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.004462+0000", 2024-09-20T20:31:25.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004327455 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.004653+0000", 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019088699999999999 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.004793+0000", 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013949500000000001 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.112 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:61 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.0052918799999999, 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.024989884, 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:25.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999610+0000", 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9139999999999998e-06 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999817+0000", 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000206873 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:25.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999845+0000", 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8059999999999999e-05 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999859+0000", 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723999999999999e-05 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999987+0000", 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012830400000000001 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:25.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.000226+0000", 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023849099999999999 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.014425+0000", 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014199570999999999 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024188+0000", 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0097624600000000006 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:25.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024341+0000", 2024-09-20T20:31:25.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015279399999999999 2024-09-20T20:31:25.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:25.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024489+0000", 2024-09-20T20:31:25.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014786199999999999 2024-09-20T20:31:25.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:25.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:25.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:25.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024598+0000", 2024-09-20T20:31:25.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109831 2024-09-20T20:31:25.118 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.118 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.119 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.119 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:25.119 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:25.119 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:25.120 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:25.115+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:25.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:25.130 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:25.130 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:25.155 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:25.155 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:25.180 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:25.221 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:25.217+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:25.259 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:25.260 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:25.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:25.362 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:25.361+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:25.423 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:25.419+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:25.447 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:25.447 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:25.462 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:25.524 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:25.518+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:25.625 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:25.621+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:25.646 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:25.646 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:25.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:25.714 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:31:25.726 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:25.725+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:25.812 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:25.812 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:25.827 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:25.822+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:25.829 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:25.927 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:25.922+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:26.007 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:26.007 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:26.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:26.028 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:26.023+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:26.129 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:26.122+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:26.193 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:26.194 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:26.209 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:26.229 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:26.225+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:26.331 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:26.323+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:26.348 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:26.348 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:26.363 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:26.431 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:26.426+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:26.532 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:26.526+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:26.540 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:26.540 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:26.555 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:26.634 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:26.626+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:26.685 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:26.685 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:26.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:26.750 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:26.749+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:26.835 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:26.836 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:26.836 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:26.831+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:26.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:26.937 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:26.931+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:27.023 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:27.023 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:27.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:27.039 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:27.031+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:27.139 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:27.135+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:27.173 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:27.173 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:27.188 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:27.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:27.239 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:27.235+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:27.329 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:27.329 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:27.341 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:27.335+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:27.343 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:27.372 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:27.373 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:27.398 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:27.398 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:27.424 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:27.424 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:27.441 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:27.435+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:27.466 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:27.466 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:27.466 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:27.466 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:27.466 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:27.482 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:27.542 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:27.534+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:27.618 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 102.562682964, 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:31:27.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.627420811999997, 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.623 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.628 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:31:27.628 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:31:27.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:31:27.629 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.627306192999995, 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.630 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:31:27.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:31:27.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.627206909999998, 2024-09-20T20:31:27.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.639 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:31:27.640 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:31:27.640 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.640 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.641 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:31:27.641 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:31:27.641 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.627145437999999, 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:31:27.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:31:27.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.624993849999996, 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.648 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:31:27.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:31:27.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.622350104999995, 2024-09-20T20:31:27.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.654 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.655 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.657 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.658 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.617756357000005, 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.659 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:31:27.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:31:27.661 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.663 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.664 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.617635774000007, 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.665 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.666 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.617563274999995, 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:31:27.668 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.669 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.670 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.671 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.614220153999995, 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.672 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.609796695, 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.676 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:31:27.677 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:27.680 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.609438584000003, 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:31:27.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:31:27.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.609318805000001, 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.685 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:27.686 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.688 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.609018534, 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.689 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.690 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.691 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:31:27.692 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 92.606507033, 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:31:27.693 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.697 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:4 4.32 e45/17 4:4def72d4:::10000000003.00000000:head v 45'2, mlcod=0'0)", 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 7.0661590070000004, 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.020462423, 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.698 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548220+0000", 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.81e-06 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553045+0000", 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048248470000000002 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553077+0000", 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1278000000000001e-05 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553090+0000", 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3484e-05 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553205+0000", 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115056 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553246+0000", 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0606999999999999e-05 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.568587+0000", 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015341119 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.568681+0000", 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4221999999999993e-05 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.701 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:5 4.10 e45/17 4:09a4c37f:::10000000003.00000001:head v 45'1, mlcod=0'0)", 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 6.9350741219999996, 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013069620000000001, 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679304+0000", 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6000000000000003e-07 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684127+0000", 2024-09-20T20:31:27.703 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048228960000000001 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684141+0000", 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684149+0000", 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.9640000000000003e-06 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684203+0000", 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4724e-05 2024-09-20T20:31:27.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684217+0000", 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3716999999999999e-05 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.692319+0000", 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081022100000000003 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.692373+0000", 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3735e-05 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.705 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4469.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 3.787757531, 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010936259, 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4469", 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 2315 2024-09-20T20:31:27.706 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826621+0000", 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.04e-06 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827873+0000", 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0012518060000000001 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827892+0000", 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8771999999999999e-05 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827901+0000", 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2119999999999992e-06 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828029+0000", 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128243 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828401+0000", 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037188500000000002 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828772+0000", 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037055900000000001 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.835475+0000", 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0067039179999999997 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837284+0000", 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001808713 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837423+0000", 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013917399999999999 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837556+0000", 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013293699999999999 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:62 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~1880994 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:24.267539+0000", 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 3.3468389859999998, 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.016993435000000001, 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.267539+0000", 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.267539+0000", 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.267541+0000", 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.193e-06 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.271800+0000", 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042591119999999998 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.271829+0000", 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9396000000000001e-05 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.271843+0000", 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4100000000000001e-05 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.271987+0000", 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00014407999999999999 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.272208+0000", 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00022021899999999999 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.272560+0000", 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035189599999999998 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.283272+0000", 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010712018 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.284367+0000", 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0010958109999999999 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.284461+0000", 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3084999999999994e-05 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.284532+0000", 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1525000000000004e-05 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:27.717 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:27.718 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:27.719 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:27.711+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:27.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:31:27.819 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:27.814+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:27.861 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:5154 4.3f 4:fd5205a5:::10000001801.00000000:head [write 0~1902 in=1902b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:27.858031+0000", 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0023343449999999998, 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023977999999999998, 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:27.862 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5154 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858031+0000", 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858031+0000", 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858032+0000", 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8299999999999995e-07 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858038+0000", 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9200000000000001e-06 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858053+0000", 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4822e-05 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858062+0000", 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3799999999999994e-06 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858193+0000", 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013176299999999999 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858384+0000", 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019105500000000001 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.858575+0000", 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019025499999999999 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:5155 4.1c 4:39f7b1ed:::10000001802.00000000:head [write 0~5512 in=5512b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:27.859246+0000", 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0011203039999999999, 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001384171, 2024-09-20T20:31:27.866 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5155 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859246+0000", 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859246+0000", 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859247+0000", 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.95e-06 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859264+0000", 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6549e-05 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:27.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859289+0000", 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.461e-05 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859302+0000", 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3722e-05 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859417+0000", 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114727 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859599+0000", 2024-09-20T20:31:27.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000181893 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:27.859776+0000", 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017697500000000001 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 2 2024-09-20T20:31:27.870 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:27.877 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:27.923 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:27.919+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:28.011 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:28.012 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:28.012 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:28.012 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:28.012 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:28.020 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:28.017+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:28.028 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:28.121 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:28.114+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:28.222 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:28.221+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:28.227 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232544262000005, 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232456403, 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232415072999999, 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232345926999997, 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:28.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232295644000004, 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:28.250 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.251 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.251 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.251 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:28.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:28.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:28.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:28.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232260538000006, 2024-09-20T20:31:28.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:28.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:28.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:28.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232208870999997, 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.264 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:28.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232131902000006, 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:28.268 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:28.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.232079536000001, 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:28.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:28.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:12 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.219509512000002, 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010263166000000001, 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003529+0000", 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003530+0000", 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-06 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003542+0000", 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1946e-05 2024-09-20T20:31:28.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003561+0000", 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9089999999999998e-05 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003580+0000", 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8913e-05 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003683+0000", 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010257899999999999 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003726+0000", 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3933000000000001e-05 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013711+0000", 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099844730000000007 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013792+0000", 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1188999999999998e-05 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 93.219418192999996, 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.281 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:28.285 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.5547898489999996, 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.031810205000000001, 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668251+0000", 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1670000000000002e-06 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678059+0000", 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098083630000000005 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678091+0000", 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2264999999999997e-05 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678107+0000", 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5237e-05 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678284+0000", 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017715400000000001 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678614+0000", 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033010199999999998 2024-09-20T20:31:28.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678862+0000", 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024798300000000001 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693888+0000", 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015026042 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.699770+0000", 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005881977 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.699932+0000", 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016219300000000001 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.700059+0000", 2024-09-20T20:31:28.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012672200000000001 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.5445309930000004, 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015489401999999999, 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.292 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678509+0000", 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1930000000000001e-06 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678531+0000", 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2330000000000001e-05 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678555+0000", 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3643e-05 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678569+0000", 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4606e-05 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678672+0000", 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010277600000000001 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678920+0000", 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024821899999999999 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.679469+0000", 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00054898600000000001 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.688799+0000", 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0093301949999999995 2024-09-20T20:31:28.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693821+0000", 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211240000000001 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693890+0000", 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9154999999999998e-05 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693997+0000", 2024-09-20T20:31:28.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107175 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.5444431439999997, 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01562446, 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:28.298 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:28.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678597+0000", 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2669999999999999e-06 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678605+0000", 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3629999999999994e-06 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678632+0000", 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7382e-05 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678646+0000", 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3869999999999999e-05 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682178+0000", 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003531494 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682531+0000", 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035335800000000001 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682918+0000", 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038688500000000001 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.688860+0000", 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059416829999999997 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694011+0000", 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051511639999999997 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694101+0000", 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0092000000000004e-05 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694220+0000", 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011890199999999999 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.54133897, 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012760664999999999, 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:28.304 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 15 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681703+0000", 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0960000000000001e-06 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681724+0000", 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1605999999999999e-05 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681754+0000", 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9954000000000002e-05 2024-09-20T20:31:28.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681773+0000", 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9286000000000001e-05 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.683826+0000", 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020528230000000001 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.684134+0000", 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030764600000000002 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.684381+0000", 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024691200000000001 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.687821+0000", 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034405070000000002 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694239+0000", 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064180419999999997 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694363+0000", 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012394199999999999 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694460+0000", 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6850999999999998e-05 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.309 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:57 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:22.995426+0000", 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.2276121240000002, 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0093663289999999996, 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995426+0000", 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995426+0000", 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995428+0000", 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9130000000000001e-06 2024-09-20T20:31:28.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995569+0000", 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000140972 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995599+0000", 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0113000000000001e-05 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995614+0000", 2024-09-20T20:31:28.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4819e-05 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995713+0000", 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8898000000000001e-05 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.995764+0000", 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0479000000000002e-05 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:22.997657+0000", 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018934209999999999 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.000135+0000", 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024778769999999999 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.004462+0000", 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004327455 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.004653+0000", 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019088699999999999 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.004793+0000", 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013949500000000001 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.315 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:61 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2234299670000004, 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.024989884, 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999610+0000", 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9139999999999998e-06 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999817+0000", 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000206873 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999845+0000", 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8059999999999999e-05 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999859+0000", 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723999999999999e-05 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999987+0000", 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012830400000000001 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.000226+0000", 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023849099999999999 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.014425+0000", 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014199570999999999 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024188+0000", 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0097624600000000006 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024341+0000", 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015279399999999999 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024489+0000", 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014786199999999999 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024598+0000", 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109831 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:63 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:25.001441+0000", 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.2215976500000001, 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018557256000000001, 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001441+0000", 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001441+0000", 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001442+0000", 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.53e-06 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001678+0000", 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023562400000000001 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001697+0000", 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8783e-05 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001708+0000", 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1569000000000001e-05 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001784+0000", 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5920000000000005e-05 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001872+0000", 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7348000000000005e-05 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.007833+0000", 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005961849 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.015871+0000", 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080379330000000006 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.019756+0000", 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038847999999999999 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.019894+0000", 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137961 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.019998+0000", 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103939 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:3240 4.1c 4:3a2e6890:::1000000100c.00000000:head [write 0~5313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:25.165211+0000", 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.0578271959999999, 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0091827509999999994, 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 3240 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165211+0000", 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165211+0000", 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165214+0000", 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4729999999999999e-06 2024-09-20T20:31:28.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165234+0000", 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0020000000000001e-05 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165259+0000", 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5306000000000001e-05 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165278+0000", 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8453000000000001e-05 2024-09-20T20:31:28.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165413+0000", 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000135399 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165630+0000", 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021752300000000001 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.165862+0000", 2024-09-20T20:31:28.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023133 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.167027+0000", 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001164841 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.174245+0000", 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072180179999999997 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.174330+0000", 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5457999999999994e-05 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.174394+0000", 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3930000000000006e-05 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:128 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:28.008833+0000", 2024-09-20T20:31:28.332 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.214205535, 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027545402, 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008833+0000", 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008833+0000", 2024-09-20T20:31:28.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008834+0000", 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.373e-06 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008917+0000", 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2777999999999999e-05 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008939+0000", 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1539000000000002e-05 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008950+0000", 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1603000000000001e-05 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.009067+0000", 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116494 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.009287+0000", 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022018299999999999 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.020160+0000", 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010873185 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.033789+0000", 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01362847 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.036258+0000", 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024696240000000001 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.036337+0000", 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8584000000000005e-05 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.036378+0000", 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1569000000000001e-05 2024-09-20T20:31:28.337 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.338 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.338 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.338 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:28.338 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:28.338 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:28.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:28.340 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:28.334+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:28.441 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:28.434+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:28.485 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4469.0:5699 4.1 e47/17 4:80ef2a37:::10000001a39.00000000:head v 47'82, mlcod=47'80)", 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:28.483632+0000", 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00139273, 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014301209999999999, 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:28.483632+0000", 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:28.483632+0000", 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:28.483633+0000", 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-06 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:28.483643+0000", 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9559999999999992e-06 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:28.483663+0000", 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0006000000000001e-05 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:28.483674+0000", 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1178999999999999e-05 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:28.483814+0000", 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013981200000000001 2024-09-20T20:31:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:28.483876+0000", 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1575999999999995e-05 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-20T20:31:28.489 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:28.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:28.541 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:28.534+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:28.631 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:28.632 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:28.642 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:28.635+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:28.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:31:28.743 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:28.741+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.793224163000005, 2024-09-20T20:31:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.792847209000001, 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.792743166999998, 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:28.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:28.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.801 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.791641928000004, 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.791551272000007, 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.791478799999993, 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.791416652999999, 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.791353904000005, 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.791245360999994, 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.791180075, 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.791118175999998, 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.788930406000006, 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.788832403000001, 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.787771074999995, 2024-09-20T20:31:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.787328604999999, 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.786451662000005, 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.786362213000004, 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.786295949999996, 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.784782648000004, 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.2402479740000008, 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029882941, 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539835+0000", 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547409+0000", 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075741580000000001 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547449+0000", 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9165999999999997e-05 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547467+0000", 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547722+0000", 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025469099999999998 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547987+0000", 2024-09-20T20:31:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026537400000000002 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.548388+0000", 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040049399999999999 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.566710+0000", 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018322767 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569495+0000", 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027841799999999998 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569587+0000", 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2744000000000005e-05 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569714+0000", 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127021 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:28.895 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:28.896 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:28.897 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:28.891+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:28.997 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:28.990+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:29.036 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:6078 4.28 e48/41 4:1402f14b:::10000001be1.00000000:head v 48'95, mlcod=48'93)", 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:29.031333+0000", 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.0038567559999999998, 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038965010000000001, 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.031333+0000", 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.031333+0000", 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.031334+0000", 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.773e-06 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.038 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.031347+0000", 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2129e-05 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.031367+0000", 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0539000000000001e-05 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.031378+0000", 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1163e-05 2024-09-20T20:31:29.039 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.031502+0000", 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000123297 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.031536+0000", 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4437999999999998e-05 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.040 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.035192+0000", 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0036556639999999999 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.035229+0000", 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.7497999999999999e-05 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4469.0:6079 4.36 4:6eb95021:::10000001be3.00000000:head [write 0~806 in=806b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:29.032725+0000", 2024-09-20T20:31:29.041 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.0024642449999999999, 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027346530000000001, 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4469", 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 6079 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.032725+0000", 2024-09-20T20:31:29.042 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.032725+0000", 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.032727+0000", 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9769999999999999e-06 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.043 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.032738+0000", 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0669000000000001e-05 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.032764+0000", 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262e-05 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.032777+0000", 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3319000000000001e-05 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.044 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.032856+0000", 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8836000000000002e-05 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.033002+0000", 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00014571199999999999 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.033134+0000", 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013175900000000001 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.045 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4469.0:6081 4.3e 4:7c49fa9f:::10000001be5.00000000:head [write 0~465 in=465b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:29.034776+0000", 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.00041312500000000003, 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00084186899999999997, 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4469", 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:29.046 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 6081 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034776+0000", 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034776+0000", 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034778+0000", 2024-09-20T20:31:29.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034788+0000", 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7529999999999996e-06 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034820+0000", 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1859000000000001e-05 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034834+0000", 2024-09-20T20:31:29.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4375e-05 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034974+0000", 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000139293 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.035307+0000", 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00033366199999999998 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:6080 4.22 e48/41 4:444aef94:::10000001be4.00000000:head v 48'118, mlcod=48'115)", 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:29.034973+0000", 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.00021587900000000001, 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00075053999999999995, 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034973+0000", 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034973+0000", 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034975+0000", 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3200000000000001e-06 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.034984+0000", 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1330000000000005e-06 2024-09-20T20:31:29.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.035006+0000", 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2413e-05 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.035016+0000", 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6649999999999998e-06 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.035070+0000", 2024-09-20T20:31:29.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4339999999999998e-05 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:29.035092+0000", 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1399999999999998e-05 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 4 2024-09-20T20:31:29.053 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:29.054 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:29.098 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:29.091+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:29.199 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:29.195+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:29.224 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:29.224 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:29.224 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:29.224 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:29.224 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:29.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:29.300 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:29.295+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4167.0:116 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'78, mlcod=10'64)", 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 104.314924479, 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099463260000000001, 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.372 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051695+0000", 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051696+0000", 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.26e-06 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051705+0000", 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051722+0000", 2024-09-20T20:31:29.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6099999999999998e-05 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.051733+0000", 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1846e-05 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056455+0000", 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0047220730000000002 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.056520+0000", 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4826000000000006e-05 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061526+0000", 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050054890000000001 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:45.061641+0000", 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115182 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.376 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.379662327000005, 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030141510999999999, 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.377 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986957+0000", 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986960+0000", 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8559999999999998e-06 2024-09-20T20:31:29.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.986974+0000", 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4087000000000001e-05 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987003+0000", 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9193e-05 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987028+0000", 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4729999999999999e-05 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997236+0000", 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010208355000000001 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997542+0000", 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030588000000000002 2024-09-20T20:31:29.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997844+0000", 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030183800000000002 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003524+0000", 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056803660000000001 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016887+0000", 2024-09-20T20:31:29.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013363313999999999 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017001+0000", 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113119 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017098+0000", 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7773000000000001e-05 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.382 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.379547708000004, 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030015944999999999, 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:29.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987071+0000", 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987073+0000", 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987081+0000", 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7260000000000002e-06 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987124+0000", 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3550000000000001e-05 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987147+0000", 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3079999999999999e-05 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997286+0000", 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010138965 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997572+0000", 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000285634 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997921+0000", 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00034878399999999999 2024-09-20T20:31:29.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003548+0000", 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0056277970000000004 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016844+0000", 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013295358 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016978+0000", 2024-09-20T20:31:29.387 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000134282 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017087+0000", 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109349 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.379448425000007, 2024-09-20T20:31:29.388 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027423941, 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987171+0000", 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987172+0000", 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3459999999999999e-06 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987179+0000", 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.533e-06 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987197+0000", 2024-09-20T20:31:29.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8377e-05 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987212+0000", 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5160000000000001e-05 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.995779+0000", 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0085670599999999996 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996099+0000", 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00031949499999999999 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996476+0000", 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037766399999999999 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998982+0000", 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00250563 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014332+0000", 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015349708 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014491+0000", 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015937899999999999 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014595+0000", 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103589 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.379386952999994, 2024-09-20T20:31:29.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030207337000000001, 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987233+0000", 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.054e-06 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987240+0000", 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8430000000000004e-06 2024-09-20T20:31:29.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987258+0000", 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7649999999999999e-05 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.987272+0000", 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998519+0000", 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011246723 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998735+0000", 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00021659500000000001 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00029333799999999998 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003700+0000", 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046709610000000004 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017244+0000", 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013544796 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017357+0000", 2024-09-20T20:31:29.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000112812 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017439+0000", 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2292000000000004e-05 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:29.400 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.377235365000004, 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.028038812999999999, 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989384+0000", 2024-09-20T20:31:29.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989386+0000", 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0829999999999998e-06 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.989398+0000", 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2343e-05 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990819+0000", 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0014206189999999999 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.990846+0000", 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6903e-05 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998557+0000", 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077110240000000004 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.998729+0000", 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017264099999999999 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999029+0000", 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000299282 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.003714+0000", 2024-09-20T20:31:29.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00468498 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017209+0000", 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013495785999999999 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017333+0000", 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012405900000000001 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017423+0000", 2024-09-20T20:31:29.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9092999999999996e-05 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.374591620000004, 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.023601915000000001, 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.406 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992027+0000", 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992030+0000", 2024-09-20T20:31:29.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4200000000000001e-06 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992079+0000", 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.9023999999999997e-05 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992853+0000", 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00077370399999999995 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.992878+0000", 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5709999999999999e-05 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997123+0000", 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042448069999999997 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997310+0000", 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018690100000000001 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997615+0000", 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000304591 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.002287+0000", 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046719639999999998 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015383+0000", 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013096063 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015520+0000", 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013778900000000001 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015629+0000", 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108942 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.411 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.369997871999999, 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.029148555, 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996621+0000", 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996623+0000", 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1739999999999999e-06 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996642+0000", 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8929000000000001e-05 2024-09-20T20:31:29.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996667+0000", 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.4247e-05 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996689+0000", 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2252999999999999e-05 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.999660+0000", 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029711 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001550+0000", 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001890302 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001912+0000", 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00036218699999999998 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.009965+0000", 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0080528249999999996 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025565+0000", 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.01559928 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025661+0000", 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6335000000000005e-05 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.025770+0000", 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000108923 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.369877289000001, 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019784856999999999, 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.417 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996742+0000", 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996743+0000", 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.42e-06 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996749+0000", 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2060000000000004e-06 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996770+0000", 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0149999999999999e-05 2024-09-20T20:31:29.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996784+0000", 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4606e-05 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996910+0000", 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000126169 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997177+0000", 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00026688200000000002 2024-09-20T20:31:29.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016527+0000", 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.019349424 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.369804790000003, 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.02332476, 2024-09-20T20:31:29.421 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996814+0000", 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996815+0000", 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.17e-06 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996821+0000", 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4929999999999998e-06 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996844+0000", 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3390000000000001e-05 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.996859+0000", 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.469e-05 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997037+0000", 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00017800499999999999 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:54.997312+0000", 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027502100000000002 2024-09-20T20:31:29.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.020139+0000", 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.022826991000000001 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:14 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.366461669000003, 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010008108999999999, 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.425 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000157+0000", 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000158+0000", 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0599999999999999e-07 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000220+0000", 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1409999999999996e-05 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000246+0000", 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6290000000000001e-05 2024-09-20T20:31:29.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.000263+0000", 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7399000000000001e-05 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001876+0000", 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001612512 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.001919+0000", 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2679000000000003e-05 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010062+0000", 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081432410000000007 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010166+0000", 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010367200000000001 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:11 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.362038209999994, 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099258999999999997, 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004581+0000", 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004582+0000", 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8999999999999996e-07 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004593+0000", 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.188e-05 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004620+0000", 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6262999999999999e-05 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004640+0000", 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0384e-05 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005152+0000", 2024-09-20T20:31:29.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00051182199999999999 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005194+0000", 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1717000000000001e-05 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014410+0000", 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092162609999999999 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014507+0000", 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6883000000000001e-05 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:2 3.f e18/16 3:f1f69726:::400.00000000:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.361680098999997, 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010443333000000001, 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.434 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004939+0000", 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004940+0000", 2024-09-20T20:31:29.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.187e-06 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.004985+0000", 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4511999999999997e-05 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005008+0000", 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3493999999999999e-05 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005028+0000", 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.9426e-05 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005475+0000", 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044742300000000002 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006198+0000", 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00072332799999999997 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015279+0000", 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0090805599999999997 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.015382+0000", 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000103403 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:33 3.14 e18/16 3:2f55791f:::606.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:29.438 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.361560319999995, 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0095291660000000004, 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005059+0000", 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005060+0000", 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1699999999999997e-07 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005069+0000", 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.55e-06 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005113+0000", 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3272000000000002e-05 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005310+0000", 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00019787900000000001 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007314+0000", 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0020039509999999999 2024-09-20T20:31:29.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007363+0000", 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8943000000000002e-05 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014515+0000", 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0071514109999999999 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014588+0000", 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3243000000000003e-05 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:19 3.d e18/16 3:b50e409b:::mds_snaptable:head v 18'1, mlcod=0'0)", 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.361260048999995, 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.011444552, 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.443 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005359+0000", 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005360+0000", 2024-09-20T20:31:29.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.7000000000000003e-07 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005381+0000", 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0735999999999999e-05 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005400+0000", 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8873999999999999e-05 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.005415+0000", 2024-09-20T20:31:29.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5359999999999999e-05 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006238+0000", 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00082284000000000003 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.006281+0000", 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3652999999999997e-05 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.446 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.014061+0000", 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0077790799999999998 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.016804+0000", 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0027430390000000001 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(mds.0.3:3 3.14 e18/16 3:287034c4:::1.00000000.inode:head v 18'4, mlcod=0'0)", 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:29.447 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 94.358748547999994, 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0099741559999999996, 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007871+0000", 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.448 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007872+0000", 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.48e-06 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007883+0000", 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1379999999999999e-05 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007902+0000", 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8753000000000002e-05 2024-09-20T20:31:29.449 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.007919+0000", 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010102+0000", 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021831160000000001 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.450 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.010153+0000", 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0439999999999998e-05 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017777+0000", 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0076243049999999996 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:29:55.017845+0000", 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7779000000000003e-05 2024-09-20T20:31:29.451 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:4 4.32 e45/17 4:4def72d4:::10000000003.00000000:head v 45'2, mlcod=0'0)", 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 8.8184005219999992, 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.020462423, 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548219+0000", 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.548220+0000", 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.81e-06 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553045+0000", 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048248470000000002 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553077+0000", 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1278000000000001e-05 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553090+0000", 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3484e-05 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553205+0000", 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000115056 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.553246+0000", 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0606999999999999e-05 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.568587+0000", 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.015341119 2024-09-20T20:31:29.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.568681+0000", 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4221999999999993e-05 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:5 4.10 e45/17 4:09a4c37f:::10000000003.00000001:head v 45'1, mlcod=0'0)", 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 8.6873156369999993, 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.013069620000000001, 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.456 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679303+0000", 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.679304+0000", 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6000000000000003e-07 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684127+0000", 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048228960000000001 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684141+0000", 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:29.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684149+0000", 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.9640000000000003e-06 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684203+0000", 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4724e-05 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.684217+0000", 2024-09-20T20:31:29.459 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3716999999999999e-05 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.692319+0000", 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0081022100000000003 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:20.692373+0000", 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3735e-05 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4469.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.5399990460000001, 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010936259, 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4469", 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 2315 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.461 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826620+0000", 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.826621+0000", 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.04e-06 2024-09-20T20:31:29.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827873+0000", 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0012518060000000001 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827892+0000", 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8771999999999999e-05 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.827901+0000", 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2119999999999992e-06 2024-09-20T20:31:29.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828029+0000", 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128243 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828401+0000", 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037188500000000002 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.828772+0000", 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00037055900000000001 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.835475+0000", 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0067039179999999997 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837284+0000", 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001808713 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837423+0000", 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013917399999999999 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:23.837556+0000", 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013293699999999999 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.466 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:62 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~1880994 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:24.267539+0000", 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.0990805010000004, 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.016993435000000001, 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.267539+0000", 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.267539+0000", 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.267541+0000", 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.193e-06 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.271800+0000", 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042591119999999998 2024-09-20T20:31:29.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.271829+0000", 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9396000000000001e-05 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.271843+0000", 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4100000000000001e-05 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.271987+0000", 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00014407999999999999 2024-09-20T20:31:29.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.272208+0000", 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00022021899999999999 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.272560+0000", 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035189599999999998 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:29.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.283272+0000", 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.010712018 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.284367+0000", 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0010958109999999999 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.284461+0000", 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3084999999999994e-05 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:29.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:29.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:24.284532+0000", 2024-09-20T20:31:29.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1525000000000004e-05 2024-09-20T20:31:29.472 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.472 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.472 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.472 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:29.472 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:29.472 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:29.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:29.474 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:29.475 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:29.466+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:29.575 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:29.573+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:29.610 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:29.610 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:29.611 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:29.611 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:29.626 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:29.647 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:29.647 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:29.671 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:29.671 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:29.675 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:29.671+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:29.693 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:29.694 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:29.758 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:29.758 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:29.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:29.776 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:29.770+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:29.877 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:29.873+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:29.961 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:29.961 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:29.962 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:31:29.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-20T20:31:29.975 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:29.978 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:29.970+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:30.078 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:30.074+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:30.121 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:30.121 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:30.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:30.180 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:30.174+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:30.281 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:30.274+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:30.281 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:30.281 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:30.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:30.382 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:30.374+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:30.433 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:30.434 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:30.450 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:30.494 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:30.490+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:30.583 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:30.578+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:30.589 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:30.589 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:30.604 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:30.684 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:30.681+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:30.736 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-20T20:31:30.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:31:30.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-20T20:31:30.780 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:30.780 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:30.786 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:30.778+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:30.796 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:30.887 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:30.879+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:30.977 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:30.977 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:30.987 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:30.985+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:30.993 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:31.089 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:31.082+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:31.147 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:31.189 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:31.182+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:31.281 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:31.281 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:31.290 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:31.282+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:31.299 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:31.391 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:31.386+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:31.434 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:31.434 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:31.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:31.491 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:31.487+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:31.592 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:31.587+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:31.599 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:31.599 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:31.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:31.693 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:31.686+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:31.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:31.742 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:31:31.745 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-20T20:31:31.753 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:31.753 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:31.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-20T20:31:31.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:31.794 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:31.787+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:31.884 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:31.894 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:31.887+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:31.897 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:31.897 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:31.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:31.897 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:31.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.897 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.907980250999998, 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:31.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:31.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:31.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.907603296999994, 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:31.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:31.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:31.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:31.908 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.907499255000005, 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.906398015999997, 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:31.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.90630736, 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:31.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:31.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.924 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.906234888, 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:31.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.906172741000006, 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:31.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.935 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.906109991999998, 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:31.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:31.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.906001449000001, 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:31.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:31.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:31.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:31.946 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.905936163000007, 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:31.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:31.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:31.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.905874264000005, 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:31.952 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:31.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.903686493999999, 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:31.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.903588490999994, 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:31.963 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.968 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.902527163000002, 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.902084693000006, 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.901207749999998, 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:31.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:31.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.901118300999997, 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:31.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:31.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.901052038000003, 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:31.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.899538735999997, 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:31.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:31.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-20T20:31:31.999 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 11.355004062000001, 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029882941, 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:32.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539835+0000", 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547409+0000", 2024-09-20T20:31:32.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075741580000000001 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547449+0000", 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9165999999999997e-05 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547467+0000", 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:32.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547722+0000", 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025469099999999998 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547987+0000", 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026537400000000002 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.548388+0000", 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040049399999999999 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.566710+0000", 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018322767 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569495+0000", 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027841799999999998 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569587+0000", 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2744000000000005e-05 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:32.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:32.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569714+0000", 2024-09-20T20:31:32.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127021 2024-09-20T20:31:32.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:32.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:32.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:32.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:32.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:32.005 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:32.006 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:32.006 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:32.007 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:32.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:32.008 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:32.009 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:32.002+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:32.107 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:32.103+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4469.0:8427 4.1 4:81aa1c0d:::10000002666.00000000:head [write 0~958 in=958b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:32.148135+0000", 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.0020490339999999999, 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0021109610000000002, 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:32.152 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4469", 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 8427 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148135+0000", 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148135+0000", 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148135+0000", 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.7000000000000004e-07 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148140+0000", 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.3819999999999997e-06 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148152+0000", 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2539e-05 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148169+0000", 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6730000000000001e-05 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148309+0000", 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000139956 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148616+0000", 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030770199999999998 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.148831+0000", 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000214639 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150238+0000", 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001407232 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.156 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:8428 4.e e50/17 4:71ae7039:::10000002667.00000000:head v 50'119, mlcod=50'117)", 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:32.150057+0000", 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.000126148, 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00045528499999999999, 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150057+0000", 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150057+0000", 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150058+0000", 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.012e-06 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150072+0000", 2024-09-20T20:31:32.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4092e-05 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150089+0000", 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6566999999999999e-05 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150098+0000", 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8710000000000003e-06 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150237+0000", 2024-09-20T20:31:32.159 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013889300000000001 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.150305+0000", 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8164000000000007e-05 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 2 2024-09-20T20:31:32.160 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:32.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:32.208 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:32.203+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:32.309 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:32.305+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:32.312 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:32.312 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:32.312 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:32.312 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:32.312 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:32.329 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:32.409 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:32.405+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:32.463 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:32.463 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:32.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50831242799999998, 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:32.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50826091699999998, 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.469 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.474 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50821446299999995, 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.479 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50817626199999999, 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:32.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:32.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:32.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50814468300000004, 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:32.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.490 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.508093189, 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.492 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.495 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50805884400000001, 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:32.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:32.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:32.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:32.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50802794600000001, 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.501 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:32.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:32.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:32.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:32.505 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50797888199999996, 2024-09-20T20:31:32.506 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.507 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:32.508 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:32.509 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.510 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.511 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.50794611700000003, 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.512 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:32.513 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:32.514 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:32.515 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.516 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.48973634500000002, 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.517 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:32.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:32.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:32.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:32.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.48918011700000003, 2024-09-20T20:31:32.522 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:32.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:32.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.527 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.488684966, 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:32.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:32.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.48801932999999997, 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.533 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.538 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.48742463499999999, 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:32.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:32.543 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.48729811099999998, 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.544 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:32.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:32.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.548 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.549 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.48721482599999999, 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:32.554 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.486234373, 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.555 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:32.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.48612339199999999, 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.560 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:32.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:32.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.565 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.565 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:32.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:32.565 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.565 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.48053638799999998, 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:32.567 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:32.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:32.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:32.571 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:32.572 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:32.574 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:32.574 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:32.569+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:32.674 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:32.665+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:8922 4.12 4:4add159e:::100000028d9.00000000:head [write 0~11250 in=11250b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:32.708167+0000", 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0039040099999999999, 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039441629999999997, 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:32.714 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 8922 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708167+0000", 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708167+0000", 2024-09-20T20:31:32.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708169+0000", 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.916e-06 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708192+0000", 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2427000000000001e-05 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:32.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708221+0000", 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9595999999999999e-05 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708235+0000", 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4053000000000001e-05 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708294+0000", 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8437000000000003e-05 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:32.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708387+0000", 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3628000000000005e-05 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.708474+0000", 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6593000000000003e-05 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.709735+0000", 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012606329999999999 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712055+0000", 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002320155 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4469.0:8924 4.2c e50/17 4:35ac120b:::100000028db.00000000:head v 50'163, mlcod=50'161)", 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:32.711499+0000", 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00057282899999999996, 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086134999999999998, 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:32.719 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.711499+0000", 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.711499+0000", 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.711500+0000", 2024-09-20T20:31:32.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5829999999999999e-06 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.711517+0000", 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7212999999999999e-05 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.711540+0000", 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2163000000000001e-05 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.711552+0000", 2024-09-20T20:31:32.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.711690+0000", 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013795999999999999 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.711751+0000", 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0408000000000002e-05 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:32.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:8926 4.0 4:00487b2b:::100000028dd.00000000:head [write 0~6699 in=6699b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:32.712264+0000", 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9998074, 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022749900000000001, 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 8926 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.723 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712264+0000", 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712264+0000", 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712266+0000", 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1239999999999999e-06 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712288+0000", 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1503000000000001e-05 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712328+0000", 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0392000000000002e-05 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712348+0000", 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0146e-05 2024-09-20T20:31:32.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712415+0000", 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6655000000000005e-05 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.712503+0000", 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7610999999999999e-05 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:32.726 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-09-20T20:31:32.727 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 3 2024-09-20T20:31:32.727 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:32.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:32.745 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-20T20:31:32.764 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-20T20:31:32.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:31:32.774 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:32.769+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:32.862 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:32.862 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:32.863 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:32.863 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:32.875 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:32.873+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:32.879 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:32.976 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:32.973+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:33.005 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:33.005 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:33.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:33.005 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:33.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.005 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.011688821000007, 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015941413000000001, 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990494+0000", 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990496+0000", 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2560000000000001e-06 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990508+0000", 2024-09-20T20:31:33.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1524e-05 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990533+0000", 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5182999999999999e-05 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990551+0000", 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.747e-05 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991197+0000", 2024-09-20T20:31:33.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064607499999999997 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991538+0000", 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000341007 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991903+0000", 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036497400000000001 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998450+0000", 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065473520000000002 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006173+0000", 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007722591 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006318+0000", 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000145186 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006436+0000", 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011779500000000001 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.011600962000003, 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026979837999999999, 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.011 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990582+0000", 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990583+0000", 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990589+0000", 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990601+0000", 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1914e-05 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990610+0000", 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0690000000000008e-06 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991577+0000", 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096654 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991847+0000", 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026995799999999999 2024-09-20T20:31:33.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992205+0000", 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035824700000000001 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998466+0000", 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062611180000000004 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017322+0000", 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018856028 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017461+0000", 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013919900000000001 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017562+0000", 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010084199999999999 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:33.016 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.011559632000001, 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018447723999999999, 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990623+0000", 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990624+0000", 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990658+0000", 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3562999999999997e-05 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990670+0000", 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.274e-05 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990679+0000", 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4600000000000003e-06 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992633+0000", 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019538480000000002 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992809+0000", 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000176575 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993080+0000", 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027103199999999999 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998498+0000", 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054180340000000004 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008780+0000", 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010281940999999999 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.008974+0000", 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000193215 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.009071+0000", 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7583000000000004e-05 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.021 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.011490486, 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027091934000000002, 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:33.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990693+0000", 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.37e-07 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990713+0000", 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9962999999999998e-05 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990724+0000", 2024-09-20T20:31:33.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990732+0000", 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4929999999999998e-06 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992689+0000", 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019571549999999999 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992797+0000", 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107753 2024-09-20T20:31:33.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992952+0000", 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000155019 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998482+0000", 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055304400000000002 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017649+0000", 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019166609000000001 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017726+0000", 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7230000000000004e-05 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.017785+0000", 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8218999999999999e-05 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.026 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.011440203000006, 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020663662999999999, 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990743+0000", 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990744+0000", 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7999999999999995e-07 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990748+0000", 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7400000000000004e-06 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990761+0000", 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2726e-05 2024-09-20T20:31:33.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990769+0000", 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5299999999999999e-06 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993531+0000", 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027627820000000001 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993696+0000", 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000164759 2024-09-20T20:31:33.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.993861+0000", 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016461500000000001 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.000305+0000", 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064445570000000001 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011033+0000", 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010727764000000001 2024-09-20T20:31:33.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011289+0000", 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00025636799999999998 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.011407+0000", 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117142 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.011405096999994, 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015996453000000001, 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990778+0000", 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990779+0000", 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4700000000000001e-07 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990783+0000", 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2799999999999997e-06 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990792+0000", 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9870000000000005e-06 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990810+0000", 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8522999999999999e-05 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990930+0000", 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119682 2024-09-20T20:31:33.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991240+0000", 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030998400000000002 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991627+0000", 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000386537 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.998124+0000", 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064978070000000004 2024-09-20T20:31:33.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006525+0000", 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084003410000000004 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006659+0000", 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134246 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.006774+0000", 2024-09-20T20:31:33.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115419 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.01135343, 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016458599000000001, 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990830+0000", 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990831+0000", 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0699999999999999e-06 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990836+0000", 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4060000000000004e-06 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990855+0000", 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9057000000000001e-05 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990862+0000", 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2189999999999998e-06 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992317+0000", 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001454573 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.992599+0000", 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028242099999999998 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.007288+0000", 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014688853 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.011276460999994, 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022682233999999999, 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990907+0000", 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990908+0000", 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5e-06 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990918+0000", 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.927e-06 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990937+0000", 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8595999999999999e-05 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990946+0000", 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994625+0000", 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036780509999999999 2024-09-20T20:31:33.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.994995+0000", 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00037006400000000003 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.013589+0000", 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018594245999999998 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 98.011224095000003, 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023453609, 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990959+0000", 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990960+0000", 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-07 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990964+0000", 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8369999999999999e-06 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990973+0000", 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.990980+0000", 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991080+0000", 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010044599999999999 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:54.991243+0000", 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162728 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014413+0000", 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023169478 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:33.048 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 97.998562751999998, 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010856199, 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003620+0000", 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003621+0000", 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8299999999999995e-07 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003647+0000", 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5337000000000002e-05 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003665+0000", 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8386e-05 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.003679+0000", 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-05 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005521+0000", 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018423249999999999 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.005571+0000", 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9639999999999999e-05 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014392+0000", 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088217950000000003 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:29:55.014477+0000", 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4192999999999998e-05 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:33.052 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.333934407999999, 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.031810205000000001, 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668249+0000", 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.668251+0000", 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1670000000000002e-06 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678059+0000", 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098083630000000005 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678091+0000", 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2264999999999997e-05 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678107+0000", 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5237e-05 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678284+0000", 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017715400000000001 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678614+0000", 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033010199999999998 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678862+0000", 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024798300000000001 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693888+0000", 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015026042 2024-09-20T20:31:33.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.699770+0000", 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005881977 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.699932+0000", 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016219300000000001 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.700059+0000", 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012672200000000001 2024-09-20T20:31:33.057 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.323675551999999, 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015489401999999999, 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:33.058 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 11 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678508+0000", 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678509+0000", 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1930000000000001e-06 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678531+0000", 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2330000000000001e-05 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678555+0000", 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3643e-05 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678569+0000", 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4606e-05 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678672+0000", 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010277600000000001 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678920+0000", 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024821899999999999 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.679469+0000", 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00054898600000000001 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.688799+0000", 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0093301949999999995 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693821+0000", 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050211240000000001 2024-09-20T20:31:33.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693890+0000", 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9154999999999998e-05 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.693997+0000", 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107175 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.323587702999999, 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01562446, 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 12 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678595+0000", 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678597+0000", 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2669999999999999e-06 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678605+0000", 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3629999999999994e-06 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678632+0000", 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7382e-05 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.678646+0000", 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3869999999999999e-05 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682178+0000", 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003531494 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682531+0000", 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035335800000000001 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.682918+0000", 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038688500000000001 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.688860+0000", 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059416829999999997 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694011+0000", 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051511639999999997 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694101+0000", 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0092000000000004e-05 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694220+0000", 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011890199999999999 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.320483529000001, 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012760664999999999, 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:33.069 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 15 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681700+0000", 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681703+0000", 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0960000000000001e-06 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681724+0000", 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1605999999999999e-05 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681754+0000", 2024-09-20T20:31:33.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9954000000000002e-05 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.681773+0000", 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9286000000000001e-05 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.683826+0000", 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020528230000000001 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.684134+0000", 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00030764600000000002 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.684381+0000", 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024691200000000001 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.687821+0000", 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034405070000000002 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694239+0000", 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064180419999999997 2024-09-20T20:31:33.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694363+0000", 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012394199999999999 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:20.694460+0000", 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6850999999999998e-05 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:61 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.0025745260000001, 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.024989884, 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999609+0000", 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999610+0000", 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9139999999999998e-06 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999817+0000", 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000206873 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999845+0000", 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8059999999999999e-05 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999859+0000", 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3723999999999999e-05 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:23.999987+0000", 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012830400000000001 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.000226+0000", 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023849099999999999 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.014425+0000", 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014199570999999999 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024188+0000", 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0097624600000000006 2024-09-20T20:31:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024341+0000", 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015279399999999999 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024489+0000", 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014786199999999999 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:24.024598+0000", 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109831 2024-09-20T20:31:33.079 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:63 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:25.001441+0000", 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.0007422090000002, 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018557256000000001, 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001441+0000", 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001441+0000", 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001442+0000", 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.53e-06 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001678+0000", 2024-09-20T20:31:33.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023562400000000001 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001697+0000", 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8783e-05 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001708+0000", 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1569000000000001e-05 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001784+0000", 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5920000000000005e-05 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.001872+0000", 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7348000000000005e-05 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.007833+0000", 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005961849 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.015871+0000", 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080379330000000006 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.019756+0000", 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038847999999999999 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.019894+0000", 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137961 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:25.019998+0000", 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103939 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:128 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:28.008833+0000", 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.9933500940000002, 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027545402, 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.085 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008833+0000", 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008833+0000", 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008834+0000", 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.373e-06 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008917+0000", 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2777999999999999e-05 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008939+0000", 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1539000000000002e-05 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.008950+0000", 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1603000000000001e-05 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.009067+0000", 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116494 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.009287+0000", 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022018299999999999 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.020160+0000", 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010873185 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.033789+0000", 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01362847 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.036258+0000", 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024696240000000001 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.036337+0000", 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8584000000000005e-05 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.036378+0000", 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1569000000000001e-05 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:129 3.1f 3:f83d65d8:::200.00000004:head [write 0~2880290 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:28.234074+0000", 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7681086639999997, 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020143351, 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.234074+0000", 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.234074+0000", 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.234076+0000", 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.57e-06 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.237650+0000", 2024-09-20T20:31:33.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035740770000000002 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.237676+0000", 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5789999999999999e-05 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.237689+0000", 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3217999999999999e-05 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.237791+0000", 2024-09-20T20:31:33.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102259 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.237931+0000", 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013954000000000001 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.238175+0000", 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024436999999999999 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.247949+0000", 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0097733750000000008 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.254097+0000", 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061485790000000004 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.254170+0000", 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2652999999999997e-05 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:28.254218+0000", 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7920000000000002e-05 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:133 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:29.010640+0000", 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.9915433460000003, 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.026315946, 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.096 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.010640+0000", 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.010640+0000", 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.010642+0000", 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2929999999999999e-06 2024-09-20T20:31:33.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.010715+0000", 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2837999999999996e-05 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.010747+0000", 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2143e-05 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.010763+0000", 2024-09-20T20:31:33.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5685999999999999e-05 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.010937+0000", 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000174733 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.011075+0000", 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013729000000000001 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.018746+0000", 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076711430000000001 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.034962+0000", 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016215805999999999 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.036651+0000", 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001688869 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.036841+0000", 2024-09-20T20:31:33.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000190602 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:29.036956+0000", 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114543 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:206 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:32.016218+0000", 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.98596516300000003, 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.027144532999999998, 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:33.101 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.016218+0000", 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.016218+0000", 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:33.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.016227+0000", 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6170000000000007e-06 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.016407+0000", 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000180509 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.016431+0000", 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3485999999999998e-05 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.016443+0000", 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.296e-05 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.016601+0000", 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000157706 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.016851+0000", 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024973699999999998 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.024603+0000", 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0077520100000000002 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.042238+0000", 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017635075 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.043114+0000", 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00087555599999999999 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.043272+0000", 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015867600000000001 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:32.043362+0000", 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0200999999999999e-05 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:33.106 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:33.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:33.110 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:31:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:31:33.113 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-20T20:31:32.743060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83718511,"num_objects":8938,"num_object_clones":0,"num_object_copies":17876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8938,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":9349,"num_write_kb":90141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9284,"ondisk_log_size":9284,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":224944,"kb_used_data":123056,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":282890576,"statfs":{"total":289910292480,"available":289679949824,"internally_reserved":0,"allocated":126009344,"data_stored":157757012,"data_compressed":19870315,"data_compressed_allocated":24449024,"data_compressed_original":96980992,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,0,2,4,8,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64786586,"num_objects":7615,"num_object_clones":0,"num_object_copies":15230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7780,"num_write_kb":67889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.114064"},"pg_stats":[{"pgid":"4.3f","version":"50'134","reported_seq":161,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.523231+0000","last_change":"2024-09-20T20:31:10.499400+0000","last_active":"2024-09-20T20:31:32.523231+0000","last_peered":"2024-09-20T20:31:32.523231+0000","last_clean":"2024-09-20T20:31:32.523231+0000","last_became_active":"2024-09-20T20:31:10.498733+0000","last_became_peered":"2024-09-20T20:31:10.498733+0000","last_unstale":"2024-09-20T20:31:32.523231+0000","last_undegraded":"2024-09-20T20:31:32.523231+0000","last_fullsized":"2024-09-20T20:31:32.523231+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:14:13.270936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":647185,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"50'136","reported_seq":210,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.631742+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:31:32.631742+0000","last_peered":"2024-09-20T20:31:32.631742+0000","last_clean":"2024-09-20T20:31:32.631742+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:31:32.631742+0000","last_undegraded":"2024-09-20T20:31:32.631742+0000","last_fullsized":"2024-09-20T20:31:32.631742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498916,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"50'125","reported_seq":199,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.539302+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:31:32.539302+0000","last_peered":"2024-09-20T20:31:32.539302+0000","last_clean":"2024-09-20T20:31:32.539302+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:31:32.539302+0000","last_undegraded":"2024-09-20T20:31:32.539302+0000","last_fullsized":"2024-09-20T20:31:32.539302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844413,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"50'127","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.627503+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:31:32.627503+0000","last_peered":"2024-09-20T20:31:32.627503+0000","last_clean":"2024-09-20T20:31:32.627503+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:31:32.627503+0000","last_undegraded":"2024-09-20T20:31:32.627503+0000","last_fullsized":"2024-09-20T20:31:32.627503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1031248,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"50'148","reported_seq":175,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.561445+0000","last_change":"2024-09-20T20:31:10.499321+0000","last_active":"2024-09-20T20:31:32.561445+0000","last_peered":"2024-09-20T20:31:32.561445+0000","last_clean":"2024-09-20T20:31:32.561445+0000","last_became_active":"2024-09-20T20:31:10.496829+0000","last_became_peered":"2024-09-20T20:31:10.496829+0000","last_unstale":"2024-09-20T20:31:32.561445+0000","last_undegraded":"2024-09-20T20:31:32.561445+0000","last_fullsized":"2024-09-20T20:31:32.561445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:55.974282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114110,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":1167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"50'140","reported_seq":214,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.616582+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:31:32.616582+0000","last_peered":"2024-09-20T20:31:32.616582+0000","last_clean":"2024-09-20T20:31:32.616582+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:31:32.616582+0000","last_undegraded":"2024-09-20T20:31:32.616582+0000","last_fullsized":"2024-09-20T20:31:32.616582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587871,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"50'151","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.530415+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:31:32.530415+0000","last_peered":"2024-09-20T20:31:32.530415+0000","last_clean":"2024-09-20T20:31:32.530415+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:31:32.530415+0000","last_undegraded":"2024-09-20T20:31:32.530415+0000","last_fullsized":"2024-09-20T20:31:32.530415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":613477,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"50'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.641636+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:31:32.641636+0000","last_peered":"2024-09-20T20:31:32.641636+0000","last_clean":"2024-09-20T20:31:32.641636+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:31:32.641636+0000","last_undegraded":"2024-09-20T20:31:32.641636+0000","last_fullsized":"2024-09-20T20:31:32.641636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721999,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"50'147","reported_seq":221,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.589234+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:31:32.589234+0000","last_peered":"2024-09-20T20:31:32.589234+0000","last_clean":"2024-09-20T20:31:32.589234+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:31:32.589234+0000","last_undegraded":"2024-09-20T20:31:32.589234+0000","last_fullsized":"2024-09-20T20:31:32.589234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610908,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"50'132","reported_seq":206,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.573514+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:31:32.573514+0000","last_peered":"2024-09-20T20:31:32.573514+0000","last_clean":"2024-09-20T20:31:32.573514+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:31:32.573514+0000","last_undegraded":"2024-09-20T20:31:32.573514+0000","last_fullsized":"2024-09-20T20:31:32.573514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586148,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"50'127","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.550669+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:31:32.550669+0000","last_peered":"2024-09-20T20:31:32.550669+0000","last_clean":"2024-09-20T20:31:32.550669+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:31:32.550669+0000","last_undegraded":"2024-09-20T20:31:32.550669+0000","last_fullsized":"2024-09-20T20:31:32.550669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368992,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"50'125","reported_seq":152,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.689759+0000","last_change":"2024-09-20T20:31:10.497886+0000","last_active":"2024-09-20T20:31:32.689759+0000","last_peered":"2024-09-20T20:31:32.689759+0000","last_clean":"2024-09-20T20:31:32.689759+0000","last_became_active":"2024-09-20T20:31:10.495584+0000","last_became_peered":"2024-09-20T20:31:10.495584+0000","last_unstale":"2024-09-20T20:31:32.689759+0000","last_undegraded":"2024-09-20T20:31:32.689759+0000","last_fullsized":"2024-09-20T20:31:32.689759+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:27.934463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377888,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"50'143","reported_seq":170,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.662420+0000","last_change":"2024-09-20T20:31:10.500370+0000","last_active":"2024-09-20T20:31:32.662420+0000","last_peered":"2024-09-20T20:31:32.662420+0000","last_clean":"2024-09-20T20:31:32.662420+0000","last_became_active":"2024-09-20T20:31:10.497142+0000","last_became_peered":"2024-09-20T20:31:10.497142+0000","last_unstale":"2024-09-20T20:31:32.662420+0000","last_undegraded":"2024-09-20T20:31:32.662420+0000","last_fullsized":"2024-09-20T20:31:32.662420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:17.243572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530794,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"50'139","reported_seq":213,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.302453+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:31:32.302453+0000","last_peered":"2024-09-20T20:31:32.302453+0000","last_clean":"2024-09-20T20:31:32.302453+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:31:32.302453+0000","last_undegraded":"2024-09-20T20:31:32.302453+0000","last_fullsized":"2024-09-20T20:31:32.302453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4913706,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"50'138","reported_seq":212,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.643438+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:31:32.643438+0000","last_peered":"2024-09-20T20:31:32.643438+0000","last_clean":"2024-09-20T20:31:32.643438+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:31:32.643438+0000","last_undegraded":"2024-09-20T20:31:32.643438+0000","last_fullsized":"2024-09-20T20:31:32.643438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":879890,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"50'151","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.619449+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:31:32.619449+0000","last_peered":"2024-09-20T20:31:32.619449+0000","last_clean":"2024-09-20T20:31:32.619449+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:31:32.619449+0000","last_undegraded":"2024-09-20T20:31:32.619449+0000","last_fullsized":"2024-09-20T20:31:32.619449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":651799,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"50'140","reported_seq":214,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.447623+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:31:32.447623+0000","last_peered":"2024-09-20T20:31:32.447623+0000","last_clean":"2024-09-20T20:31:32.447623+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:31:32.447623+0000","last_undegraded":"2024-09-20T20:31:32.447623+0000","last_fullsized":"2024-09-20T20:31:32.447623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440117,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"50'134","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.465661+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:31:32.465661+0000","last_peered":"2024-09-20T20:31:32.465661+0000","last_clean":"2024-09-20T20:31:32.465661+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:31:32.465661+0000","last_undegraded":"2024-09-20T20:31:32.465661+0000","last_fullsized":"2024-09-20T20:31:32.465661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418599,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"50'133","reported_seq":170,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.621610+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:31:32.621610+0000","last_peered":"2024-09-20T20:31:32.621610+0000","last_clean":"2024-09-20T20:31:32.621610+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:31:32.621610+0000","last_undegraded":"2024-09-20T20:31:32.621610+0000","last_fullsized":"2024-09-20T20:31:32.621610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582507,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"50'162","reported_seq":236,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.651579+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:31:32.651579+0000","last_peered":"2024-09-20T20:31:32.651579+0000","last_clean":"2024-09-20T20:31:32.651579+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:31:32.651579+0000","last_undegraded":"2024-09-20T20:31:32.651579+0000","last_fullsized":"2024-09-20T20:31:32.651579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662647,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"50'131","reported_seq":205,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.398233+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:31:32.398233+0000","last_peered":"2024-09-20T20:31:32.398233+0000","last_clean":"2024-09-20T20:31:32.398233+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:31:32.398233+0000","last_undegraded":"2024-09-20T20:31:32.398233+0000","last_fullsized":"2024-09-20T20:31:32.398233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":583631,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"50'150","reported_seq":177,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.545130+0000","last_change":"2024-09-20T20:31:10.496019+0000","last_active":"2024-09-20T20:31:32.545130+0000","last_peered":"2024-09-20T20:31:32.545130+0000","last_clean":"2024-09-20T20:31:32.545130+0000","last_became_active":"2024-09-20T20:31:10.495129+0000","last_became_peered":"2024-09-20T20:31:10.495129+0000","last_unstale":"2024-09-20T20:31:32.545130+0000","last_undegraded":"2024-09-20T20:31:32.545130+0000","last_fullsized":"2024-09-20T20:31:32.545130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:25:23.362031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":601766,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"50'136","reported_seq":210,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.643386+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:31:32.643386+0000","last_peered":"2024-09-20T20:31:32.643386+0000","last_clean":"2024-09-20T20:31:32.643386+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:31:32.643386+0000","last_undegraded":"2024-09-20T20:31:32.643386+0000","last_fullsized":"2024-09-20T20:31:32.643386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028846,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"50'144","reported_seq":171,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.569734+0000","last_change":"2024-09-20T20:31:10.498817+0000","last_active":"2024-09-20T20:31:32.569734+0000","last_peered":"2024-09-20T20:31:32.569734+0000","last_clean":"2024-09-20T20:31:32.569734+0000","last_became_active":"2024-09-20T20:31:10.497885+0000","last_became_peered":"2024-09-20T20:31:10.497885+0000","last_unstale":"2024-09-20T20:31:32.569734+0000","last_undegraded":"2024-09-20T20:31:32.569734+0000","last_fullsized":"2024-09-20T20:31:32.569734+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:07.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714276,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"50'157","reported_seq":184,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.467071+0000","last_change":"2024-09-20T20:31:10.497852+0000","last_active":"2024-09-20T20:31:32.467071+0000","last_peered":"2024-09-20T20:31:32.467071+0000","last_clean":"2024-09-20T20:31:32.467071+0000","last_became_active":"2024-09-20T20:31:10.496002+0000","last_became_peered":"2024-09-20T20:31:10.496002+0000","last_unstale":"2024-09-20T20:31:32.467071+0000","last_undegraded":"2024-09-20T20:31:32.467071+0000","last_fullsized":"2024-09-20T20:31:32.467071+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:10.127090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476514,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"50'161","reported_seq":235,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.348049+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:31:32.348049+0000","last_peered":"2024-09-20T20:31:32.348049+0000","last_clean":"2024-09-20T20:31:32.348049+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:31:32.348049+0000","last_undegraded":"2024-09-20T20:31:32.348049+0000","last_fullsized":"2024-09-20T20:31:32.348049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":675464,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"50'134","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.386632+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:31:32.386632+0000","last_peered":"2024-09-20T20:31:32.386632+0000","last_clean":"2024-09-20T20:31:32.386632+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:31:32.386632+0000","last_undegraded":"2024-09-20T20:31:32.386632+0000","last_fullsized":"2024-09-20T20:31:32.386632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694501,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"50'131","reported_seq":205,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.502937+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:31:32.502937+0000","last_peered":"2024-09-20T20:31:32.502937+0000","last_clean":"2024-09-20T20:31:32.502937+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:31:32.502937+0000","last_undegraded":"2024-09-20T20:31:32.502937+0000","last_fullsized":"2024-09-20T20:31:32.502937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580152,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"50'126","reported_seq":200,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.473499+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:31:32.473499+0000","last_peered":"2024-09-20T20:31:32.473499+0000","last_clean":"2024-09-20T20:31:32.473499+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:31:32.473499+0000","last_undegraded":"2024-09-20T20:31:32.473499+0000","last_fullsized":"2024-09-20T20:31:32.473499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624185,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"50'155","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.693990+0000","last_change":"2024-09-20T20:31:10.495910+0000","last_active":"2024-09-20T20:31:32.693990+0000","last_peered":"2024-09-20T20:31:32.693990+0000","last_clean":"2024-09-20T20:31:32.693990+0000","last_became_active":"2024-09-20T20:31:10.495116+0000","last_became_peered":"2024-09-20T20:31:10.495116+0000","last_unstale":"2024-09-20T20:31:32.693990+0000","last_undegraded":"2024-09-20T20:31:32.693990+0000","last_fullsized":"2024-09-20T20:31:32.693990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:08.218160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645914,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"50'157","reported_seq":231,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.477616+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:31:32.477616+0000","last_peered":"2024-09-20T20:31:32.477616+0000","last_clean":"2024-09-20T20:31:32.477616+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:31:32.477616+0000","last_undegraded":"2024-09-20T20:31:32.477616+0000","last_fullsized":"2024-09-20T20:31:32.477616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998749,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"50'159","reported_seq":233,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.645967+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:31:32.645967+0000","last_peered":"2024-09-20T20:31:32.645967+0000","last_clean":"2024-09-20T20:31:32.645967+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:31:32.645967+0000","last_undegraded":"2024-09-20T20:31:32.645967+0000","last_fullsized":"2024-09-20T20:31:32.645967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2222207,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":2254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"50'128","reported_seq":155,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.549839+0000","last_change":"2024-09-20T20:31:10.499837+0000","last_active":"2024-09-20T20:31:32.549839+0000","last_peered":"2024-09-20T20:31:32.549839+0000","last_clean":"2024-09-20T20:31:32.549839+0000","last_became_active":"2024-09-20T20:31:10.499019+0000","last_became_peered":"2024-09-20T20:31:10.499019+0000","last_unstale":"2024-09-20T20:31:32.549839+0000","last_undegraded":"2024-09-20T20:31:32.549839+0000","last_fullsized":"2024-09-20T20:31:32.549839+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:57.428556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631697,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"50'4","reported_seq":80,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745432+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:31:31.745432+0000","last_peered":"2024-09-20T20:31:31.745432+0000","last_clean":"2024-09-20T20:31:31.745432+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:31:31.745432+0000","last_undegraded":"2024-09-20T20:31:31.745432+0000","last_fullsized":"2024-09-20T20:31:31.745432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"50'134","reported_seq":161,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.613211+0000","last_change":"2024-09-20T20:31:10.499750+0000","last_active":"2024-09-20T20:31:32.613211+0000","last_peered":"2024-09-20T20:31:32.613211+0000","last_clean":"2024-09-20T20:31:32.613211+0000","last_became_active":"2024-09-20T20:31:10.498865+0000","last_became_peered":"2024-09-20T20:31:10.498865+0000","last_unstale":"2024-09-20T20:31:32.613211+0000","last_undegraded":"2024-09-20T20:31:32.613211+0000","last_fullsized":"2024-09-20T20:31:32.613211+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:35.447873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575358,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745184+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:31:31.745184+0000","last_peered":"2024-09-20T20:31:31.745184+0000","last_clean":"2024-09-20T20:31:31.745184+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:31:31.745184+0000","last_undegraded":"2024-09-20T20:31:31.745184+0000","last_fullsized":"2024-09-20T20:31:31.745184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"50'149","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.605940+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:31:32.605940+0000","last_peered":"2024-09-20T20:31:32.605940+0000","last_clean":"2024-09-20T20:31:32.605940+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:31:32.605940+0000","last_undegraded":"2024-09-20T20:31:32.605940+0000","last_fullsized":"2024-09-20T20:31:32.605940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":572191,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744857+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:31:31.744857+0000","last_peered":"2024-09-20T20:31:31.744857+0000","last_clean":"2024-09-20T20:31:31.744857+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:31:31.744857+0000","last_undegraded":"2024-09-20T20:31:31.744857+0000","last_fullsized":"2024-09-20T20:31:31.744857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"50'129","reported_seq":203,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.492117+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:31:32.492117+0000","last_peered":"2024-09-20T20:31:32.492117+0000","last_clean":"2024-09-20T20:31:32.492117+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:31:32.492117+0000","last_undegraded":"2024-09-20T20:31:32.492117+0000","last_fullsized":"2024-09-20T20:31:32.492117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559500,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":84,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744662+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:31:31.744662+0000","last_peered":"2024-09-20T20:31:31.744662+0000","last_clean":"2024-09-20T20:31:31.744662+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:31:31.744662+0000","last_undegraded":"2024-09-20T20:31:31.744662+0000","last_fullsized":"2024-09-20T20:31:31.744662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746489+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:31:31.746489+0000","last_peered":"2024-09-20T20:31:31.746489+0000","last_clean":"2024-09-20T20:31:31.746489+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:31:31.746489+0000","last_undegraded":"2024-09-20T20:31:31.746489+0000","last_fullsized":"2024-09-20T20:31:31.746489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"50'142","reported_seq":216,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.626620+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:31:32.626620+0000","last_peered":"2024-09-20T20:31:32.626620+0000","last_clean":"2024-09-20T20:31:32.626620+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:31:32.626620+0000","last_undegraded":"2024-09-20T20:31:32.626620+0000","last_fullsized":"2024-09-20T20:31:32.626620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654856,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746653+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:31:31.746653+0000","last_peered":"2024-09-20T20:31:31.746653+0000","last_clean":"2024-09-20T20:31:31.746653+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:31:31.746653+0000","last_undegraded":"2024-09-20T20:31:31.746653+0000","last_fullsized":"2024-09-20T20:31:31.746653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'157","reported_seq":184,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.467476+0000","last_change":"2024-09-20T20:31:10.497170+0000","last_active":"2024-09-20T20:31:32.467476+0000","last_peered":"2024-09-20T20:31:32.467476+0000","last_clean":"2024-09-20T20:31:32.467476+0000","last_became_active":"2024-09-20T20:31:10.496258+0000","last_became_peered":"2024-09-20T20:31:10.496258+0000","last_unstale":"2024-09-20T20:31:32.467476+0000","last_undegraded":"2024-09-20T20:31:32.467476+0000","last_fullsized":"2024-09-20T20:31:32.467476+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:25.042093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465619,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":1509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746898+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:31:31.746898+0000","last_peered":"2024-09-20T20:31:31.746898+0000","last_clean":"2024-09-20T20:31:31.746898+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:31:31.746898+0000","last_undegraded":"2024-09-20T20:31:31.746898+0000","last_fullsized":"2024-09-20T20:31:31.746898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'137","reported_seq":211,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.395028+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:31:32.395028+0000","last_peered":"2024-09-20T20:31:32.395028+0000","last_clean":"2024-09-20T20:31:32.395028+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:31:32.395028+0000","last_undegraded":"2024-09-20T20:31:32.395028+0000","last_fullsized":"2024-09-20T20:31:32.395028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590489,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745912+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:31:31.745912+0000","last_peered":"2024-09-20T20:31:31.745912+0000","last_clean":"2024-09-20T20:31:31.745912+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:31:31.745912+0000","last_undegraded":"2024-09-20T20:31:31.745912+0000","last_fullsized":"2024-09-20T20:31:31.745912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"50'149","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.505631+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:31:32.505631+0000","last_peered":"2024-09-20T20:31:32.505631+0000","last_clean":"2024-09-20T20:31:32.505631+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:31:32.505631+0000","last_undegraded":"2024-09-20T20:31:32.505631+0000","last_fullsized":"2024-09-20T20:31:32.505631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566441,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"47'59","reported_seq":135,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745752+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:31:31.745752+0000","last_peered":"2024-09-20T20:31:31.745752+0000","last_clean":"2024-09-20T20:31:31.745752+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:31:31.745752+0000","last_undegraded":"2024-09-20T20:31:31.745752+0000","last_fullsized":"2024-09-20T20:31:31.745752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"50'157","reported_seq":231,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.677609+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:31:32.677609+0000","last_peered":"2024-09-20T20:31:32.677609+0000","last_clean":"2024-09-20T20:31:32.677609+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:31:32.677609+0000","last_undegraded":"2024-09-20T20:31:32.677609+0000","last_fullsized":"2024-09-20T20:31:32.677609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784930,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746799+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:31:31.746799+0000","last_peered":"2024-09-20T20:31:31.746799+0000","last_clean":"2024-09-20T20:31:31.746799+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:31:31.746799+0000","last_undegraded":"2024-09-20T20:31:31.746799+0000","last_fullsized":"2024-09-20T20:31:31.746799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"50'144","reported_seq":218,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.487611+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:31:32.487611+0000","last_peered":"2024-09-20T20:31:32.487611+0000","last_clean":"2024-09-20T20:31:32.487611+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:31:32.487611+0000","last_undegraded":"2024-09-20T20:31:32.487611+0000","last_fullsized":"2024-09-20T20:31:32.487611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514837,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744715+0000","last_change":"2024-09-20T20:31:10.497330+0000","last_active":"2024-09-20T20:31:31.744715+0000","last_peered":"2024-09-20T20:31:31.744715+0000","last_clean":"2024-09-20T20:31:31.744715+0000","last_became_active":"2024-09-20T20:31:10.495375+0000","last_became_peered":"2024-09-20T20:31:10.495375+0000","last_unstale":"2024-09-20T20:31:31.744715+0000","last_undegraded":"2024-09-20T20:31:31.744715+0000","last_fullsized":"2024-09-20T20:31:31.744715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:06.652761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"50'125","reported_seq":199,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.586561+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:31:32.586561+0000","last_peered":"2024-09-20T20:31:32.586561+0000","last_clean":"2024-09-20T20:31:32.586561+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:31:32.586561+0000","last_undegraded":"2024-09-20T20:31:32.586561+0000","last_fullsized":"2024-09-20T20:31:32.586561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531230,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744688+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:31:31.744688+0000","last_peered":"2024-09-20T20:31:31.744688+0000","last_clean":"2024-09-20T20:31:31.744688+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:31:31.744688+0000","last_undegraded":"2024-09-20T20:31:31.744688+0000","last_fullsized":"2024-09-20T20:31:31.744688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"50'130","reported_seq":204,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.520535+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:31:32.520535+0000","last_peered":"2024-09-20T20:31:32.520535+0000","last_clean":"2024-09-20T20:31:32.520535+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:31:32.520535+0000","last_undegraded":"2024-09-20T20:31:32.520535+0000","last_fullsized":"2024-09-20T20:31:32.520535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455004,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":286,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744952+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:31:31.744952+0000","last_peered":"2024-09-20T20:31:31.744952+0000","last_clean":"2024-09-20T20:31:31.744952+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:31:31.744952+0000","last_undegraded":"2024-09-20T20:31:31.744952+0000","last_fullsized":"2024-09-20T20:31:31.744952+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745491+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:31:31.745491+0000","last_peered":"2024-09-20T20:31:31.745491+0000","last_clean":"2024-09-20T20:31:31.745491+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:31:31.745491+0000","last_undegraded":"2024-09-20T20:31:31.745491+0000","last_fullsized":"2024-09-20T20:31:31.745491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"48'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745454+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:31:31.745454+0000","last_peered":"2024-09-20T20:31:31.745454+0000","last_clean":"2024-09-20T20:31:31.745454+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:31:31.745454+0000","last_undegraded":"2024-09-20T20:31:31.745454+0000","last_fullsized":"2024-09-20T20:31:31.745454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"50'147","reported_seq":221,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.537251+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:31:32.537251+0000","last_peered":"2024-09-20T20:31:32.537251+0000","last_clean":"2024-09-20T20:31:32.537251+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:31:32.537251+0000","last_undegraded":"2024-09-20T20:31:32.537251+0000","last_fullsized":"2024-09-20T20:31:32.537251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635297,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744754+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:31:31.744754+0000","last_peered":"2024-09-20T20:31:31.744754+0000","last_clean":"2024-09-20T20:31:31.744754+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:31:31.744754+0000","last_undegraded":"2024-09-20T20:31:31.744754+0000","last_fullsized":"2024-09-20T20:31:31.744754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747089+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:31:31.747089+0000","last_peered":"2024-09-20T20:31:31.747089+0000","last_clean":"2024-09-20T20:31:31.747089+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:31:31.747089+0000","last_undegraded":"2024-09-20T20:31:31.747089+0000","last_fullsized":"2024-09-20T20:31:31.747089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"50'141","reported_seq":168,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.606517+0000","last_change":"2024-09-20T20:31:10.498550+0000","last_active":"2024-09-20T20:31:32.606517+0000","last_peered":"2024-09-20T20:31:32.606517+0000","last_clean":"2024-09-20T20:31:32.606517+0000","last_became_active":"2024-09-20T20:31:10.497702+0000","last_became_peered":"2024-09-20T20:31:10.497702+0000","last_unstale":"2024-09-20T20:31:32.606517+0000","last_undegraded":"2024-09-20T20:31:32.606517+0000","last_fullsized":"2024-09-20T20:31:32.606517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:29.034503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520894,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747406+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:31:31.747406+0000","last_peered":"2024-09-20T20:31:31.747406+0000","last_clean":"2024-09-20T20:31:31.747406+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:31:31.747406+0000","last_undegraded":"2024-09-20T20:31:31.747406+0000","last_fullsized":"2024-09-20T20:31:31.747406+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'2","reported_seq":29,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744290+0000","last_change":"2024-09-20T20:31:10.495583+0000","last_active":"2024-09-20T20:31:31.744290+0000","last_peered":"2024-09-20T20:31:31.744290+0000","last_clean":"2024-09-20T20:31:31.744290+0000","last_became_active":"2024-09-20T20:31:10.493901+0000","last_became_peered":"2024-09-20T20:31:10.493901+0000","last_unstale":"2024-09-20T20:31:31.744290+0000","last_undegraded":"2024-09-20T20:31:31.744290+0000","last_fullsized":"2024-09-20T20:31:31.744290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:29.771507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'128","reported_seq":202,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.419832+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:31:32.419832+0000","last_peered":"2024-09-20T20:31:32.419832+0000","last_clean":"2024-09-20T20:31:32.419832+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:31:32.419832+0000","last_undegraded":"2024-09-20T20:31:32.419832+0000","last_fullsized":"2024-09-20T20:31:32.419832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":734042,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":91,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746933+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:31:31.746933+0000","last_peered":"2024-09-20T20:31:31.746933+0000","last_clean":"2024-09-20T20:31:31.746933+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:31:31.746933+0000","last_undegraded":"2024-09-20T20:31:31.746933+0000","last_fullsized":"2024-09-20T20:31:31.746933+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745479+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:31:31.745479+0000","last_peered":"2024-09-20T20:31:31.745479+0000","last_clean":"2024-09-20T20:31:31.745479+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:31:31.745479+0000","last_undegraded":"2024-09-20T20:31:31.745479+0000","last_fullsized":"2024-09-20T20:31:31.745479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"50'121","reported_seq":195,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.599833+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:31:32.599833+0000","last_peered":"2024-09-20T20:31:32.599833+0000","last_clean":"2024-09-20T20:31:32.599833+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:31:32.599833+0000","last_undegraded":"2024-09-20T20:31:32.599833+0000","last_fullsized":"2024-09-20T20:31:32.599833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482206,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747030+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:31:31.747030+0000","last_peered":"2024-09-20T20:31:31.747030+0000","last_clean":"2024-09-20T20:31:31.747030+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:31:31.747030+0000","last_undegraded":"2024-09-20T20:31:31.747030+0000","last_fullsized":"2024-09-20T20:31:31.747030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746192+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:31:31.746192+0000","last_peered":"2024-09-20T20:31:31.746192+0000","last_clean":"2024-09-20T20:31:31.746192+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:31:31.746192+0000","last_undegraded":"2024-09-20T20:31:31.746192+0000","last_fullsized":"2024-09-20T20:31:31.746192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"50'126","reported_seq":200,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.634353+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:31:32.634353+0000","last_peered":"2024-09-20T20:31:32.634353+0000","last_clean":"2024-09-20T20:31:32.634353+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:31:32.634353+0000","last_undegraded":"2024-09-20T20:31:32.634353+0000","last_fullsized":"2024-09-20T20:31:32.634353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505603,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745972+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:31:31.745972+0000","last_peered":"2024-09-20T20:31:31.745972+0000","last_clean":"2024-09-20T20:31:31.745972+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:31:31.745972+0000","last_undegraded":"2024-09-20T20:31:31.745972+0000","last_fullsized":"2024-09-20T20:31:31.745972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746579+0000","last_change":"2024-09-20T20:31:10.498717+0000","last_active":"2024-09-20T20:31:31.746579+0000","last_peered":"2024-09-20T20:31:31.746579+0000","last_clean":"2024-09-20T20:31:31.746579+0000","last_became_active":"2024-09-20T20:31:10.497894+0000","last_became_peered":"2024-09-20T20:31:10.497894+0000","last_unstale":"2024-09-20T20:31:31.746579+0000","last_undegraded":"2024-09-20T20:31:31.746579+0000","last_fullsized":"2024-09-20T20:31:31.746579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:03.959197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'136","reported_seq":210,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.289789+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:31:32.289789+0000","last_peered":"2024-09-20T20:31:32.289789+0000","last_clean":"2024-09-20T20:31:32.289789+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:31:32.289789+0000","last_undegraded":"2024-09-20T20:31:32.289789+0000","last_fullsized":"2024-09-20T20:31:32.289789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590504,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747390+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:31:31.747390+0000","last_peered":"2024-09-20T20:31:31.747390+0000","last_clean":"2024-09-20T20:31:31.747390+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:31:31.747390+0000","last_undegraded":"2024-09-20T20:31:31.747390+0000","last_fullsized":"2024-09-20T20:31:31.747390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747150+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:31:31.747150+0000","last_peered":"2024-09-20T20:31:31.747150+0000","last_clean":"2024-09-20T20:31:31.747150+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:31:31.747150+0000","last_undegraded":"2024-09-20T20:31:31.747150+0000","last_fullsized":"2024-09-20T20:31:31.747150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"50'147","reported_seq":221,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.658511+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:31:32.658511+0000","last_peered":"2024-09-20T20:31:32.658511+0000","last_clean":"2024-09-20T20:31:32.658511+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:31:32.658511+0000","last_undegraded":"2024-09-20T20:31:32.658511+0000","last_fullsized":"2024-09-20T20:31:32.658511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492364,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"50'16","reported_seq":92,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747552+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:31:31.747552+0000","last_peered":"2024-09-20T20:31:31.747552+0000","last_clean":"2024-09-20T20:31:31.747552+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:31:31.747552+0000","last_undegraded":"2024-09-20T20:31:31.747552+0000","last_fullsized":"2024-09-20T20:31:31.747552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746489+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:31:31.746489+0000","last_peered":"2024-09-20T20:31:31.746489+0000","last_clean":"2024-09-20T20:31:31.746489+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:31:31.746489+0000","last_undegraded":"2024-09-20T20:31:31.746489+0000","last_fullsized":"2024-09-20T20:31:31.746489+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"50'129","reported_seq":203,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.591376+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:31:32.591376+0000","last_peered":"2024-09-20T20:31:32.591376+0000","last_clean":"2024-09-20T20:31:32.591376+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:31:32.591376+0000","last_undegraded":"2024-09-20T20:31:32.591376+0000","last_fullsized":"2024-09-20T20:31:32.591376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":573332,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"50'136","reported_seq":210,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.564586+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:31:32.564586+0000","last_peered":"2024-09-20T20:31:32.564586+0000","last_clean":"2024-09-20T20:31:32.564586+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:31:32.564586+0000","last_undegraded":"2024-09-20T20:31:32.564586+0000","last_fullsized":"2024-09-20T20:31:32.564586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2904322,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":2908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"46'20","reported_seq":96,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745928+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:31:31.745928+0000","last_peered":"2024-09-20T20:31:31.745928+0000","last_clean":"2024-09-20T20:31:31.745928+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:31:31.745928+0000","last_undegraded":"2024-09-20T20:31:31.745928+0000","last_fullsized":"2024-09-20T20:31:31.745928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"50'134","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.628075+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:31:32.628075+0000","last_peered":"2024-09-20T20:31:32.628075+0000","last_clean":"2024-09-20T20:31:32.628075+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:31:32.628075+0000","last_undegraded":"2024-09-20T20:31:32.628075+0000","last_fullsized":"2024-09-20T20:31:32.628075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580987,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746505+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:31:31.746505+0000","last_peered":"2024-09-20T20:31:31.746505+0000","last_clean":"2024-09-20T20:31:31.746505+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:31:31.746505+0000","last_undegraded":"2024-09-20T20:31:31.746505+0000","last_fullsized":"2024-09-20T20:31:31.746505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746611+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:31:31.746611+0000","last_peered":"2024-09-20T20:31:31.746611+0000","last_clean":"2024-09-20T20:31:31.746611+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:31:31.746611+0000","last_undegraded":"2024-09-20T20:31:31.746611+0000","last_fullsized":"2024-09-20T20:31:31.746611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"50'147","reported_seq":221,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.601903+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:31:32.601903+0000","last_peered":"2024-09-20T20:31:32.601903+0000","last_clean":"2024-09-20T20:31:32.601903+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:31:32.601903+0000","last_undegraded":"2024-09-20T20:31:32.601903+0000","last_fullsized":"2024-09-20T20:31:32.601903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1271846,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747097+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:31:31.747097+0000","last_peered":"2024-09-20T20:31:31.747097+0000","last_clean":"2024-09-20T20:31:31.747097+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:31:31.747097+0000","last_undegraded":"2024-09-20T20:31:31.747097+0000","last_fullsized":"2024-09-20T20:31:31.747097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"50'155","reported_seq":229,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.564262+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:31:32.564262+0000","last_peered":"2024-09-20T20:31:32.564262+0000","last_clean":"2024-09-20T20:31:32.564262+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:31:32.564262+0000","last_undegraded":"2024-09-20T20:31:32.564262+0000","last_fullsized":"2024-09-20T20:31:32.564262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4854521,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"50'127","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.541947+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:31:32.541947+0000","last_peered":"2024-09-20T20:31:32.541947+0000","last_clean":"2024-09-20T20:31:32.541947+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:31:32.541947+0000","last_undegraded":"2024-09-20T20:31:32.541947+0000","last_fullsized":"2024-09-20T20:31:32.541947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":984629,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745481+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:31:31.745481+0000","last_peered":"2024-09-20T20:31:31.745481+0000","last_clean":"2024-09-20T20:31:31.745481+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:31:31.745481+0000","last_undegraded":"2024-09-20T20:31:31.745481+0000","last_fullsized":"2024-09-20T20:31:31.745481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"50'140","reported_seq":214,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.348625+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:31:32.348625+0000","last_peered":"2024-09-20T20:31:32.348625+0000","last_clean":"2024-09-20T20:31:32.348625+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:31:32.348625+0000","last_undegraded":"2024-09-20T20:31:32.348625+0000","last_fullsized":"2024-09-20T20:31:32.348625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":518974,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746911+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:31:31.746911+0000","last_peered":"2024-09-20T20:31:31.746911+0000","last_clean":"2024-09-20T20:31:31.746911+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:31:31.746911+0000","last_undegraded":"2024-09-20T20:31:31.746911+0000","last_fullsized":"2024-09-20T20:31:31.746911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"50'129","reported_seq":203,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.504423+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:31:32.504423+0000","last_peered":"2024-09-20T20:31:32.504423+0000","last_clean":"2024-09-20T20:31:32.504423+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:31:32.504423+0000","last_undegraded":"2024-09-20T20:31:32.504423+0000","last_fullsized":"2024-09-20T20:31:32.504423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532431,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"48'2","reported_seq":28,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744558+0000","last_change":"2024-09-20T20:31:10.497909+0000","last_active":"2024-09-20T20:31:31.744558+0000","last_peered":"2024-09-20T20:31:31.744558+0000","last_clean":"2024-09-20T20:31:31.744558+0000","last_became_active":"2024-09-20T20:31:10.496914+0000","last_became_peered":"2024-09-20T20:31:10.496914+0000","last_unstale":"2024-09-20T20:31:31.744558+0000","last_undegraded":"2024-09-20T20:31:31.744558+0000","last_fullsized":"2024-09-20T20:31:31.744558+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:20.329970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"50'126","reported_seq":153,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.487559+0000","last_change":"2024-09-20T20:31:10.498891+0000","last_active":"2024-09-20T20:31:32.487559+0000","last_peered":"2024-09-20T20:31:32.487559+0000","last_clean":"2024-09-20T20:31:32.487559+0000","last_became_active":"2024-09-20T20:31:10.498120+0000","last_became_peered":"2024-09-20T20:31:10.498120+0000","last_unstale":"2024-09-20T20:31:32.487559+0000","last_undegraded":"2024-09-20T20:31:32.487559+0000","last_fullsized":"2024-09-20T20:31:32.487559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:51.291631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610577,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745591+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:31:31.745591+0000","last_peered":"2024-09-20T20:31:31.745591+0000","last_clean":"2024-09-20T20:31:31.745591+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:31:31.745591+0000","last_undegraded":"2024-09-20T20:31:31.745591+0000","last_fullsized":"2024-09-20T20:31:31.745591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"50'124","reported_seq":198,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.424369+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:31:32.424369+0000","last_peered":"2024-09-20T20:31:32.424369+0000","last_clean":"2024-09-20T20:31:32.424369+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:31:32.424369+0000","last_undegraded":"2024-09-20T20:31:32.424369+0000","last_fullsized":"2024-09-20T20:31:32.424369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344164,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745797+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:31:31.745797+0000","last_peered":"2024-09-20T20:31:31.745797+0000","last_clean":"2024-09-20T20:31:31.745797+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:31:31.745797+0000","last_undegraded":"2024-09-20T20:31:31.745797+0000","last_fullsized":"2024-09-20T20:31:31.745797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"50'141","reported_seq":215,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.469958+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:31:32.469958+0000","last_peered":"2024-09-20T20:31:32.469958+0000","last_clean":"2024-09-20T20:31:32.469958+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:31:32.469958+0000","last_undegraded":"2024-09-20T20:31:32.469958+0000","last_fullsized":"2024-09-20T20:31:32.469958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474555,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'79","reported_seq":155,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.067721+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:31:32.067721+0000","last_peered":"2024-09-20T20:31:32.067721+0000","last_clean":"2024-09-20T20:31:32.067721+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:31:32.067721+0000","last_undegraded":"2024-09-20T20:31:32.067721+0000","last_fullsized":"2024-09-20T20:31:32.067721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"50'144","reported_seq":171,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.530029+0000","last_change":"2024-09-20T20:31:10.499495+0000","last_active":"2024-09-20T20:31:32.530029+0000","last_peered":"2024-09-20T20:31:32.530029+0000","last_clean":"2024-09-20T20:31:32.530029+0000","last_became_active":"2024-09-20T20:31:10.498620+0000","last_became_peered":"2024-09-20T20:31:10.498620+0000","last_unstale":"2024-09-20T20:31:32.530029+0000","last_undegraded":"2024-09-20T20:31:32.530029+0000","last_fullsized":"2024-09-20T20:31:32.530029+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:17:34.440116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":802575,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'3","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746833+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:31:31.746833+0000","last_peered":"2024-09-20T20:31:31.746833+0000","last_clean":"2024-09-20T20:31:31.746833+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:31:31.746833+0000","last_undegraded":"2024-09-20T20:31:31.746833+0000","last_fullsized":"2024-09-20T20:31:31.746833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"50'158","reported_seq":232,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.610627+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:31:32.610627+0000","last_peered":"2024-09-20T20:31:32.610627+0000","last_clean":"2024-09-20T20:31:32.610627+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:31:32.610627+0000","last_undegraded":"2024-09-20T20:31:32.610627+0000","last_fullsized":"2024-09-20T20:31:32.610627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521132,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":83,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746823+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:31:31.746823+0000","last_peered":"2024-09-20T20:31:31.746823+0000","last_clean":"2024-09-20T20:31:31.746823+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:31:31.746823+0000","last_undegraded":"2024-09-20T20:31:31.746823+0000","last_fullsized":"2024-09-20T20:31:31.746823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":53766526,"num_objects":8906,"num_object_clones":0,"num_object_copies":17812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8906,"num_write_kb":57149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":121237504,"data_stored":107545743,"data_compressed":12257474,"data_compressed_allocated":15171584,"data_compressed_original":44048384,"omap_allocated":0,"internal_metadata":0},"log_size":8907,"ondisk_log_size":8907,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":29361598,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":29530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11558912,"data_stored":58723196,"data_compressed":8821602,"data_compressed_allocated":10739712,"data_compressed_original":57958400,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738393,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74596,"kb_used_data":39244,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94297244,"statfs":{"total":96636764160,"available":96560377856,"internally_reserved":0,"allocated":40185856,"data_stored":50105869,"data_compressed":6464535,"data_compressed_allocated":8044544,"data_compressed_original":32296960,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738394,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73732,"kb_used_data":42544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94298108,"statfs":{"total":96636764160,"available":96561262592,"internally_reserved":0,"allocated":43565056,"data_stored":53184933,"data_compressed":6594500,"data_compressed_allocated":7979008,"data_compressed_original":30404608,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,0,2,4,8,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76616,"kb_used_data":41268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94295224,"statfs":{"total":96636764160,"available":96558309376,"internally_reserved":0,"allocated":42258432,"data_stored":54466210,"data_compressed":6811280,"data_compressed_allocated":8425472,"data_compressed_original":34279424,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4296704,"data_stored":20972990,"data_compressed":3205342,"data_compressed_allocated":3891200,"data_compressed_original":20594688,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4079616,"data_stored":20972374,"data_compressed":3164141,"data_compressed_allocated":3813376,"data_compressed_original":20725760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3182592,"data_stored":16777832,"data_compressed":2452119,"data_compressed_allocated":3035136,"data_compressed_original":16637952,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38584320,"data_stored":34289185,"data_compressed":3786673,"data_compressed_allocated":4726784,"data_compressed_original":14135296,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":43241472,"data_stored":37930521,"data_compressed":4225175,"data_compressed_allocated":5136384,"data_compressed_original":13643776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":39411712,"data_stored":35326037,"data_compressed":4245626,"data_compressed_allocated":5308416,"data_compressed_original":16269312,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:31:33.117 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:31:33.118 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:33.105+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:33.208 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:33.205+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:33.255 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:33.255 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:33.271 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:33.309 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:33.303+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:33.410 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:33.403+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:33.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:31:33.445 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:31:33.449 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:33.449 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:33.449 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:33.449 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:33.449 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:33.461 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-20T20:31:32.743060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83718511,"num_objects":8938,"num_object_clones":0,"num_object_copies":17876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8938,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":9349,"num_write_kb":90141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9284,"ondisk_log_size":9284,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":224944,"kb_used_data":123056,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":282890576,"statfs":{"total":289910292480,"available":289679949824,"internally_reserved":0,"allocated":126009344,"data_stored":157757012,"data_compressed":19870315,"data_compressed_allocated":24449024,"data_compressed_original":96980992,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,0,2,4,8,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64786586,"num_objects":7615,"num_object_clones":0,"num_object_copies":15230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7780,"num_write_kb":67889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.114064"},"pg_stats":[{"pgid":"4.3f","version":"50'134","reported_seq":161,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.523231+0000","last_change":"2024-09-20T20:31:10.499400+0000","last_active":"2024-09-20T20:31:32.523231+0000","last_peered":"2024-09-20T20:31:32.523231+0000","last_clean":"2024-09-20T20:31:32.523231+0000","last_became_active":"2024-09-20T20:31:10.498733+0000","last_became_peered":"2024-09-20T20:31:10.498733+0000","last_unstale":"2024-09-20T20:31:32.523231+0000","last_undegraded":"2024-09-20T20:31:32.523231+0000","last_fullsized":"2024-09-20T20:31:32.523231+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:14:13.270936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":647185,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"50'136","reported_seq":210,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.631742+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:31:32.631742+0000","last_peered":"2024-09-20T20:31:32.631742+0000","last_clean":"2024-09-20T20:31:32.631742+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:31:32.631742+0000","last_undegraded":"2024-09-20T20:31:32.631742+0000","last_fullsized":"2024-09-20T20:31:32.631742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498916,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"50'125","reported_seq":199,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.539302+0000","last_change":"2024-09-20T20:29:55.016835+0000","last_active":"2024-09-20T20:31:32.539302+0000","last_peered":"2024-09-20T20:31:32.539302+0000","last_clean":"2024-09-20T20:31:32.539302+0000","last_became_active":"2024-09-20T20:29:55.016079+0000","last_became_peered":"2024-09-20T20:29:55.016079+0000","last_unstale":"2024-09-20T20:31:32.539302+0000","last_undegraded":"2024-09-20T20:31:32.539302+0000","last_fullsized":"2024-09-20T20:31:32.539302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:19.284594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":844413,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"50'127","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.627503+0000","last_change":"2024-09-20T20:29:55.013664+0000","last_active":"2024-09-20T20:31:32.627503+0000","last_peered":"2024-09-20T20:31:32.627503+0000","last_clean":"2024-09-20T20:31:32.627503+0000","last_became_active":"2024-09-20T20:29:55.012205+0000","last_became_peered":"2024-09-20T20:29:55.012205+0000","last_unstale":"2024-09-20T20:31:32.627503+0000","last_undegraded":"2024-09-20T20:31:32.627503+0000","last_fullsized":"2024-09-20T20:31:32.627503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1031248,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":1071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"50'148","reported_seq":175,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.561445+0000","last_change":"2024-09-20T20:31:10.499321+0000","last_active":"2024-09-20T20:31:32.561445+0000","last_peered":"2024-09-20T20:31:32.561445+0000","last_clean":"2024-09-20T20:31:32.561445+0000","last_became_active":"2024-09-20T20:31:10.496829+0000","last_became_peered":"2024-09-20T20:31:10.496829+0000","last_unstale":"2024-09-20T20:31:32.561445+0000","last_undegraded":"2024-09-20T20:31:32.561445+0000","last_fullsized":"2024-09-20T20:31:32.561445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:55.974282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114110,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":1167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"50'140","reported_seq":214,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.616582+0000","last_change":"2024-09-20T20:29:55.013283+0000","last_active":"2024-09-20T20:31:32.616582+0000","last_peered":"2024-09-20T20:31:32.616582+0000","last_clean":"2024-09-20T20:31:32.616582+0000","last_became_active":"2024-09-20T20:29:55.012209+0000","last_became_peered":"2024-09-20T20:29:55.012209+0000","last_unstale":"2024-09-20T20:31:32.616582+0000","last_undegraded":"2024-09-20T20:31:32.616582+0000","last_fullsized":"2024-09-20T20:31:32.616582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587871,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"50'151","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.530415+0000","last_change":"2024-09-20T20:29:55.013574+0000","last_active":"2024-09-20T20:31:32.530415+0000","last_peered":"2024-09-20T20:31:32.530415+0000","last_clean":"2024-09-20T20:31:32.530415+0000","last_became_active":"2024-09-20T20:29:55.012717+0000","last_became_peered":"2024-09-20T20:29:55.012717+0000","last_unstale":"2024-09-20T20:31:32.530415+0000","last_undegraded":"2024-09-20T20:31:32.530415+0000","last_fullsized":"2024-09-20T20:31:32.530415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":613477,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"50'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.641636+0000","last_change":"2024-09-20T20:29:55.020120+0000","last_active":"2024-09-20T20:31:32.641636+0000","last_peered":"2024-09-20T20:31:32.641636+0000","last_clean":"2024-09-20T20:31:32.641636+0000","last_became_active":"2024-09-20T20:29:55.017665+0000","last_became_peered":"2024-09-20T20:29:55.017665+0000","last_unstale":"2024-09-20T20:31:32.641636+0000","last_undegraded":"2024-09-20T20:31:32.641636+0000","last_fullsized":"2024-09-20T20:31:32.641636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721999,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"50'147","reported_seq":221,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.589234+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:31:32.589234+0000","last_peered":"2024-09-20T20:31:32.589234+0000","last_clean":"2024-09-20T20:31:32.589234+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:31:32.589234+0000","last_undegraded":"2024-09-20T20:31:32.589234+0000","last_fullsized":"2024-09-20T20:31:32.589234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610908,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"50'132","reported_seq":206,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.573514+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:31:32.573514+0000","last_peered":"2024-09-20T20:31:32.573514+0000","last_clean":"2024-09-20T20:31:32.573514+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:31:32.573514+0000","last_undegraded":"2024-09-20T20:31:32.573514+0000","last_fullsized":"2024-09-20T20:31:32.573514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586148,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"50'127","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.550669+0000","last_change":"2024-09-20T20:29:55.019721+0000","last_active":"2024-09-20T20:31:32.550669+0000","last_peered":"2024-09-20T20:31:32.550669+0000","last_clean":"2024-09-20T20:31:32.550669+0000","last_became_active":"2024-09-20T20:29:55.018432+0000","last_became_peered":"2024-09-20T20:29:55.018432+0000","last_unstale":"2024-09-20T20:31:32.550669+0000","last_undegraded":"2024-09-20T20:31:32.550669+0000","last_fullsized":"2024-09-20T20:31:32.550669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:33.441191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368992,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"50'125","reported_seq":152,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.689759+0000","last_change":"2024-09-20T20:31:10.497886+0000","last_active":"2024-09-20T20:31:32.689759+0000","last_peered":"2024-09-20T20:31:32.689759+0000","last_clean":"2024-09-20T20:31:32.689759+0000","last_became_active":"2024-09-20T20:31:10.495584+0000","last_became_peered":"2024-09-20T20:31:10.495584+0000","last_unstale":"2024-09-20T20:31:32.689759+0000","last_undegraded":"2024-09-20T20:31:32.689759+0000","last_fullsized":"2024-09-20T20:31:32.689759+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:27.934463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377888,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"50'143","reported_seq":170,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.662420+0000","last_change":"2024-09-20T20:31:10.500370+0000","last_active":"2024-09-20T20:31:32.662420+0000","last_peered":"2024-09-20T20:31:32.662420+0000","last_clean":"2024-09-20T20:31:32.662420+0000","last_became_active":"2024-09-20T20:31:10.497142+0000","last_became_peered":"2024-09-20T20:31:10.497142+0000","last_unstale":"2024-09-20T20:31:32.662420+0000","last_undegraded":"2024-09-20T20:31:32.662420+0000","last_fullsized":"2024-09-20T20:31:32.662420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:17.243572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530794,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"50'139","reported_seq":213,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.302453+0000","last_change":"2024-09-20T20:29:55.004269+0000","last_active":"2024-09-20T20:31:32.302453+0000","last_peered":"2024-09-20T20:31:32.302453+0000","last_clean":"2024-09-20T20:31:32.302453+0000","last_became_active":"2024-09-20T20:29:55.001075+0000","last_became_peered":"2024-09-20T20:29:55.001075+0000","last_unstale":"2024-09-20T20:31:32.302453+0000","last_undegraded":"2024-09-20T20:31:32.302453+0000","last_fullsized":"2024-09-20T20:31:32.302453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:15:04.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4913706,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"50'138","reported_seq":212,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.643438+0000","last_change":"2024-09-20T20:29:55.002609+0000","last_active":"2024-09-20T20:31:32.643438+0000","last_peered":"2024-09-20T20:31:32.643438+0000","last_clean":"2024-09-20T20:31:32.643438+0000","last_became_active":"2024-09-20T20:29:54.999251+0000","last_became_peered":"2024-09-20T20:29:54.999251+0000","last_unstale":"2024-09-20T20:31:32.643438+0000","last_undegraded":"2024-09-20T20:31:32.643438+0000","last_fullsized":"2024-09-20T20:31:32.643438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":879890,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"50'151","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.619449+0000","last_change":"2024-09-20T20:29:55.018289+0000","last_active":"2024-09-20T20:31:32.619449+0000","last_peered":"2024-09-20T20:31:32.619449+0000","last_clean":"2024-09-20T20:31:32.619449+0000","last_became_active":"2024-09-20T20:29:55.016955+0000","last_became_peered":"2024-09-20T20:29:55.016955+0000","last_unstale":"2024-09-20T20:31:32.619449+0000","last_undegraded":"2024-09-20T20:31:32.619449+0000","last_fullsized":"2024-09-20T20:31:32.619449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":651799,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"50'140","reported_seq":214,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.447623+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:31:32.447623+0000","last_peered":"2024-09-20T20:31:32.447623+0000","last_clean":"2024-09-20T20:31:32.447623+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:31:32.447623+0000","last_undegraded":"2024-09-20T20:31:32.447623+0000","last_fullsized":"2024-09-20T20:31:32.447623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440117,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"50'134","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.465661+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:31:32.465661+0000","last_peered":"2024-09-20T20:31:32.465661+0000","last_clean":"2024-09-20T20:31:32.465661+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:31:32.465661+0000","last_undegraded":"2024-09-20T20:31:32.465661+0000","last_fullsized":"2024-09-20T20:31:32.465661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418599,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"50'133","reported_seq":170,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.621610+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:31:32.621610+0000","last_peered":"2024-09-20T20:31:32.621610+0000","last_clean":"2024-09-20T20:31:32.621610+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:31:32.621610+0000","last_undegraded":"2024-09-20T20:31:32.621610+0000","last_fullsized":"2024-09-20T20:31:32.621610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582507,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"50'162","reported_seq":236,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.651579+0000","last_change":"2024-09-20T20:29:55.013026+0000","last_active":"2024-09-20T20:31:32.651579+0000","last_peered":"2024-09-20T20:31:32.651579+0000","last_clean":"2024-09-20T20:31:32.651579+0000","last_became_active":"2024-09-20T20:29:55.011792+0000","last_became_peered":"2024-09-20T20:29:55.011792+0000","last_unstale":"2024-09-20T20:31:32.651579+0000","last_undegraded":"2024-09-20T20:31:32.651579+0000","last_fullsized":"2024-09-20T20:31:32.651579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:38:55.876489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662647,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"50'131","reported_seq":205,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.398233+0000","last_change":"2024-09-20T20:29:55.018906+0000","last_active":"2024-09-20T20:31:32.398233+0000","last_peered":"2024-09-20T20:31:32.398233+0000","last_clean":"2024-09-20T20:31:32.398233+0000","last_became_active":"2024-09-20T20:29:55.016610+0000","last_became_peered":"2024-09-20T20:29:55.016610+0000","last_unstale":"2024-09-20T20:31:32.398233+0000","last_undegraded":"2024-09-20T20:31:32.398233+0000","last_fullsized":"2024-09-20T20:31:32.398233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:57.723478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":583631,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"50'150","reported_seq":177,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.545130+0000","last_change":"2024-09-20T20:31:10.496019+0000","last_active":"2024-09-20T20:31:32.545130+0000","last_peered":"2024-09-20T20:31:32.545130+0000","last_clean":"2024-09-20T20:31:32.545130+0000","last_became_active":"2024-09-20T20:31:10.495129+0000","last_became_peered":"2024-09-20T20:31:10.495129+0000","last_unstale":"2024-09-20T20:31:32.545130+0000","last_undegraded":"2024-09-20T20:31:32.545130+0000","last_fullsized":"2024-09-20T20:31:32.545130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:25:23.362031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":601766,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"50'136","reported_seq":210,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.643386+0000","last_change":"2024-09-20T20:29:55.005769+0000","last_active":"2024-09-20T20:31:32.643386+0000","last_peered":"2024-09-20T20:31:32.643386+0000","last_clean":"2024-09-20T20:31:32.643386+0000","last_became_active":"2024-09-20T20:29:55.004705+0000","last_became_peered":"2024-09-20T20:29:55.004705+0000","last_unstale":"2024-09-20T20:31:32.643386+0000","last_undegraded":"2024-09-20T20:31:32.643386+0000","last_fullsized":"2024-09-20T20:31:32.643386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:35:51.750296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1028846,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"50'144","reported_seq":171,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.569734+0000","last_change":"2024-09-20T20:31:10.498817+0000","last_active":"2024-09-20T20:31:32.569734+0000","last_peered":"2024-09-20T20:31:32.569734+0000","last_clean":"2024-09-20T20:31:32.569734+0000","last_became_active":"2024-09-20T20:31:10.497885+0000","last_became_peered":"2024-09-20T20:31:10.497885+0000","last_unstale":"2024-09-20T20:31:32.569734+0000","last_undegraded":"2024-09-20T20:31:32.569734+0000","last_fullsized":"2024-09-20T20:31:32.569734+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:38:07.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714276,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"50'157","reported_seq":184,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.467071+0000","last_change":"2024-09-20T20:31:10.497852+0000","last_active":"2024-09-20T20:31:32.467071+0000","last_peered":"2024-09-20T20:31:32.467071+0000","last_clean":"2024-09-20T20:31:32.467071+0000","last_became_active":"2024-09-20T20:31:10.496002+0000","last_became_peered":"2024-09-20T20:31:10.496002+0000","last_unstale":"2024-09-20T20:31:32.467071+0000","last_undegraded":"2024-09-20T20:31:32.467071+0000","last_fullsized":"2024-09-20T20:31:32.467071+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:10.127090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476514,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"50'161","reported_seq":235,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.348049+0000","last_change":"2024-09-20T20:29:55.005841+0000","last_active":"2024-09-20T20:31:32.348049+0000","last_peered":"2024-09-20T20:31:32.348049+0000","last_clean":"2024-09-20T20:31:32.348049+0000","last_became_active":"2024-09-20T20:29:55.004560+0000","last_became_peered":"2024-09-20T20:29:55.004560+0000","last_unstale":"2024-09-20T20:31:32.348049+0000","last_undegraded":"2024-09-20T20:31:32.348049+0000","last_fullsized":"2024-09-20T20:31:32.348049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":675464,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"50'134","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.386632+0000","last_change":"2024-09-20T20:29:55.006687+0000","last_active":"2024-09-20T20:31:32.386632+0000","last_peered":"2024-09-20T20:31:32.386632+0000","last_clean":"2024-09-20T20:31:32.386632+0000","last_became_active":"2024-09-20T20:29:55.004917+0000","last_became_peered":"2024-09-20T20:29:55.004917+0000","last_unstale":"2024-09-20T20:31:32.386632+0000","last_undegraded":"2024-09-20T20:31:32.386632+0000","last_fullsized":"2024-09-20T20:31:32.386632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:36.771035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694501,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"50'131","reported_seq":205,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.502937+0000","last_change":"2024-09-20T20:29:55.010657+0000","last_active":"2024-09-20T20:31:32.502937+0000","last_peered":"2024-09-20T20:31:32.502937+0000","last_clean":"2024-09-20T20:31:32.502937+0000","last_became_active":"2024-09-20T20:29:55.009770+0000","last_became_peered":"2024-09-20T20:29:55.009770+0000","last_unstale":"2024-09-20T20:31:32.502937+0000","last_undegraded":"2024-09-20T20:31:32.502937+0000","last_fullsized":"2024-09-20T20:31:32.502937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580152,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"50'126","reported_seq":200,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.473499+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:31:32.473499+0000","last_peered":"2024-09-20T20:31:32.473499+0000","last_clean":"2024-09-20T20:31:32.473499+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:31:32.473499+0000","last_undegraded":"2024-09-20T20:31:32.473499+0000","last_fullsized":"2024-09-20T20:31:32.473499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624185,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"50'155","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.693990+0000","last_change":"2024-09-20T20:31:10.495910+0000","last_active":"2024-09-20T20:31:32.693990+0000","last_peered":"2024-09-20T20:31:32.693990+0000","last_clean":"2024-09-20T20:31:32.693990+0000","last_became_active":"2024-09-20T20:31:10.495116+0000","last_became_peered":"2024-09-20T20:31:10.495116+0000","last_unstale":"2024-09-20T20:31:32.693990+0000","last_undegraded":"2024-09-20T20:31:32.693990+0000","last_fullsized":"2024-09-20T20:31:32.693990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:08.218160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645914,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"50'157","reported_seq":231,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.477616+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:31:32.477616+0000","last_peered":"2024-09-20T20:31:32.477616+0000","last_clean":"2024-09-20T20:31:32.477616+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:31:32.477616+0000","last_undegraded":"2024-09-20T20:31:32.477616+0000","last_fullsized":"2024-09-20T20:31:32.477616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998749,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"50'159","reported_seq":233,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.645967+0000","last_change":"2024-09-20T20:29:55.014338+0000","last_active":"2024-09-20T20:31:32.645967+0000","last_peered":"2024-09-20T20:31:32.645967+0000","last_clean":"2024-09-20T20:31:32.645967+0000","last_became_active":"2024-09-20T20:29:55.012497+0000","last_became_peered":"2024-09-20T20:29:55.012497+0000","last_unstale":"2024-09-20T20:31:32.645967+0000","last_undegraded":"2024-09-20T20:31:32.645967+0000","last_fullsized":"2024-09-20T20:31:32.645967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:55.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2222207,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":2254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"50'128","reported_seq":155,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.549839+0000","last_change":"2024-09-20T20:31:10.499837+0000","last_active":"2024-09-20T20:31:32.549839+0000","last_peered":"2024-09-20T20:31:32.549839+0000","last_clean":"2024-09-20T20:31:32.549839+0000","last_became_active":"2024-09-20T20:31:10.499019+0000","last_became_peered":"2024-09-20T20:31:10.499019+0000","last_unstale":"2024-09-20T20:31:32.549839+0000","last_undegraded":"2024-09-20T20:31:32.549839+0000","last_fullsized":"2024-09-20T20:31:32.549839+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:55:57.428556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":631697,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"50'4","reported_seq":80,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745432+0000","last_change":"2024-09-20T20:29:54.004261+0000","last_active":"2024-09-20T20:31:31.745432+0000","last_peered":"2024-09-20T20:31:31.745432+0000","last_clean":"2024-09-20T20:31:31.745432+0000","last_became_active":"2024-09-20T20:29:54.003321+0000","last_became_peered":"2024-09-20T20:29:54.003321+0000","last_unstale":"2024-09-20T20:31:31.745432+0000","last_undegraded":"2024-09-20T20:31:31.745432+0000","last_fullsized":"2024-09-20T20:31:31.745432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:56.408377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"50'134","reported_seq":161,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.613211+0000","last_change":"2024-09-20T20:31:10.499750+0000","last_active":"2024-09-20T20:31:32.613211+0000","last_peered":"2024-09-20T20:31:32.613211+0000","last_clean":"2024-09-20T20:31:32.613211+0000","last_became_active":"2024-09-20T20:31:10.498865+0000","last_became_peered":"2024-09-20T20:31:10.498865+0000","last_unstale":"2024-09-20T20:31:32.613211+0000","last_undegraded":"2024-09-20T20:31:32.613211+0000","last_fullsized":"2024-09-20T20:31:32.613211+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:35.447873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575358,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745184+0000","last_change":"2024-09-20T20:29:54.001404+0000","last_active":"2024-09-20T20:31:31.745184+0000","last_peered":"2024-09-20T20:31:31.745184+0000","last_clean":"2024-09-20T20:31:31.745184+0000","last_became_active":"2024-09-20T20:29:54.000542+0000","last_became_peered":"2024-09-20T20:29:54.000542+0000","last_unstale":"2024-09-20T20:31:31.745184+0000","last_undegraded":"2024-09-20T20:31:31.745184+0000","last_fullsized":"2024-09-20T20:31:31.745184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:55:06.139464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"50'149","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.605940+0000","last_change":"2024-09-20T20:29:55.007560+0000","last_active":"2024-09-20T20:31:32.605940+0000","last_peered":"2024-09-20T20:31:32.605940+0000","last_clean":"2024-09-20T20:31:32.605940+0000","last_became_active":"2024-09-20T20:29:55.006799+0000","last_became_peered":"2024-09-20T20:29:55.006799+0000","last_unstale":"2024-09-20T20:31:32.605940+0000","last_undegraded":"2024-09-20T20:31:32.605940+0000","last_fullsized":"2024-09-20T20:31:32.605940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":572191,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744857+0000","last_change":"2024-09-20T20:29:54.002611+0000","last_active":"2024-09-20T20:31:31.744857+0000","last_peered":"2024-09-20T20:31:31.744857+0000","last_clean":"2024-09-20T20:31:31.744857+0000","last_became_active":"2024-09-20T20:29:54.001005+0000","last_became_peered":"2024-09-20T20:29:54.001005+0000","last_unstale":"2024-09-20T20:31:31.744857+0000","last_undegraded":"2024-09-20T20:31:31.744857+0000","last_fullsized":"2024-09-20T20:31:31.744857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:18.665590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"50'129","reported_seq":203,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.492117+0000","last_change":"2024-09-20T20:29:55.008283+0000","last_active":"2024-09-20T20:31:32.492117+0000","last_peered":"2024-09-20T20:31:32.492117+0000","last_clean":"2024-09-20T20:31:32.492117+0000","last_became_active":"2024-09-20T20:29:55.007022+0000","last_became_peered":"2024-09-20T20:29:55.007022+0000","last_unstale":"2024-09-20T20:31:32.492117+0000","last_undegraded":"2024-09-20T20:31:32.492117+0000","last_fullsized":"2024-09-20T20:31:32.492117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559500,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":84,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744662+0000","last_change":"2024-09-20T20:29:53.999606+0000","last_active":"2024-09-20T20:31:31.744662+0000","last_peered":"2024-09-20T20:31:31.744662+0000","last_clean":"2024-09-20T20:31:31.744662+0000","last_became_active":"2024-09-20T20:29:53.998832+0000","last_became_peered":"2024-09-20T20:29:53.998832+0000","last_unstale":"2024-09-20T20:31:31.744662+0000","last_undegraded":"2024-09-20T20:31:31.744662+0000","last_fullsized":"2024-09-20T20:31:31.744662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:19:25.264824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746489+0000","last_change":"2024-09-20T20:29:53.999209+0000","last_active":"2024-09-20T20:31:31.746489+0000","last_peered":"2024-09-20T20:31:31.746489+0000","last_clean":"2024-09-20T20:31:31.746489+0000","last_became_active":"2024-09-20T20:29:53.998581+0000","last_became_peered":"2024-09-20T20:29:53.998581+0000","last_unstale":"2024-09-20T20:31:31.746489+0000","last_undegraded":"2024-09-20T20:31:31.746489+0000","last_fullsized":"2024-09-20T20:31:31.746489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"50'142","reported_seq":216,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.626620+0000","last_change":"2024-09-20T20:29:55.018640+0000","last_active":"2024-09-20T20:31:32.626620+0000","last_peered":"2024-09-20T20:31:32.626620+0000","last_clean":"2024-09-20T20:31:32.626620+0000","last_became_active":"2024-09-20T20:29:55.018180+0000","last_became_peered":"2024-09-20T20:29:55.018180+0000","last_unstale":"2024-09-20T20:31:32.626620+0000","last_undegraded":"2024-09-20T20:31:32.626620+0000","last_fullsized":"2024-09-20T20:31:32.626620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:52.421552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654856,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746653+0000","last_change":"2024-09-20T20:29:54.001233+0000","last_active":"2024-09-20T20:31:31.746653+0000","last_peered":"2024-09-20T20:31:31.746653+0000","last_clean":"2024-09-20T20:31:31.746653+0000","last_became_active":"2024-09-20T20:29:54.000393+0000","last_became_peered":"2024-09-20T20:29:54.000393+0000","last_unstale":"2024-09-20T20:31:31.746653+0000","last_undegraded":"2024-09-20T20:31:31.746653+0000","last_fullsized":"2024-09-20T20:31:31.746653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:34:33.760825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'157","reported_seq":184,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.467476+0000","last_change":"2024-09-20T20:31:10.497170+0000","last_active":"2024-09-20T20:31:32.467476+0000","last_peered":"2024-09-20T20:31:32.467476+0000","last_clean":"2024-09-20T20:31:32.467476+0000","last_became_active":"2024-09-20T20:31:10.496258+0000","last_became_peered":"2024-09-20T20:31:10.496258+0000","last_unstale":"2024-09-20T20:31:32.467476+0000","last_undegraded":"2024-09-20T20:31:32.467476+0000","last_fullsized":"2024-09-20T20:31:32.467476+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:25.042093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465619,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":1509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746898+0000","last_change":"2024-09-20T20:29:53.999469+0000","last_active":"2024-09-20T20:31:31.746898+0000","last_peered":"2024-09-20T20:31:31.746898+0000","last_clean":"2024-09-20T20:31:31.746898+0000","last_became_active":"2024-09-20T20:29:53.998714+0000","last_became_peered":"2024-09-20T20:29:53.998714+0000","last_unstale":"2024-09-20T20:31:31.746898+0000","last_undegraded":"2024-09-20T20:31:31.746898+0000","last_fullsized":"2024-09-20T20:31:31.746898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'137","reported_seq":211,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.395028+0000","last_change":"2024-09-20T20:29:55.018515+0000","last_active":"2024-09-20T20:31:32.395028+0000","last_peered":"2024-09-20T20:31:32.395028+0000","last_clean":"2024-09-20T20:31:32.395028+0000","last_became_active":"2024-09-20T20:29:55.017067+0000","last_became_peered":"2024-09-20T20:29:55.017067+0000","last_unstale":"2024-09-20T20:31:32.395028+0000","last_undegraded":"2024-09-20T20:31:32.395028+0000","last_fullsized":"2024-09-20T20:31:32.395028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:25.954641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590489,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745912+0000","last_change":"2024-09-20T20:29:54.004239+0000","last_active":"2024-09-20T20:31:31.745912+0000","last_peered":"2024-09-20T20:31:31.745912+0000","last_clean":"2024-09-20T20:31:31.745912+0000","last_became_active":"2024-09-20T20:29:54.003754+0000","last_became_peered":"2024-09-20T20:29:54.003754+0000","last_unstale":"2024-09-20T20:31:31.745912+0000","last_undegraded":"2024-09-20T20:31:31.745912+0000","last_fullsized":"2024-09-20T20:31:31.745912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"50'149","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.505631+0000","last_change":"2024-09-20T20:29:55.011150+0000","last_active":"2024-09-20T20:31:32.505631+0000","last_peered":"2024-09-20T20:31:32.505631+0000","last_clean":"2024-09-20T20:31:32.505631+0000","last_became_active":"2024-09-20T20:29:55.008203+0000","last_became_peered":"2024-09-20T20:29:55.008203+0000","last_unstale":"2024-09-20T20:31:32.505631+0000","last_undegraded":"2024-09-20T20:31:32.505631+0000","last_fullsized":"2024-09-20T20:31:32.505631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:22.870590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566441,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"47'59","reported_seq":135,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745752+0000","last_change":"2024-09-20T20:29:54.002096+0000","last_active":"2024-09-20T20:31:31.745752+0000","last_peered":"2024-09-20T20:31:31.745752+0000","last_clean":"2024-09-20T20:31:31.745752+0000","last_became_active":"2024-09-20T20:29:54.000999+0000","last_became_peered":"2024-09-20T20:29:54.000999+0000","last_unstale":"2024-09-20T20:31:31.745752+0000","last_undegraded":"2024-09-20T20:31:31.745752+0000","last_fullsized":"2024-09-20T20:31:31.745752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"50'157","reported_seq":231,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.677609+0000","last_change":"2024-09-20T20:29:55.013946+0000","last_active":"2024-09-20T20:31:32.677609+0000","last_peered":"2024-09-20T20:31:32.677609+0000","last_clean":"2024-09-20T20:31:32.677609+0000","last_became_active":"2024-09-20T20:29:55.013088+0000","last_became_peered":"2024-09-20T20:29:55.013088+0000","last_unstale":"2024-09-20T20:31:32.677609+0000","last_undegraded":"2024-09-20T20:31:32.677609+0000","last_fullsized":"2024-09-20T20:31:32.677609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:00.086059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784930,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746799+0000","last_change":"2024-09-20T20:29:54.008770+0000","last_active":"2024-09-20T20:31:31.746799+0000","last_peered":"2024-09-20T20:31:31.746799+0000","last_clean":"2024-09-20T20:31:31.746799+0000","last_became_active":"2024-09-20T20:29:54.008147+0000","last_became_peered":"2024-09-20T20:29:54.008147+0000","last_unstale":"2024-09-20T20:31:31.746799+0000","last_undegraded":"2024-09-20T20:31:31.746799+0000","last_fullsized":"2024-09-20T20:31:31.746799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:55:44.985224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"50'144","reported_seq":218,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.487611+0000","last_change":"2024-09-20T20:29:55.006968+0000","last_active":"2024-09-20T20:31:32.487611+0000","last_peered":"2024-09-20T20:31:32.487611+0000","last_clean":"2024-09-20T20:31:32.487611+0000","last_became_active":"2024-09-20T20:29:55.005214+0000","last_became_peered":"2024-09-20T20:29:55.005214+0000","last_unstale":"2024-09-20T20:31:32.487611+0000","last_undegraded":"2024-09-20T20:31:32.487611+0000","last_fullsized":"2024-09-20T20:31:32.487611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:55:30.848833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":514837,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744715+0000","last_change":"2024-09-20T20:31:10.497330+0000","last_active":"2024-09-20T20:31:31.744715+0000","last_peered":"2024-09-20T20:31:31.744715+0000","last_clean":"2024-09-20T20:31:31.744715+0000","last_became_active":"2024-09-20T20:31:10.495375+0000","last_became_peered":"2024-09-20T20:31:10.495375+0000","last_unstale":"2024-09-20T20:31:31.744715+0000","last_undegraded":"2024-09-20T20:31:31.744715+0000","last_fullsized":"2024-09-20T20:31:31.744715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:35:06.652761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"50'125","reported_seq":199,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.586561+0000","last_change":"2024-09-20T20:29:55.002423+0000","last_active":"2024-09-20T20:31:32.586561+0000","last_peered":"2024-09-20T20:31:32.586561+0000","last_clean":"2024-09-20T20:31:32.586561+0000","last_became_active":"2024-09-20T20:29:55.001477+0000","last_became_peered":"2024-09-20T20:29:55.001477+0000","last_unstale":"2024-09-20T20:31:32.586561+0000","last_undegraded":"2024-09-20T20:31:32.586561+0000","last_fullsized":"2024-09-20T20:31:32.586561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:49.294409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531230,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744688+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:31:31.744688+0000","last_peered":"2024-09-20T20:31:31.744688+0000","last_clean":"2024-09-20T20:31:31.744688+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:31:31.744688+0000","last_undegraded":"2024-09-20T20:31:31.744688+0000","last_fullsized":"2024-09-20T20:31:31.744688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"50'130","reported_seq":204,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.520535+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:31:32.520535+0000","last_peered":"2024-09-20T20:31:32.520535+0000","last_clean":"2024-09-20T20:31:32.520535+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:31:32.520535+0000","last_undegraded":"2024-09-20T20:31:32.520535+0000","last_fullsized":"2024-09-20T20:31:32.520535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455004,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":286,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744952+0000","last_change":"2024-09-20T20:29:44.700437+0000","last_active":"2024-09-20T20:31:31.744952+0000","last_peered":"2024-09-20T20:31:31.744952+0000","last_clean":"2024-09-20T20:31:31.744952+0000","last_became_active":"2024-09-20T20:29:44.699937+0000","last_became_peered":"2024-09-20T20:29:44.699937+0000","last_unstale":"2024-09-20T20:31:31.744952+0000","last_undegraded":"2024-09-20T20:31:31.744952+0000","last_fullsized":"2024-09-20T20:31:31.744952+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:39.548361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745491+0000","last_change":"2024-09-20T20:29:51.834512+0000","last_active":"2024-09-20T20:31:31.745491+0000","last_peered":"2024-09-20T20:31:31.745491+0000","last_clean":"2024-09-20T20:31:31.745491+0000","last_became_active":"2024-09-20T20:29:49.814123+0000","last_became_peered":"2024-09-20T20:29:49.814123+0000","last_unstale":"2024-09-20T20:31:31.745491+0000","last_undegraded":"2024-09-20T20:31:31.745491+0000","last_fullsized":"2024-09-20T20:31:31.745491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:13.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001466735,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"48'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745454+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:31:31.745454+0000","last_peered":"2024-09-20T20:31:31.745454+0000","last_clean":"2024-09-20T20:31:31.745454+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:31:31.745454+0000","last_undegraded":"2024-09-20T20:31:31.745454+0000","last_fullsized":"2024-09-20T20:31:31.745454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"50'147","reported_seq":221,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.537251+0000","last_change":"2024-09-20T20:29:55.005741+0000","last_active":"2024-09-20T20:31:32.537251+0000","last_peered":"2024-09-20T20:31:32.537251+0000","last_clean":"2024-09-20T20:31:32.537251+0000","last_became_active":"2024-09-20T20:29:55.002283+0000","last_became_peered":"2024-09-20T20:29:55.002283+0000","last_unstale":"2024-09-20T20:31:32.537251+0000","last_undegraded":"2024-09-20T20:31:32.537251+0000","last_fullsized":"2024-09-20T20:31:32.537251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:37:58.540011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635297,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744754+0000","last_change":"2024-09-20T20:29:51.833773+0000","last_active":"2024-09-20T20:31:31.744754+0000","last_peered":"2024-09-20T20:31:31.744754+0000","last_clean":"2024-09-20T20:31:31.744754+0000","last_became_active":"2024-09-20T20:29:49.814807+0000","last_became_peered":"2024-09-20T20:29:49.814807+0000","last_unstale":"2024-09-20T20:31:31.744754+0000","last_undegraded":"2024-09-20T20:31:31.744754+0000","last_fullsized":"2024-09-20T20:31:31.744754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:57:53.257365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084095299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747089+0000","last_change":"2024-09-20T20:29:54.002102+0000","last_active":"2024-09-20T20:31:31.747089+0000","last_peered":"2024-09-20T20:31:31.747089+0000","last_clean":"2024-09-20T20:31:31.747089+0000","last_became_active":"2024-09-20T20:29:54.001057+0000","last_became_peered":"2024-09-20T20:29:54.001057+0000","last_unstale":"2024-09-20T20:31:31.747089+0000","last_undegraded":"2024-09-20T20:31:31.747089+0000","last_fullsized":"2024-09-20T20:31:31.747089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:45.110556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"50'141","reported_seq":168,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.606517+0000","last_change":"2024-09-20T20:31:10.498550+0000","last_active":"2024-09-20T20:31:32.606517+0000","last_peered":"2024-09-20T20:31:32.606517+0000","last_clean":"2024-09-20T20:31:32.606517+0000","last_became_active":"2024-09-20T20:31:10.497702+0000","last_became_peered":"2024-09-20T20:31:10.497702+0000","last_unstale":"2024-09-20T20:31:32.606517+0000","last_undegraded":"2024-09-20T20:31:32.606517+0000","last_fullsized":"2024-09-20T20:31:32.606517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:29.034503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520894,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747406+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:31:31.747406+0000","last_peered":"2024-09-20T20:31:31.747406+0000","last_clean":"2024-09-20T20:31:31.747406+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:31:31.747406+0000","last_undegraded":"2024-09-20T20:31:31.747406+0000","last_fullsized":"2024-09-20T20:31:31.747406+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'2","reported_seq":29,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744290+0000","last_change":"2024-09-20T20:31:10.495583+0000","last_active":"2024-09-20T20:31:31.744290+0000","last_peered":"2024-09-20T20:31:31.744290+0000","last_clean":"2024-09-20T20:31:31.744290+0000","last_became_active":"2024-09-20T20:31:10.493901+0000","last_became_peered":"2024-09-20T20:31:10.493901+0000","last_unstale":"2024-09-20T20:31:31.744290+0000","last_undegraded":"2024-09-20T20:31:31.744290+0000","last_fullsized":"2024-09-20T20:31:31.744290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:29.771507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'128","reported_seq":202,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.419832+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:31:32.419832+0000","last_peered":"2024-09-20T20:31:32.419832+0000","last_clean":"2024-09-20T20:31:32.419832+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:31:32.419832+0000","last_undegraded":"2024-09-20T20:31:32.419832+0000","last_fullsized":"2024-09-20T20:31:32.419832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":734042,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":91,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746933+0000","last_change":"2024-09-20T20:29:51.833762+0000","last_active":"2024-09-20T20:31:31.746933+0000","last_peered":"2024-09-20T20:31:31.746933+0000","last_clean":"2024-09-20T20:31:31.746933+0000","last_became_active":"2024-09-20T20:29:49.814108+0000","last_became_peered":"2024-09-20T20:29:49.814108+0000","last_unstale":"2024-09-20T20:31:31.746933+0000","last_undegraded":"2024-09-20T20:31:31.746933+0000","last_fullsized":"2024-09-20T20:31:31.746933+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:54.632258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745479+0000","last_change":"2024-09-20T20:29:54.008206+0000","last_active":"2024-09-20T20:31:31.745479+0000","last_peered":"2024-09-20T20:31:31.745479+0000","last_clean":"2024-09-20T20:31:31.745479+0000","last_became_active":"2024-09-20T20:29:54.007405+0000","last_became_peered":"2024-09-20T20:29:54.007405+0000","last_unstale":"2024-09-20T20:31:31.745479+0000","last_undegraded":"2024-09-20T20:31:31.745479+0000","last_fullsized":"2024-09-20T20:31:31.745479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:42.489455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"50'121","reported_seq":195,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.599833+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:31:32.599833+0000","last_peered":"2024-09-20T20:31:32.599833+0000","last_clean":"2024-09-20T20:31:32.599833+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:31:32.599833+0000","last_undegraded":"2024-09-20T20:31:32.599833+0000","last_fullsized":"2024-09-20T20:31:32.599833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482206,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747030+0000","last_change":"2024-09-20T20:29:54.004215+0000","last_active":"2024-09-20T20:31:31.747030+0000","last_peered":"2024-09-20T20:31:31.747030+0000","last_clean":"2024-09-20T20:31:31.747030+0000","last_became_active":"2024-09-20T20:29:54.003397+0000","last_became_peered":"2024-09-20T20:29:54.003397+0000","last_unstale":"2024-09-20T20:31:31.747030+0000","last_undegraded":"2024-09-20T20:31:31.747030+0000","last_fullsized":"2024-09-20T20:31:31.747030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746192+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:31:31.746192+0000","last_peered":"2024-09-20T20:31:31.746192+0000","last_clean":"2024-09-20T20:31:31.746192+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:31:31.746192+0000","last_undegraded":"2024-09-20T20:31:31.746192+0000","last_fullsized":"2024-09-20T20:31:31.746192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"50'126","reported_seq":200,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.634353+0000","last_change":"2024-09-20T20:29:55.014391+0000","last_active":"2024-09-20T20:31:32.634353+0000","last_peered":"2024-09-20T20:31:32.634353+0000","last_clean":"2024-09-20T20:31:32.634353+0000","last_became_active":"2024-09-20T20:29:55.011695+0000","last_became_peered":"2024-09-20T20:29:55.011695+0000","last_unstale":"2024-09-20T20:31:32.634353+0000","last_undegraded":"2024-09-20T20:31:32.634353+0000","last_fullsized":"2024-09-20T20:31:32.634353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:33.217994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505603,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745972+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:31:31.745972+0000","last_peered":"2024-09-20T20:31:31.745972+0000","last_clean":"2024-09-20T20:31:31.745972+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:31:31.745972+0000","last_undegraded":"2024-09-20T20:31:31.745972+0000","last_fullsized":"2024-09-20T20:31:31.745972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746579+0000","last_change":"2024-09-20T20:31:10.498717+0000","last_active":"2024-09-20T20:31:31.746579+0000","last_peered":"2024-09-20T20:31:31.746579+0000","last_clean":"2024-09-20T20:31:31.746579+0000","last_became_active":"2024-09-20T20:31:10.497894+0000","last_became_peered":"2024-09-20T20:31:10.497894+0000","last_unstale":"2024-09-20T20:31:31.746579+0000","last_undegraded":"2024-09-20T20:31:31.746579+0000","last_fullsized":"2024-09-20T20:31:31.746579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:03.959197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'136","reported_seq":210,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.289789+0000","last_change":"2024-09-20T20:29:55.016827+0000","last_active":"2024-09-20T20:31:32.289789+0000","last_peered":"2024-09-20T20:31:32.289789+0000","last_clean":"2024-09-20T20:31:32.289789+0000","last_became_active":"2024-09-20T20:29:55.014907+0000","last_became_peered":"2024-09-20T20:29:55.014907+0000","last_unstale":"2024-09-20T20:31:32.289789+0000","last_undegraded":"2024-09-20T20:31:32.289789+0000","last_fullsized":"2024-09-20T20:31:32.289789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590504,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747390+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:31:31.747390+0000","last_peered":"2024-09-20T20:31:31.747390+0000","last_clean":"2024-09-20T20:31:31.747390+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:31:31.747390+0000","last_undegraded":"2024-09-20T20:31:31.747390+0000","last_fullsized":"2024-09-20T20:31:31.747390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747150+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:31:31.747150+0000","last_peered":"2024-09-20T20:31:31.747150+0000","last_clean":"2024-09-20T20:31:31.747150+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:31:31.747150+0000","last_undegraded":"2024-09-20T20:31:31.747150+0000","last_fullsized":"2024-09-20T20:31:31.747150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"50'147","reported_seq":221,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.658511+0000","last_change":"2024-09-20T20:29:55.006714+0000","last_active":"2024-09-20T20:31:32.658511+0000","last_peered":"2024-09-20T20:31:32.658511+0000","last_clean":"2024-09-20T20:31:32.658511+0000","last_became_active":"2024-09-20T20:29:55.005864+0000","last_became_peered":"2024-09-20T20:29:55.005864+0000","last_unstale":"2024-09-20T20:31:32.658511+0000","last_undegraded":"2024-09-20T20:31:32.658511+0000","last_fullsized":"2024-09-20T20:31:32.658511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:04.925398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492364,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"50'16","reported_seq":92,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747552+0000","last_change":"2024-09-20T20:29:54.003342+0000","last_active":"2024-09-20T20:31:31.747552+0000","last_peered":"2024-09-20T20:31:31.747552+0000","last_clean":"2024-09-20T20:31:31.747552+0000","last_became_active":"2024-09-20T20:29:54.001512+0000","last_became_peered":"2024-09-20T20:29:54.001512+0000","last_unstale":"2024-09-20T20:31:31.747552+0000","last_undegraded":"2024-09-20T20:31:31.747552+0000","last_fullsized":"2024-09-20T20:31:31.747552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:18.763403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746489+0000","last_change":"2024-09-20T20:29:51.834507+0000","last_active":"2024-09-20T20:31:31.746489+0000","last_peered":"2024-09-20T20:31:31.746489+0000","last_clean":"2024-09-20T20:31:31.746489+0000","last_became_active":"2024-09-20T20:29:49.814929+0000","last_became_peered":"2024-09-20T20:29:49.814929+0000","last_unstale":"2024-09-20T20:31:31.746489+0000","last_undegraded":"2024-09-20T20:31:31.746489+0000","last_fullsized":"2024-09-20T20:31:31.746489+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:14.504881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014683249999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"50'129","reported_seq":203,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.591376+0000","last_change":"2024-09-20T20:29:55.010241+0000","last_active":"2024-09-20T20:31:32.591376+0000","last_peered":"2024-09-20T20:31:32.591376+0000","last_clean":"2024-09-20T20:31:32.591376+0000","last_became_active":"2024-09-20T20:29:55.009237+0000","last_became_peered":"2024-09-20T20:29:55.009237+0000","last_unstale":"2024-09-20T20:31:32.591376+0000","last_undegraded":"2024-09-20T20:31:32.591376+0000","last_fullsized":"2024-09-20T20:31:32.591376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":573332,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"50'136","reported_seq":210,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.564586+0000","last_change":"2024-09-20T20:29:55.002979+0000","last_active":"2024-09-20T20:31:32.564586+0000","last_peered":"2024-09-20T20:31:32.564586+0000","last_clean":"2024-09-20T20:31:32.564586+0000","last_became_active":"2024-09-20T20:29:54.999742+0000","last_became_peered":"2024-09-20T20:29:54.999742+0000","last_unstale":"2024-09-20T20:31:32.564586+0000","last_undegraded":"2024-09-20T20:31:32.564586+0000","last_fullsized":"2024-09-20T20:31:32.564586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2904322,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":2908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"46'20","reported_seq":96,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745928+0000","last_change":"2024-09-20T20:29:53.999340+0000","last_active":"2024-09-20T20:31:31.745928+0000","last_peered":"2024-09-20T20:31:31.745928+0000","last_clean":"2024-09-20T20:31:31.745928+0000","last_became_active":"2024-09-20T20:29:53.998560+0000","last_became_peered":"2024-09-20T20:29:53.998560+0000","last_unstale":"2024-09-20T20:31:31.745928+0000","last_undegraded":"2024-09-20T20:31:31.745928+0000","last_fullsized":"2024-09-20T20:31:31.745928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:59.772282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"50'134","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.628075+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:31:32.628075+0000","last_peered":"2024-09-20T20:31:32.628075+0000","last_clean":"2024-09-20T20:31:32.628075+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:31:32.628075+0000","last_undegraded":"2024-09-20T20:31:32.628075+0000","last_fullsized":"2024-09-20T20:31:32.628075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580987,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746505+0000","last_change":"2024-09-20T20:29:54.005409+0000","last_active":"2024-09-20T20:31:31.746505+0000","last_peered":"2024-09-20T20:31:31.746505+0000","last_clean":"2024-09-20T20:31:31.746505+0000","last_became_active":"2024-09-20T20:29:54.004621+0000","last_became_peered":"2024-09-20T20:29:54.004621+0000","last_unstale":"2024-09-20T20:31:31.746505+0000","last_undegraded":"2024-09-20T20:31:31.746505+0000","last_fullsized":"2024-09-20T20:31:31.746505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746611+0000","last_change":"2024-09-20T20:29:54.006043+0000","last_active":"2024-09-20T20:31:31.746611+0000","last_peered":"2024-09-20T20:31:31.746611+0000","last_clean":"2024-09-20T20:31:31.746611+0000","last_became_active":"2024-09-20T20:29:54.005226+0000","last_became_peered":"2024-09-20T20:29:54.005226+0000","last_unstale":"2024-09-20T20:31:31.746611+0000","last_undegraded":"2024-09-20T20:31:31.746611+0000","last_fullsized":"2024-09-20T20:31:31.746611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:33:27.309206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"50'147","reported_seq":221,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.601903+0000","last_change":"2024-09-20T20:29:55.011875+0000","last_active":"2024-09-20T20:31:32.601903+0000","last_peered":"2024-09-20T20:31:32.601903+0000","last_clean":"2024-09-20T20:31:32.601903+0000","last_became_active":"2024-09-20T20:29:55.007476+0000","last_became_peered":"2024-09-20T20:29:55.007476+0000","last_unstale":"2024-09-20T20:31:32.601903+0000","last_undegraded":"2024-09-20T20:31:32.601903+0000","last_fullsized":"2024-09-20T20:31:32.601903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:14:38.621699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1271846,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.747097+0000","last_change":"2024-09-20T20:29:54.004367+0000","last_active":"2024-09-20T20:31:31.747097+0000","last_peered":"2024-09-20T20:31:31.747097+0000","last_clean":"2024-09-20T20:31:31.747097+0000","last_became_active":"2024-09-20T20:29:54.003703+0000","last_became_peered":"2024-09-20T20:29:54.003703+0000","last_unstale":"2024-09-20T20:31:31.747097+0000","last_undegraded":"2024-09-20T20:31:31.747097+0000","last_fullsized":"2024-09-20T20:31:31.747097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:21:21.694428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"50'155","reported_seq":229,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.564262+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:31:32.564262+0000","last_peered":"2024-09-20T20:31:32.564262+0000","last_clean":"2024-09-20T20:31:32.564262+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:31:32.564262+0000","last_undegraded":"2024-09-20T20:31:32.564262+0000","last_fullsized":"2024-09-20T20:31:32.564262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4854521,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"50'127","reported_seq":201,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.541947+0000","last_change":"2024-09-20T20:29:55.014886+0000","last_active":"2024-09-20T20:31:32.541947+0000","last_peered":"2024-09-20T20:31:32.541947+0000","last_clean":"2024-09-20T20:31:32.541947+0000","last_became_active":"2024-09-20T20:29:55.012578+0000","last_became_peered":"2024-09-20T20:29:55.012578+0000","last_unstale":"2024-09-20T20:31:32.541947+0000","last_undegraded":"2024-09-20T20:31:32.541947+0000","last_fullsized":"2024-09-20T20:31:32.541947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:31:42.837623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":984629,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745481+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:31:31.745481+0000","last_peered":"2024-09-20T20:31:31.745481+0000","last_clean":"2024-09-20T20:31:31.745481+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:31:31.745481+0000","last_undegraded":"2024-09-20T20:31:31.745481+0000","last_fullsized":"2024-09-20T20:31:31.745481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"50'140","reported_seq":214,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.348625+0000","last_change":"2024-09-20T20:29:55.006773+0000","last_active":"2024-09-20T20:31:32.348625+0000","last_peered":"2024-09-20T20:31:32.348625+0000","last_clean":"2024-09-20T20:31:32.348625+0000","last_became_active":"2024-09-20T20:29:55.005853+0000","last_became_peered":"2024-09-20T20:29:55.005853+0000","last_unstale":"2024-09-20T20:31:32.348625+0000","last_undegraded":"2024-09-20T20:31:32.348625+0000","last_fullsized":"2024-09-20T20:31:32.348625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":518974,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746911+0000","last_change":"2024-09-20T20:29:54.001670+0000","last_active":"2024-09-20T20:31:31.746911+0000","last_peered":"2024-09-20T20:31:31.746911+0000","last_clean":"2024-09-20T20:31:31.746911+0000","last_became_active":"2024-09-20T20:29:54.000251+0000","last_became_peered":"2024-09-20T20:29:54.000251+0000","last_unstale":"2024-09-20T20:31:31.746911+0000","last_undegraded":"2024-09-20T20:31:31.746911+0000","last_fullsized":"2024-09-20T20:31:31.746911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:29.703140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"50'129","reported_seq":203,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.504423+0000","last_change":"2024-09-20T20:29:55.015664+0000","last_active":"2024-09-20T20:31:32.504423+0000","last_peered":"2024-09-20T20:31:32.504423+0000","last_clean":"2024-09-20T20:31:32.504423+0000","last_became_active":"2024-09-20T20:29:55.014571+0000","last_became_peered":"2024-09-20T20:29:55.014571+0000","last_unstale":"2024-09-20T20:31:32.504423+0000","last_undegraded":"2024-09-20T20:31:32.504423+0000","last_fullsized":"2024-09-20T20:31:32.504423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:03.729284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532431,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"48'2","reported_seq":28,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.744558+0000","last_change":"2024-09-20T20:31:10.497909+0000","last_active":"2024-09-20T20:31:31.744558+0000","last_peered":"2024-09-20T20:31:31.744558+0000","last_clean":"2024-09-20T20:31:31.744558+0000","last_became_active":"2024-09-20T20:31:10.496914+0000","last_became_peered":"2024-09-20T20:31:10.496914+0000","last_unstale":"2024-09-20T20:31:31.744558+0000","last_undegraded":"2024-09-20T20:31:31.744558+0000","last_fullsized":"2024-09-20T20:31:31.744558+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:20.329970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"50'126","reported_seq":153,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.487559+0000","last_change":"2024-09-20T20:31:10.498891+0000","last_active":"2024-09-20T20:31:32.487559+0000","last_peered":"2024-09-20T20:31:32.487559+0000","last_clean":"2024-09-20T20:31:32.487559+0000","last_became_active":"2024-09-20T20:31:10.498120+0000","last_became_peered":"2024-09-20T20:31:10.498120+0000","last_unstale":"2024-09-20T20:31:32.487559+0000","last_undegraded":"2024-09-20T20:31:32.487559+0000","last_fullsized":"2024-09-20T20:31:32.487559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:51.291631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610577,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745591+0000","last_change":"2024-09-20T20:29:54.000822+0000","last_active":"2024-09-20T20:31:31.745591+0000","last_peered":"2024-09-20T20:31:31.745591+0000","last_clean":"2024-09-20T20:31:31.745591+0000","last_became_active":"2024-09-20T20:29:53.999904+0000","last_became_peered":"2024-09-20T20:29:53.999904+0000","last_unstale":"2024-09-20T20:31:31.745591+0000","last_undegraded":"2024-09-20T20:31:31.745591+0000","last_fullsized":"2024-09-20T20:31:31.745591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:38.284604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"50'124","reported_seq":198,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.424369+0000","last_change":"2024-09-20T20:29:55.018458+0000","last_active":"2024-09-20T20:31:32.424369+0000","last_peered":"2024-09-20T20:31:32.424369+0000","last_clean":"2024-09-20T20:31:32.424369+0000","last_became_active":"2024-09-20T20:29:55.016547+0000","last_became_peered":"2024-09-20T20:29:55.016547+0000","last_unstale":"2024-09-20T20:31:32.424369+0000","last_undegraded":"2024-09-20T20:31:32.424369+0000","last_fullsized":"2024-09-20T20:31:32.424369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:10:23.926044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344164,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.745797+0000","last_change":"2024-09-20T20:29:54.008217+0000","last_active":"2024-09-20T20:31:31.745797+0000","last_peered":"2024-09-20T20:31:31.745797+0000","last_clean":"2024-09-20T20:31:31.745797+0000","last_became_active":"2024-09-20T20:29:54.007577+0000","last_became_peered":"2024-09-20T20:29:54.007577+0000","last_unstale":"2024-09-20T20:31:31.745797+0000","last_undegraded":"2024-09-20T20:31:31.745797+0000","last_fullsized":"2024-09-20T20:31:31.745797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"50'141","reported_seq":215,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.469958+0000","last_change":"2024-09-20T20:29:55.012375+0000","last_active":"2024-09-20T20:31:32.469958+0000","last_peered":"2024-09-20T20:31:32.469958+0000","last_clean":"2024-09-20T20:31:32.469958+0000","last_became_active":"2024-09-20T20:29:55.011639+0000","last_became_peered":"2024-09-20T20:29:55.011639+0000","last_unstale":"2024-09-20T20:31:32.469958+0000","last_undegraded":"2024-09-20T20:31:32.469958+0000","last_fullsized":"2024-09-20T20:31:32.469958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:37.790406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474555,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'79","reported_seq":155,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.067721+0000","last_change":"2024-09-20T20:29:54.003270+0000","last_active":"2024-09-20T20:31:32.067721+0000","last_peered":"2024-09-20T20:31:32.067721+0000","last_clean":"2024-09-20T20:31:32.067721+0000","last_became_active":"2024-09-20T20:29:54.002201+0000","last_became_peered":"2024-09-20T20:29:54.002201+0000","last_unstale":"2024-09-20T20:31:32.067721+0000","last_undegraded":"2024-09-20T20:31:32.067721+0000","last_fullsized":"2024-09-20T20:31:32.067721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:37:23.872455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"50'144","reported_seq":171,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.530029+0000","last_change":"2024-09-20T20:31:10.499495+0000","last_active":"2024-09-20T20:31:32.530029+0000","last_peered":"2024-09-20T20:31:32.530029+0000","last_clean":"2024-09-20T20:31:32.530029+0000","last_became_active":"2024-09-20T20:31:10.498620+0000","last_became_peered":"2024-09-20T20:31:10.498620+0000","last_unstale":"2024-09-20T20:31:32.530029+0000","last_undegraded":"2024-09-20T20:31:32.530029+0000","last_fullsized":"2024-09-20T20:31:32.530029+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:17:34.440116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":802575,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'3","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746833+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:31:31.746833+0000","last_peered":"2024-09-20T20:31:31.746833+0000","last_clean":"2024-09-20T20:31:31.746833+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:31:31.746833+0000","last_undegraded":"2024-09-20T20:31:31.746833+0000","last_fullsized":"2024-09-20T20:31:31.746833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"50'158","reported_seq":232,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:32.610627+0000","last_change":"2024-09-20T20:29:55.014992+0000","last_active":"2024-09-20T20:31:32.610627+0000","last_peered":"2024-09-20T20:31:32.610627+0000","last_clean":"2024-09-20T20:31:32.610627+0000","last_became_active":"2024-09-20T20:29:55.012428+0000","last_became_peered":"2024-09-20T20:29:55.012428+0000","last_unstale":"2024-09-20T20:31:32.610627+0000","last_undegraded":"2024-09-20T20:31:32.610627+0000","last_fullsized":"2024-09-20T20:31:32.610627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:38.125199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521132,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":83,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-20T20:31:31.746823+0000","last_change":"2024-09-20T20:29:54.001943+0000","last_active":"2024-09-20T20:31:31.746823+0000","last_peered":"2024-09-20T20:31:31.746823+0000","last_clean":"2024-09-20T20:31:31.746823+0000","last_became_active":"2024-09-20T20:29:54.001063+0000","last_became_peered":"2024-09-20T20:29:54.001063+0000","last_unstale":"2024-09-20T20:31:31.746823+0000","last_undegraded":"2024-09-20T20:31:31.746823+0000","last_fullsized":"2024-09-20T20:31:31.746823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:36:43.727166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":53766526,"num_objects":8906,"num_object_clones":0,"num_object_copies":17812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8906,"num_write_kb":57149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":121237504,"data_stored":107545743,"data_compressed":12257474,"data_compressed_allocated":15171584,"data_compressed_original":44048384,"omap_allocated":0,"internal_metadata":0},"log_size":8907,"ondisk_log_size":8907,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":29361598,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":29530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11558912,"data_stored":58723196,"data_compressed":8821602,"data_compressed_allocated":10739712,"data_compressed_original":57958400,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738393,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74596,"kb_used_data":39244,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94297244,"statfs":{"total":96636764160,"available":96560377856,"internally_reserved":0,"allocated":40185856,"data_stored":50105869,"data_compressed":6464535,"data_compressed_allocated":8044544,"data_compressed_original":32296960,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738394,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73732,"kb_used_data":42544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94298108,"statfs":{"total":96636764160,"available":96561262592,"internally_reserved":0,"allocated":43565056,"data_stored":53184933,"data_compressed":6594500,"data_compressed_allocated":7979008,"data_compressed_original":30404608,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,0,2,4,8,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76616,"kb_used_data":41268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94295224,"statfs":{"total":96636764160,"available":96558309376,"internally_reserved":0,"allocated":42258432,"data_stored":54466210,"data_compressed":6811280,"data_compressed_allocated":8425472,"data_compressed_original":34279424,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4296704,"data_stored":20972990,"data_compressed":3205342,"data_compressed_allocated":3891200,"data_compressed_original":20594688,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4079616,"data_stored":20972374,"data_compressed":3164141,"data_compressed_allocated":3813376,"data_compressed_original":20725760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3182592,"data_stored":16777832,"data_compressed":2452119,"data_compressed_allocated":3035136,"data_compressed_original":16637952,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38584320,"data_stored":34289185,"data_compressed":3786673,"data_compressed_allocated":4726784,"data_compressed_original":14135296,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":43241472,"data_stored":37930521,"data_compressed":4225175,"data_compressed_allocated":5136384,"data_compressed_original":13643776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":39411712,"data_stored":35326037,"data_compressed":4245626,"data_compressed_allocated":5308416,"data_compressed_original":16269312,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:31:33.466 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-20T20:31:33.466 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:31:33.466 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-20T20:31:33.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-20T20:31:33.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:33.510 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:33.503+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:33.595 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.605355144000001, 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.604978189999997, 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.604874147999993, 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.603772909, 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.603682253000002, 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.603609781000003, 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.603547633999995, 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.603484885, 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.603376342000004, 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.603311055999995, 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.603249156999993, 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.601061387000001, 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.600963383999996, 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.599902056000005, 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.599459585999995, 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.598582643, 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.598493194, 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024090001, 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993717+0000", 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993719+0000", 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6929999999999996e-06 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993746+0000", 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993761+0000", 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.507e-05 2024-09-20T20:31:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003997+0000", 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010235918 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004246+0000", 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024960200000000003 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004457+0000", 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210375 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009464+0000", 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050070740000000002 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017502+0000", 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080382909999999995 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017651+0000", 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014894299999999999 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017807+0000", 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015629500000000001 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.598426931000006, 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.596913628999999, 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.052378955, 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029882941, 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539835+0000", 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547409+0000", 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075741580000000001 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547449+0000", 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9165999999999997e-05 2024-09-20T20:31:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547467+0000", 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547722+0000", 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025469099999999998 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547987+0000", 2024-09-20T20:31:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026537400000000002 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.548388+0000", 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040049399999999999 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.566710+0000", 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018322767 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569495+0000", 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027841799999999998 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569587+0000", 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2744000000000005e-05 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569714+0000", 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127021 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:33.705 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:33.706 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T20:31:33.707 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:33.707 INFO:teuthology.orchestra.run.smithi070.stderr:no valid command found; 10 closest matches: 2024-09-20T20:31:33.707 INFO:teuthology.orchestra.run.smithi070.stderr:0 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:1 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:2 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:abort 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:assert 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:bench [] [] [] [] 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs debug_inject_read_zeros 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs files list 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs stats 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:bluestore allocator dump block 2024-09-20T20:31:33.708 INFO:teuthology.orchestra.run.smithi070.stderr:Error EINVAL: invalid command 2024-09-20T20:31:33.708 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-20T20:31:33.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-20T20:31:33.709 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:33.699+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:33.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:31:33.807 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:33.805+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:33.842 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:33.842 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:33.842 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.842 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_repop(client.4469.0:9758 4.13 e51/17 4:ca460221:::10000002cd3.00000000:head v 51'148, mlcod=51'146)", 2024-09-20T20:31:33.842 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:33.840567+0000", 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.00064565599999999999, 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00066267699999999997, 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:33.840567+0000", 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:33.843 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:33.840567+0000", 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:33.840569+0000", 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7770000000000001e-06 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:33.840591+0000", 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:33.844 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:33.840618+0000", 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.6804999999999998e-05 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:33.840631+0000", 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2723e-05 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:33.840756+0000", 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012555699999999999 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:33.845 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:33.840792+0000", 2024-09-20T20:31:33.846 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6035000000000003e-05 2024-09-20T20:31:33.846 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:33.846 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:33.846 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:33.846 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:33.846 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-20T20:31:33.846 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 1 2024-09-20T20:31:33.846 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:33.859 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:no valid command found; 10 closest matches: 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:0 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:1 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:2 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:abort 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:assert 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:bench [] [] [] [] 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs debug_inject_read_zeros 2024-09-20T20:31:33.881 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs files list 2024-09-20T20:31:33.882 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs stats 2024-09-20T20:31:33.882 INFO:teuthology.orchestra.run.smithi070.stderr:bluestore allocator dump block 2024-09-20T20:31:33.882 INFO:teuthology.orchestra.run.smithi070.stderr:Error EINVAL: invalid command 2024-09-20T20:31:33.884 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T20:31:33.884 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-20T20:31:33.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-20T20:31:33.908 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:33.901+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:33.994 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:33.994 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:33.995 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:33.995 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:34.009 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:34.010 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:34.001+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:34.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:no valid command found; 10 closest matches: 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:0 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:1 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:2 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:abort 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:assert 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:bench [] [] [] [] 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs debug_inject_read_zeros 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs files list 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:bluefs stats 2024-09-20T20:31:34.064 INFO:teuthology.orchestra.run.smithi070.stderr:bluestore allocator dump block 2024-09-20T20:31:34.065 INFO:teuthology.orchestra.run.smithi070.stderr:Error EINVAL: invalid command 2024-09-20T20:31:34.067 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T20:31:34.068 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-20T20:31:34.110 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:34.101+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:34.162 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:34.162 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:34.183 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:34.183 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:34.189 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:34.189 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:34.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:34.206 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:34.206 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:34.251 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:34.247+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:34.313 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:34.309+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:34.344 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:34.344 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:34.359 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:34.447 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:34.443+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:34.515 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:34.513+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:34.535 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:34.536 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:34.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:34.615 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:34.609+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:34.716 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:34.709+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:34.726 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:34.726 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:34.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:34.752 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:31:34.814 INFO:tasks.workunit.client.0.smithi070.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-20T20:31:34.817 INFO:tasks.workunit.client.0.smithi070.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T20:31:34.817 INFO:tasks.workunit.client.0.smithi070.stderr:+ make 2024-09-20T20:31:34.817 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:34.813+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:34.849 INFO:tasks.workunit.client.0.smithi070.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-20T20:31:34.879 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:34.879 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:34.893 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:34.917 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:34.913+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:35.019 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:35.017+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:35.058 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:35.059 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:35.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:35.119 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:35.115+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:35.136 INFO:tasks.workunit.client.0.smithi070.stderr:++ readlink -f fsstress 2024-09-20T20:31:35.137 INFO:tasks.workunit.client.0.smithi070.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-20T20:31:35.138 INFO:tasks.workunit.client.0.smithi070.stderr:+ popd 2024-09-20T20:31:35.138 INFO:tasks.workunit.client.0.smithi070.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T20:31:35.138 INFO:tasks.workunit.client.0.smithi070.stderr:+ popd 2024-09-20T20:31:35.139 INFO:tasks.workunit.client.0.smithi070.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-20T20:31:35.139 INFO:tasks.workunit.client.0.smithi070.stderr:++ mktemp -d -p . 2024-09-20T20:31:35.140 INFO:tasks.workunit.client.0.smithi070.stderr:+ T=./tmp.XDIi8MGPiX 2024-09-20T20:31:35.140 INFO:tasks.workunit.client.0.smithi070.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.XDIi8MGPiX -l 1 -n 1000 -p 10 -v 2024-09-20T20:31:35.142 INFO:tasks.workunit.client.0.smithi070.stdout:seed = 1727002420 2024-09-20T20:31:35.143 INFO:tasks.workunit.client.0.smithi070.stdout:0/0: dread - no filename 2024-09-20T20:31:35.143 INFO:tasks.workunit.client.0.smithi070.stdout:0/1: stat - no entries 2024-09-20T20:31:35.144 INFO:tasks.workunit.client.0.smithi070.stdout:0/2: dwrite - no filename 2024-09-20T20:31:35.144 INFO:tasks.workunit.client.0.smithi070.stdout:0/3: chown . 328439 1 2024-09-20T20:31:35.144 INFO:tasks.workunit.client.0.smithi070.stdout:0/4: chown . 352023579 1 2024-09-20T20:31:35.144 INFO:tasks.workunit.client.0.smithi070.stdout:0/5: dread - no filename 2024-09-20T20:31:35.144 INFO:tasks.workunit.client.0.smithi070.stdout:2/0: fdatasync - no filename 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:0/6: creat f0 x:0 0 0 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:2/1: getdents . 0 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:2/2: link - no file 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:2/3: read - no filename 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:2/4: write - no filename 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:3/0: dwrite - no filename 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:3/1: dread - no filename 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:3/2: dwrite - no filename 2024-09-20T20:31:35.145 INFO:tasks.workunit.client.0.smithi070.stdout:3/3: dwrite - no filename 2024-09-20T20:31:35.146 INFO:tasks.workunit.client.0.smithi070.stdout:3/4: dwrite - no filename 2024-09-20T20:31:35.146 INFO:tasks.workunit.client.0.smithi070.stdout:3/5: dwrite - no filename 2024-09-20T20:31:35.146 INFO:tasks.workunit.client.0.smithi070.stdout:3/6: fsync - no filename 2024-09-20T20:31:35.146 INFO:tasks.workunit.client.0.smithi070.stdout:0/7: rename f0 to f1 0 2024-09-20T20:31:35.146 INFO:tasks.workunit.client.0.smithi070.stdout:1/0: mknod c0 0 2024-09-20T20:31:35.147 INFO:tasks.workunit.client.0.smithi070.stdout:2/5: creat f0 x:0 0 0 2024-09-20T20:31:35.147 INFO:tasks.workunit.client.0.smithi070.stdout:4/0: fdatasync - no filename 2024-09-20T20:31:35.147 INFO:tasks.workunit.client.0.smithi070.stdout:3/7: creat f0 x:0 0 0 2024-09-20T20:31:35.147 INFO:tasks.workunit.client.0.smithi070.stdout:1/1: creat f1 x:0 0 0 2024-09-20T20:31:35.147 INFO:tasks.workunit.client.0.smithi070.stdout:5/0: stat - no entries 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:5/1: link - no file 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:2/6: creat f1 x:0 0 0 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:3/8: dread - f0 zero size 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:4/1: mknod c0 0 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:1/2: creat f2 x:0 0 0 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:0/8: write f1 [434448,17596] 0 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:5/2: creat f0 x:0 0 0 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:6/0: dread - no filename 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:6/1: write - no filename 2024-09-20T20:31:35.148 INFO:tasks.workunit.client.0.smithi070.stdout:3/9: write f0 [62863,56232] 0 2024-09-20T20:31:35.150 INFO:tasks.workunit.client.0.smithi070.stdout:2/7: write f1 [952225,129124] 0 2024-09-20T20:31:35.150 INFO:tasks.workunit.client.0.smithi070.stdout:4/2: creat f1 x:0 0 0 2024-09-20T20:31:35.150 INFO:tasks.workunit.client.0.smithi070.stdout:0/9: stat f1 0 2024-09-20T20:31:35.150 INFO:tasks.workunit.client.0.smithi070.stdout:1/3: mknod c3 0 2024-09-20T20:31:35.150 INFO:tasks.workunit.client.0.smithi070.stdout:5/3: dread - f0 zero size 2024-09-20T20:31:35.150 INFO:tasks.workunit.client.0.smithi070.stdout:2/8: chown f1 1441332 1 2024-09-20T20:31:35.150 INFO:tasks.workunit.client.0.smithi070.stdout:0/10: chown f1 830 1 2024-09-20T20:31:35.150 INFO:tasks.workunit.client.0.smithi070.stdout:6/2: creat f0 x:0 0 0 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:8/0: readlink - no filename 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:6/3: creat f1 x:0 0 0 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:7/0: mknod c0 0 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:2/9: link f1 f2 0 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:8/1: creat f0 x:0 0 0 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:7/1: creat f1 x:0 0 0 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:3/10: chown f0 14265 1 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:7/2: stat c0 0 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:8/2: chown f0 817342588 1 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:2/10: mkdir d3 0 2024-09-20T20:31:35.151 INFO:tasks.workunit.client.0.smithi070.stdout:9/0: creat f0 x:0 0 0 2024-09-20T20:31:35.152 INFO:tasks.workunit.client.0.smithi070.stdout:3/11: symlink l1 0 2024-09-20T20:31:35.152 INFO:tasks.workunit.client.0.smithi070.stdout:7/3: dread - f1 zero size 2024-09-20T20:31:35.152 INFO:tasks.workunit.client.0.smithi070.stdout:2/11: chown f0 5653653 1 2024-09-20T20:31:35.152 INFO:tasks.workunit.client.0.smithi070.stdout:7/4: rmdir - no directory 2024-09-20T20:31:35.152 INFO:tasks.workunit.client.0.smithi070.stdout:3/12: fdatasync f0 0 2024-09-20T20:31:35.152 INFO:tasks.workunit.client.0.smithi070.stdout:2/12: fdatasync f2 0 2024-09-20T20:31:35.153 INFO:tasks.workunit.client.0.smithi070.stdout:7/5: dread - f1 zero size 2024-09-20T20:31:35.153 INFO:tasks.workunit.client.0.smithi070.stdout:8/3: creat f1 x:0 0 0 2024-09-20T20:31:35.153 INFO:tasks.workunit.client.0.smithi070.stdout:0/11: dread f1 [0,4194304] 0 2024-09-20T20:31:35.154 INFO:tasks.workunit.client.0.smithi070.stdout:2/13: creat d3/f4 x:0 0 0 2024-09-20T20:31:35.156 INFO:tasks.workunit.client.0.smithi070.stdout:8/4: write f1 [322964,80717] 0 2024-09-20T20:31:35.156 INFO:tasks.workunit.client.0.smithi070.stdout:3/13: dread f0 [0,4194304] 0 2024-09-20T20:31:35.156 INFO:tasks.workunit.client.0.smithi070.stdout:2/14: mkdir d3/d5 0 2024-09-20T20:31:35.157 INFO:tasks.workunit.client.0.smithi070.stdout:0/12: dread f1 [0,4194304] 0 2024-09-20T20:31:35.158 INFO:tasks.workunit.client.0.smithi070.stdout:8/5: rename f1 to f2 0 2024-09-20T20:31:35.158 INFO:tasks.workunit.client.0.smithi070.stdout:2/15: creat d3/f6 x:0 0 0 2024-09-20T20:31:35.160 INFO:tasks.workunit.client.0.smithi070.stdout:1/4: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.160 INFO:tasks.workunit.client.0.smithi070.stdout:3/14: truncate f0 295527 0 2024-09-20T20:31:35.162 INFO:tasks.workunit.client.0.smithi070.stdout:2/16: write f0 [863863,130548] 0 2024-09-20T20:31:35.164 INFO:tasks.workunit.client.0.smithi070.stdout:6/4: dwrite f0 [0,4194304] 0 2024-09-20T20:31:35.166 INFO:tasks.workunit.client.0.smithi070.stdout:2/17: write f1 [1192405,18016] 0 2024-09-20T20:31:35.166 INFO:tasks.workunit.client.0.smithi070.stdout:6/5: read f0 [1322495,56397] 0 2024-09-20T20:31:35.167 INFO:tasks.workunit.client.0.smithi070.stdout:9/1: dwrite f0 [0,4194304] 0 2024-09-20T20:31:35.169 INFO:tasks.workunit.client.0.smithi070.stdout:0/13: creat f2 x:0 0 0 2024-09-20T20:31:35.169 INFO:tasks.workunit.client.0.smithi070.stdout:7/6: dwrite f1 [0,4194304] 0 2024-09-20T20:31:35.169 INFO:tasks.workunit.client.0.smithi070.stdout:0/14: fdatasync f2 0 2024-09-20T20:31:35.174 INFO:tasks.workunit.client.0.smithi070.stdout:3/15: creat f2 x:0 0 0 2024-09-20T20:31:35.174 INFO:tasks.workunit.client.0.smithi070.stdout:3/16: stat f2 0 2024-09-20T20:31:35.174 INFO:tasks.workunit.client.0.smithi070.stdout:5/4: getdents . 0 2024-09-20T20:31:35.174 INFO:tasks.workunit.client.0.smithi070.stdout:4/3: fsync f1 0 2024-09-20T20:31:35.175 INFO:tasks.workunit.client.0.smithi070.stdout:4/4: dread - f1 zero size 2024-09-20T20:31:35.175 INFO:tasks.workunit.client.0.smithi070.stdout:6/6: mknod c2 0 2024-09-20T20:31:35.175 INFO:tasks.workunit.client.0.smithi070.stdout:0/15: mknod c3 0 2024-09-20T20:31:35.175 INFO:tasks.workunit.client.0.smithi070.stdout:5/5: creat f1 x:0 0 0 2024-09-20T20:31:35.175 INFO:tasks.workunit.client.0.smithi070.stdout:8/6: fsync f2 0 2024-09-20T20:31:35.176 INFO:tasks.workunit.client.0.smithi070.stdout:0/16: mkdir d4 0 2024-09-20T20:31:35.176 INFO:tasks.workunit.client.0.smithi070.stdout:5/6: mkdir d2 0 2024-09-20T20:31:35.176 INFO:tasks.workunit.client.0.smithi070.stdout:4/5: unlink f1 0 2024-09-20T20:31:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:6/7: truncate f1 864547 0 2024-09-20T20:31:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:8/7: dread - f0 zero size 2024-09-20T20:31:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:0/17: read - f2 zero size 2024-09-20T20:31:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:4/6: stat c0 0 2024-09-20T20:31:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:1/5: dwrite f1 [0,4194304] 0 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:3/17: getdents . 0 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:8/8: write f2 [559124,92583] 0 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:4/7: chown c0 14 1 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:1/6: mkdir d4 0 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:0/18: creat d4/f5 x:0 0 0 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:0/19: readlink - no filename 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:5/7: mkdir d2/d3 0 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:4/8: stat c0 0 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:8/9: truncate f2 989195 0 2024-09-20T20:31:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:3/18: creat f3 x:0 0 0 2024-09-20T20:31:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:3/19: readlink l1 0 2024-09-20T20:31:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:0/20: chown d4/f5 62 1 2024-09-20T20:31:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:1/7: write f1 [3985983,128408] 0 2024-09-20T20:31:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:4/9: creat f2 x:0 0 0 2024-09-20T20:31:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:5/8: rmdir d2/d3 0 2024-09-20T20:31:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:7/7: dread f1 [0,4194304] 0 2024-09-20T20:31:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:4/10: rename c0 to c3 0 2024-09-20T20:31:35.183 INFO:tasks.workunit.client.0.smithi070.stdout:1/8: creat d4/f5 x:0 0 0 2024-09-20T20:31:35.184 INFO:tasks.workunit.client.0.smithi070.stdout:5/9: mkdir d2/d4 0 2024-09-20T20:31:35.184 INFO:tasks.workunit.client.0.smithi070.stdout:3/20: getdents . 0 2024-09-20T20:31:35.185 INFO:tasks.workunit.client.0.smithi070.stdout:5/10: rename d2 to d2/d5 22 2024-09-20T20:31:35.185 INFO:tasks.workunit.client.0.smithi070.stdout:4/11: link f2 f4 0 2024-09-20T20:31:35.186 INFO:tasks.workunit.client.0.smithi070.stdout:4/12: dread - f4 zero size 2024-09-20T20:31:35.186 INFO:tasks.workunit.client.0.smithi070.stdout:5/11: rmdir d2 39 2024-09-20T20:31:35.187 INFO:tasks.workunit.client.0.smithi070.stdout:5/12: read - f0 zero size 2024-09-20T20:31:35.187 INFO:tasks.workunit.client.0.smithi070.stdout:4/13: symlink l5 0 2024-09-20T20:31:35.187 INFO:tasks.workunit.client.0.smithi070.stdout:6/8: fdatasync f0 0 2024-09-20T20:31:35.188 INFO:tasks.workunit.client.0.smithi070.stdout:6/9: stat c2 0 2024-09-20T20:31:35.188 INFO:tasks.workunit.client.0.smithi070.stdout:8/10: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.189 INFO:tasks.workunit.client.0.smithi070.stdout:6/10: mknod c3 0 2024-09-20T20:31:35.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/13: write f0 [84265,82107] 0 2024-09-20T20:31:35.190 INFO:tasks.workunit.client.0.smithi070.stdout:8/11: chown f0 1075938 1 2024-09-20T20:31:35.190 INFO:tasks.workunit.client.0.smithi070.stdout:0/21: dwrite d4/f5 [0,4194304] 0 2024-09-20T20:31:35.191 INFO:tasks.workunit.client.0.smithi070.stdout:5/14: write f1 [837026,35562] 0 2024-09-20T20:31:35.191 INFO:tasks.workunit.client.0.smithi070.stdout:0/22: fsync f2 0 2024-09-20T20:31:35.192 INFO:tasks.workunit.client.0.smithi070.stdout:1/9: truncate f2 818539 0 2024-09-20T20:31:35.193 INFO:tasks.workunit.client.0.smithi070.stdout:0/23: symlink d4/l6 0 2024-09-20T20:31:35.193 INFO:tasks.workunit.client.0.smithi070.stdout:5/15: write f1 [1181929,101472] 0 2024-09-20T20:31:35.194 INFO:tasks.workunit.client.0.smithi070.stdout:0/24: chown d4/f5 221324 1 2024-09-20T20:31:35.195 INFO:tasks.workunit.client.0.smithi070.stdout:3/21: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.197 INFO:tasks.workunit.client.0.smithi070.stdout:0/25: write f1 [597576,90822] 0 2024-09-20T20:31:35.198 INFO:tasks.workunit.client.0.smithi070.stdout:3/22: creat f4 x:0 0 0 2024-09-20T20:31:35.200 INFO:tasks.workunit.client.0.smithi070.stdout:3/23: readlink l1 0 2024-09-20T20:31:35.202 INFO:tasks.workunit.client.0.smithi070.stdout:4/14: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.202 INFO:tasks.workunit.client.0.smithi070.stdout:3/24: creat f5 x:0 0 0 2024-09-20T20:31:35.203 INFO:tasks.workunit.client.0.smithi070.stdout:3/25: readlink l1 0 2024-09-20T20:31:35.204 INFO:tasks.workunit.client.0.smithi070.stdout:4/15: mkdir d6 0 2024-09-20T20:31:35.204 INFO:tasks.workunit.client.0.smithi070.stdout:8/12: dwrite f0 [0,4194304] 0 2024-09-20T20:31:35.205 INFO:tasks.workunit.client.0.smithi070.stdout:3/26: symlink l6 0 2024-09-20T20:31:35.206 INFO:tasks.workunit.client.0.smithi070.stdout:3/27: mkdir d7 0 2024-09-20T20:31:35.206 INFO:tasks.workunit.client.0.smithi070.stdout:1/10: dwrite f1 [0,4194304] 0 2024-09-20T20:31:35.207 INFO:tasks.workunit.client.0.smithi070.stdout:4/16: write f4 [1524386,15308] 0 2024-09-20T20:31:35.207 INFO:tasks.workunit.client.0.smithi070.stdout:8/13: link f0 f3 0 2024-09-20T20:31:35.208 INFO:tasks.workunit.client.0.smithi070.stdout:5/16: dwrite f0 [0,4194304] 0 2024-09-20T20:31:35.208 INFO:tasks.workunit.client.0.smithi070.stdout:4/17: chown f2 2786762 1 2024-09-20T20:31:35.209 INFO:tasks.workunit.client.0.smithi070.stdout:1/11: mkdir d4/d6 0 2024-09-20T20:31:35.210 INFO:tasks.workunit.client.0.smithi070.stdout:0/26: dwrite f1 [0,4194304] 0 2024-09-20T20:31:35.210 INFO:tasks.workunit.client.0.smithi070.stdout:3/28: mkdir d7/d8 0 2024-09-20T20:31:35.211 INFO:tasks.workunit.client.0.smithi070.stdout:0/27: creat d4/f7 x:0 0 0 2024-09-20T20:31:35.211 INFO:tasks.workunit.client.0.smithi070.stdout:3/29: write f0 [1238947,47465] 0 2024-09-20T20:31:35.211 INFO:tasks.workunit.client.0.smithi070.stdout:0/28: fdatasync f2 0 2024-09-20T20:31:35.211 INFO:tasks.workunit.client.0.smithi070.stdout:1/12: creat d4/d6/f7 x:0 0 0 2024-09-20T20:31:35.212 INFO:tasks.workunit.client.0.smithi070.stdout:3/30: creat d7/f9 x:0 0 0 2024-09-20T20:31:35.212 INFO:tasks.workunit.client.0.smithi070.stdout:1/13: write f1 [4116694,51342] 0 2024-09-20T20:31:35.213 INFO:tasks.workunit.client.0.smithi070.stdout:8/14: dread f2 [0,4194304] 0 2024-09-20T20:31:35.213 INFO:tasks.workunit.client.0.smithi070.stdout:3/31: write d7/f9 [172638,87479] 0 2024-09-20T20:31:35.213 INFO:tasks.workunit.client.0.smithi070.stdout:4/18: dread f2 [0,4194304] 0 2024-09-20T20:31:35.213 INFO:tasks.workunit.client.0.smithi070.stdout:1/14: rename c0 to d4/c8 0 2024-09-20T20:31:35.214 INFO:tasks.workunit.client.0.smithi070.stdout:1/15: rmdir d4/d6 39 2024-09-20T20:31:35.220 INFO:tasks.workunit.client.0.smithi070.stdout:8/15: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.220 INFO:tasks.workunit.client.0.smithi070.stdout:4/19: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.221 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:35.215+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:35.222 INFO:tasks.workunit.client.0.smithi070.stdout:8/16: mkdir d4 0 2024-09-20T20:31:35.222 INFO:tasks.workunit.client.0.smithi070.stdout:4/20: mkdir d6/d7 0 2024-09-20T20:31:35.248 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:35.248 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:35.255 INFO:tasks.workunit.client.0.smithi070.stdout:3/32: getdents d7 0 2024-09-20T20:31:35.256 INFO:tasks.workunit.client.0.smithi070.stdout:3/33: truncate f5 87540 0 2024-09-20T20:31:35.256 INFO:tasks.workunit.client.0.smithi070.stdout:3/34: write f5 [286474,19621] 0 2024-09-20T20:31:35.258 INFO:tasks.workunit.client.0.smithi070.stdout:4/21: truncate f4 1380585 0 2024-09-20T20:31:35.258 INFO:tasks.workunit.client.0.smithi070.stdout:8/17: dwrite f2 [4194304,4194304] 0 2024-09-20T20:31:35.263 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:35.264 INFO:tasks.workunit.client.0.smithi070.stdout:8/18: dread f2 [4194304,4194304] 0 2024-09-20T20:31:35.266 INFO:tasks.workunit.client.0.smithi070.stdout:3/35: dwrite f3 [0,4194304] 0 2024-09-20T20:31:35.267 INFO:tasks.workunit.client.0.smithi070.stdout:1/16: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.268 INFO:tasks.workunit.client.0.smithi070.stdout:1/17: mknod d4/c9 0 2024-09-20T20:31:35.268 INFO:tasks.workunit.client.0.smithi070.stdout:3/36: getdents d7 0 2024-09-20T20:31:35.270 INFO:tasks.workunit.client.0.smithi070.stdout:3/37: read f3 [1409463,25856] 0 2024-09-20T20:31:35.274 INFO:tasks.workunit.client.0.smithi070.stdout:3/38: dread f2 [0,4194304] 0 2024-09-20T20:31:35.274 INFO:tasks.workunit.client.0.smithi070.stdout:3/39: readlink l1 0 2024-09-20T20:31:35.275 INFO:tasks.workunit.client.0.smithi070.stdout:8/19: truncate f3 1098344 0 2024-09-20T20:31:35.275 INFO:tasks.workunit.client.0.smithi070.stdout:3/40: readlink l1 0 2024-09-20T20:31:35.275 INFO:tasks.workunit.client.0.smithi070.stdout:4/22: dread f4 [0,4194304] 0 2024-09-20T20:31:35.275 INFO:tasks.workunit.client.0.smithi070.stdout:8/20: symlink d4/l5 0 2024-09-20T20:31:35.275 INFO:tasks.workunit.client.0.smithi070.stdout:4/23: fdatasync f4 0 2024-09-20T20:31:35.276 INFO:tasks.workunit.client.0.smithi070.stdout:4/24: readlink l5 0 2024-09-20T20:31:35.276 INFO:tasks.workunit.client.0.smithi070.stdout:1/18: dwrite f1 [0,4194304] 0 2024-09-20T20:31:35.276 INFO:tasks.workunit.client.0.smithi070.stdout:8/21: mknod d4/c6 0 2024-09-20T20:31:35.277 INFO:tasks.workunit.client.0.smithi070.stdout:4/25: unlink l5 0 2024-09-20T20:31:35.277 INFO:tasks.workunit.client.0.smithi070.stdout:4/26: fdatasync f2 0 2024-09-20T20:31:35.277 INFO:tasks.workunit.client.0.smithi070.stdout:8/22: creat d4/f7 x:0 0 0 2024-09-20T20:31:35.277 INFO:tasks.workunit.client.0.smithi070.stdout:1/19: symlink d4/d6/la 0 2024-09-20T20:31:35.277 INFO:tasks.workunit.client.0.smithi070.stdout:8/23: read - d4/f7 zero size 2024-09-20T20:31:35.278 INFO:tasks.workunit.client.0.smithi070.stdout:8/24: mknod d4/c8 0 2024-09-20T20:31:35.278 INFO:tasks.workunit.client.0.smithi070.stdout:1/20: mknod d4/cb 0 2024-09-20T20:31:35.278 INFO:tasks.workunit.client.0.smithi070.stdout:1/21: unlink d4/f5 0 2024-09-20T20:31:35.280 INFO:tasks.workunit.client.0.smithi070.stdout:1/22: creat d4/fc x:0 0 0 2024-09-20T20:31:35.280 INFO:tasks.workunit.client.0.smithi070.stdout:1/23: read - d4/d6/f7 zero size 2024-09-20T20:31:35.282 INFO:tasks.workunit.client.0.smithi070.stdout:1/24: mkdir d4/dd 0 2024-09-20T20:31:35.283 INFO:tasks.workunit.client.0.smithi070.stdout:4/27: dwrite f4 [0,4194304] 0 2024-09-20T20:31:35.283 INFO:tasks.workunit.client.0.smithi070.stdout:1/25: unlink d4/c9 0 2024-09-20T20:31:35.283 INFO:tasks.workunit.client.0.smithi070.stdout:4/28: write f4 [3385501,35348] 0 2024-09-20T20:31:35.285 INFO:tasks.workunit.client.0.smithi070.stdout:1/26: rename c3 to d4/dd/ce 0 2024-09-20T20:31:35.285 INFO:tasks.workunit.client.0.smithi070.stdout:1/27: rmdir d4/d6 39 2024-09-20T20:31:35.286 INFO:tasks.workunit.client.0.smithi070.stdout:1/28: dread - d4/d6/f7 zero size 2024-09-20T20:31:35.291 INFO:tasks.workunit.client.0.smithi070.stdout:4/29: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.292 INFO:tasks.workunit.client.0.smithi070.stdout:4/30: rmdir d6 39 2024-09-20T20:31:35.293 INFO:tasks.workunit.client.0.smithi070.stdout:4/31: chown d6/d7 30128223 1 2024-09-20T20:31:35.293 INFO:tasks.workunit.client.0.smithi070.stdout:4/32: creat d6/f8 x:0 0 0 2024-09-20T20:31:35.294 INFO:tasks.workunit.client.0.smithi070.stdout:4/33: write d6/f8 [39383,117780] 0 2024-09-20T20:31:35.297 INFO:tasks.workunit.client.0.smithi070.stdout:4/34: dread f4 [0,4194304] 0 2024-09-20T20:31:35.297 INFO:tasks.workunit.client.0.smithi070.stdout:4/35: stat c3 0 2024-09-20T20:31:35.298 INFO:tasks.workunit.client.0.smithi070.stdout:4/36: creat d6/d7/f9 x:0 0 0 2024-09-20T20:31:35.298 INFO:tasks.workunit.client.0.smithi070.stdout:4/37: chown d6/f8 363048 1 2024-09-20T20:31:35.299 INFO:tasks.workunit.client.0.smithi070.stdout:4/38: mknod d6/d7/ca 0 2024-09-20T20:31:35.318 INFO:tasks.workunit.client.0.smithi070.stdout:8/25: truncate f0 159344 0 2024-09-20T20:31:35.320 INFO:tasks.workunit.client.0.smithi070.stdout:4/39: fdatasync f4 0 2024-09-20T20:31:35.320 INFO:tasks.workunit.client.0.smithi070.stdout:4/40: chown f4 81001 1 2024-09-20T20:31:35.321 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:35.317+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:35.321 INFO:tasks.workunit.client.0.smithi070.stdout:4/41: link c3 d6/cb 0 2024-09-20T20:31:35.322 INFO:tasks.workunit.client.0.smithi070.stdout:8/26: dread f2 [4194304,4194304] 0 2024-09-20T20:31:35.326 INFO:tasks.workunit.client.0.smithi070.stdout:4/42: dwrite f4 [0,4194304] 0 2024-09-20T20:31:35.327 INFO:tasks.workunit.client.0.smithi070.stdout:4/43: truncate f2 4727140 0 2024-09-20T20:31:35.333 INFO:tasks.workunit.client.0.smithi070.stdout:4/44: dwrite d6/f8 [0,4194304] 0 2024-09-20T20:31:35.335 INFO:tasks.workunit.client.0.smithi070.stdout:8/27: dwrite f0 [0,4194304] 0 2024-09-20T20:31:35.336 INFO:tasks.workunit.client.0.smithi070.stdout:8/28: write f2 [200324,2427] 0 2024-09-20T20:31:35.338 INFO:tasks.workunit.client.0.smithi070.stdout:8/29: truncate f2 9344315 0 2024-09-20T20:31:35.339 INFO:tasks.workunit.client.0.smithi070.stdout:8/30: creat d4/f9 x:0 0 0 2024-09-20T20:31:35.339 INFO:tasks.workunit.client.0.smithi070.stdout:8/31: symlink d4/la 0 2024-09-20T20:31:35.340 INFO:tasks.workunit.client.0.smithi070.stdout:8/32: chown d4/f9 1805923688 1 2024-09-20T20:31:35.341 INFO:tasks.workunit.client.0.smithi070.stdout:8/33: mkdir d4/db 0 2024-09-20T20:31:35.341 INFO:tasks.workunit.client.0.smithi070.stdout:8/34: symlink d4/lc 0 2024-09-20T20:31:35.342 INFO:tasks.workunit.client.0.smithi070.stdout:4/45: dwrite f2 [4194304,4194304] 0 2024-09-20T20:31:35.342 INFO:tasks.workunit.client.0.smithi070.stdout:8/35: stat d4/c8 0 2024-09-20T20:31:35.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/36: dwrite f3 [0,4194304] 0 2024-09-20T20:31:35.351 INFO:tasks.workunit.client.0.smithi070.stdout:4/46: dwrite f4 [4194304,4194304] 0 2024-09-20T20:31:35.353 INFO:tasks.workunit.client.0.smithi070.stdout:4/47: mkdir d6/d7/dc 0 2024-09-20T20:31:35.353 INFO:tasks.workunit.client.0.smithi070.stdout:4/48: dread - d6/d7/f9 zero size 2024-09-20T20:31:35.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/49: rename d6 to d6/dd 22 2024-09-20T20:31:35.355 INFO:tasks.workunit.client.0.smithi070.stdout:4/50: chown c3 718901375 1 2024-09-20T20:31:35.355 INFO:tasks.workunit.client.0.smithi070.stdout:8/37: dread f2 [4194304,4194304] 0 2024-09-20T20:31:35.356 INFO:tasks.workunit.client.0.smithi070.stdout:8/38: mknod d4/db/cd 0 2024-09-20T20:31:35.356 INFO:tasks.workunit.client.0.smithi070.stdout:8/39: fdatasync d4/f9 0 2024-09-20T20:31:35.357 INFO:tasks.workunit.client.0.smithi070.stdout:8/40: link d4/lc d4/db/le 0 2024-09-20T20:31:35.363 INFO:tasks.workunit.client.0.smithi070.stdout:8/41: dread f0 [0,4194304] 0 2024-09-20T20:31:35.363 INFO:tasks.workunit.client.0.smithi070.stdout:4/51: dwrite d6/d7/f9 [0,4194304] 0 2024-09-20T20:31:35.364 INFO:tasks.workunit.client.0.smithi070.stdout:4/52: creat d6/d7/dc/fe x:0 0 0 2024-09-20T20:31:35.364 INFO:tasks.workunit.client.0.smithi070.stdout:4/53: write f2 [5027346,108212] 0 2024-09-20T20:31:35.365 INFO:tasks.workunit.client.0.smithi070.stdout:4/54: creat d6/ff x:0 0 0 2024-09-20T20:31:35.366 INFO:tasks.workunit.client.0.smithi070.stdout:4/55: rename d6/cb to d6/c10 0 2024-09-20T20:31:35.366 INFO:tasks.workunit.client.0.smithi070.stdout:4/56: creat d6/f11 x:0 0 0 2024-09-20T20:31:35.369 INFO:tasks.workunit.client.0.smithi070.stdout:4/57: dread d6/d7/f9 [0,4194304] 0 2024-09-20T20:31:35.370 INFO:tasks.workunit.client.0.smithi070.stdout:8/42: fsync f0 0 2024-09-20T20:31:35.370 INFO:tasks.workunit.client.0.smithi070.stdout:4/58: stat d6/d7/dc 0 2024-09-20T20:31:35.370 INFO:tasks.workunit.client.0.smithi070.stdout:4/59: chown f2 4350229 1 2024-09-20T20:31:35.370 INFO:tasks.workunit.client.0.smithi070.stdout:8/43: creat d4/db/ff x:0 0 0 2024-09-20T20:31:35.377 INFO:tasks.workunit.client.0.smithi070.stdout:8/44: dwrite f0 [4194304,4194304] 0 2024-09-20T20:31:35.379 INFO:tasks.workunit.client.0.smithi070.stdout:8/45: mknod d4/c10 0 2024-09-20T20:31:35.387 INFO:tasks.workunit.client.0.smithi070.stdout:8/46: dwrite d4/f7 [0,4194304] 0 2024-09-20T20:31:35.388 INFO:tasks.workunit.client.0.smithi070.stdout:8/47: rename f2 to d4/db/f11 0 2024-09-20T20:31:35.391 INFO:tasks.workunit.client.0.smithi070.stdout:8/48: dread f3 [0,4194304] 0 2024-09-20T20:31:35.392 INFO:tasks.workunit.client.0.smithi070.stdout:8/49: rmdir d4/db 39 2024-09-20T20:31:35.396 INFO:tasks.workunit.client.0.smithi070.stdout:8/50: dread d4/f7 [0,4194304] 0 2024-09-20T20:31:35.397 INFO:tasks.workunit.client.0.smithi070.stdout:8/51: rename f3 to d4/f12 0 2024-09-20T20:31:35.398 INFO:tasks.workunit.client.0.smithi070.stdout:8/52: creat d4/db/f13 x:0 0 0 2024-09-20T20:31:35.404 INFO:tasks.workunit.client.0.smithi070.stdout:8/53: dwrite d4/f12 [0,4194304] 0 2024-09-20T20:31:35.404 INFO:tasks.workunit.client.0.smithi070.stdout:8/54: readlink d4/l5 0 2024-09-20T20:31:35.406 INFO:tasks.workunit.client.0.smithi070.stdout:8/55: mknod d4/db/c14 0 2024-09-20T20:31:35.411 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:35.411 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:35.415 INFO:tasks.workunit.client.0.smithi070.stdout:8/56: dwrite d4/db/ff [0,4194304] 0 2024-09-20T20:31:35.416 INFO:tasks.workunit.client.0.smithi070.stdout:8/57: write d4/db/f11 [9450256,122091] 0 2024-09-20T20:31:35.416 INFO:tasks.workunit.client.0.smithi070.stdout:8/58: dread - d4/db/f13 zero size 2024-09-20T20:31:35.417 INFO:tasks.workunit.client.0.smithi070.stdout:8/59: mknod d4/c15 0 2024-09-20T20:31:35.417 INFO:tasks.workunit.client.0.smithi070.stdout:8/60: creat d4/db/f16 x:0 0 0 2024-09-20T20:31:35.421 INFO:tasks.workunit.client.0.smithi070.stdout:8/61: dread d4/db/f11 [0,4194304] 0 2024-09-20T20:31:35.421 INFO:tasks.workunit.client.0.smithi070.stdout:8/62: chown d4/db/f11 45334 1 2024-09-20T20:31:35.422 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:35.413+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:35.422 INFO:tasks.workunit.client.0.smithi070.stdout:8/63: mkdir d4/d17 0 2024-09-20T20:31:35.424 INFO:tasks.workunit.client.0.smithi070.stdout:8/64: creat d4/f18 x:0 0 0 2024-09-20T20:31:35.424 INFO:tasks.workunit.client.0.smithi070.stdout:6/11: dread f1 [0,4194304] 0 2024-09-20T20:31:35.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:35.425 INFO:tasks.workunit.client.0.smithi070.stdout:6/12: mkdir d4 0 2024-09-20T20:31:35.426 INFO:tasks.workunit.client.0.smithi070.stdout:6/13: mknod d4/c5 0 2024-09-20T20:31:35.426 INFO:tasks.workunit.client.0.smithi070.stdout:6/14: creat d4/f6 x:0 0 0 2024-09-20T20:31:35.426 INFO:tasks.workunit.client.0.smithi070.stdout:6/15: write d4/f6 [991925,71100] 0 2024-09-20T20:31:35.429 INFO:tasks.workunit.client.0.smithi070.stdout:6/16: dread f0 [0,4194304] 0 2024-09-20T20:31:35.430 INFO:tasks.workunit.client.0.smithi070.stdout:6/17: chown d4 47941 1 2024-09-20T20:31:35.430 INFO:tasks.workunit.client.0.smithi070.stdout:6/18: stat f0 0 2024-09-20T20:31:35.430 INFO:tasks.workunit.client.0.smithi070.stdout:6/19: creat d4/f7 x:0 0 0 2024-09-20T20:31:35.430 INFO:tasks.workunit.client.0.smithi070.stdout:6/20: readlink - no filename 2024-09-20T20:31:35.435 INFO:tasks.workunit.client.0.smithi070.stdout:8/65: fsync d4/db/f13 0 2024-09-20T20:31:35.440 INFO:tasks.workunit.client.0.smithi070.stdout:8/66: dread d4/db/ff [0,4194304] 0 2024-09-20T20:31:35.440 INFO:tasks.workunit.client.0.smithi070.stdout:8/67: write d4/db/f16 [759126,54094] 0 2024-09-20T20:31:35.441 INFO:tasks.workunit.client.0.smithi070.stdout:7/8: fsync f1 0 2024-09-20T20:31:35.441 INFO:tasks.workunit.client.0.smithi070.stdout:7/9: mkdir d2 0 2024-09-20T20:31:35.442 INFO:tasks.workunit.client.0.smithi070.stdout:7/10: fdatasync f1 0 2024-09-20T20:31:35.443 INFO:tasks.workunit.client.0.smithi070.stdout:7/11: mkdir d2/d3 0 2024-09-20T20:31:35.444 INFO:tasks.workunit.client.0.smithi070.stdout:8/68: dread f0 [4194304,4194304] 0 2024-09-20T20:31:35.445 INFO:tasks.workunit.client.0.smithi070.stdout:8/69: symlink d4/d17/l19 0 2024-09-20T20:31:35.445 INFO:tasks.workunit.client.0.smithi070.stdout:8/70: unlink d4/db/le 0 2024-09-20T20:31:35.446 INFO:tasks.workunit.client.0.smithi070.stdout:8/71: chown d4/f7 284 1 2024-09-20T20:31:35.447 INFO:tasks.workunit.client.0.smithi070.stdout:8/72: stat d4/c15 0 2024-09-20T20:31:35.448 INFO:tasks.workunit.client.0.smithi070.stdout:8/73: symlink d4/db/l1a 0 2024-09-20T20:31:35.451 INFO:tasks.workunit.client.0.smithi070.stdout:7/12: dwrite f1 [4194304,4194304] 0 2024-09-20T20:31:35.454 INFO:tasks.workunit.client.0.smithi070.stdout:8/74: dread d4/db/ff [0,4194304] 0 2024-09-20T20:31:35.454 INFO:tasks.workunit.client.0.smithi070.stdout:8/75: creat d4/db/f1b x:0 0 0 2024-09-20T20:31:35.455 INFO:tasks.workunit.client.0.smithi070.stdout:8/76: creat d4/d17/f1c x:0 0 0 2024-09-20T20:31:35.457 INFO:tasks.workunit.client.0.smithi070.stdout:8/77: write d4/f12 [5793439,105976] 0 2024-09-20T20:31:35.457 INFO:tasks.workunit.client.0.smithi070.stdout:8/78: chown d4/c6 49 1 2024-09-20T20:31:35.458 INFO:tasks.workunit.client.0.smithi070.stdout:8/79: unlink d4/f9 0 2024-09-20T20:31:35.467 INFO:tasks.workunit.client.0.smithi070.stdout:8/80: getdents d4/d17 0 2024-09-20T20:31:35.468 INFO:tasks.workunit.client.0.smithi070.stdout:8/81: symlink d4/l1d 0 2024-09-20T20:31:35.469 INFO:tasks.workunit.client.0.smithi070.stdout:1/29: fdatasync f2 0 2024-09-20T20:31:35.470 INFO:tasks.workunit.client.0.smithi070.stdout:1/30: mknod d4/d6/cf 0 2024-09-20T20:31:35.471 INFO:tasks.workunit.client.0.smithi070.stdout:1/31: creat d4/dd/f10 x:0 0 0 2024-09-20T20:31:35.472 INFO:tasks.workunit.client.0.smithi070.stdout:1/32: dread - d4/d6/f7 zero size 2024-09-20T20:31:35.473 INFO:tasks.workunit.client.0.smithi070.stdout:1/33: rmdir d4 39 2024-09-20T20:31:35.475 INFO:tasks.workunit.client.0.smithi070.stdout:8/82: dwrite d4/db/f1b [0,4194304] 0 2024-09-20T20:31:35.477 INFO:tasks.workunit.client.0.smithi070.stdout:8/83: rename d4/c10 to d4/c1e 0 2024-09-20T20:31:35.478 INFO:tasks.workunit.client.0.smithi070.stdout:8/84: stat d4/db/f16 0 2024-09-20T20:31:35.478 INFO:tasks.workunit.client.0.smithi070.stdout:8/85: chown d4/db/f13 5389 1 2024-09-20T20:31:35.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/41: dread f5 [0,4194304] 0 2024-09-20T20:31:35.483 INFO:tasks.workunit.client.0.smithi070.stdout:8/86: dread d4/f12 [0,4194304] 0 2024-09-20T20:31:35.483 INFO:tasks.workunit.client.0.smithi070.stdout:8/87: stat d4/db/cd 0 2024-09-20T20:31:35.484 INFO:tasks.workunit.client.0.smithi070.stdout:3/42: creat d7/fa x:0 0 0 2024-09-20T20:31:35.484 INFO:tasks.workunit.client.0.smithi070.stdout:7/13: fdatasync f1 0 2024-09-20T20:31:35.484 INFO:tasks.workunit.client.0.smithi070.stdout:3/43: creat d7/fb x:0 0 0 2024-09-20T20:31:35.485 INFO:tasks.workunit.client.0.smithi070.stdout:8/88: mknod d4/c1f 0 2024-09-20T20:31:35.485 INFO:tasks.workunit.client.0.smithi070.stdout:7/14: creat d2/d3/f4 x:0 0 0 2024-09-20T20:31:35.485 INFO:tasks.workunit.client.0.smithi070.stdout:3/44: unlink d7/fa 0 2024-09-20T20:31:35.486 INFO:tasks.workunit.client.0.smithi070.stdout:7/15: fdatasync f1 0 2024-09-20T20:31:35.486 INFO:tasks.workunit.client.0.smithi070.stdout:2/18: dread f1 [0,4194304] 0 2024-09-20T20:31:35.486 INFO:tasks.workunit.client.0.smithi070.stdout:3/45: chown f5 13421593 1 2024-09-20T20:31:35.486 INFO:tasks.workunit.client.0.smithi070.stdout:7/16: mknod d2/d3/c5 0 2024-09-20T20:31:35.486 INFO:tasks.workunit.client.0.smithi070.stdout:7/17: readlink - no filename 2024-09-20T20:31:35.487 INFO:tasks.workunit.client.0.smithi070.stdout:2/19: truncate d3/f4 512959 0 2024-09-20T20:31:35.487 INFO:tasks.workunit.client.0.smithi070.stdout:7/18: dread - d2/d3/f4 zero size 2024-09-20T20:31:35.487 INFO:tasks.workunit.client.0.smithi070.stdout:1/34: rename d4/dd to d4/d6/d11 0 2024-09-20T20:31:35.487 INFO:tasks.workunit.client.0.smithi070.stdout:3/46: creat d7/d8/fc x:0 0 0 2024-09-20T20:31:35.487 INFO:tasks.workunit.client.0.smithi070.stdout:8/89: getdents d4/db 0 2024-09-20T20:31:35.488 INFO:tasks.workunit.client.0.smithi070.stdout:1/35: stat d4/c8 0 2024-09-20T20:31:35.488 INFO:tasks.workunit.client.0.smithi070.stdout:7/19: creat d2/d3/f6 x:0 0 0 2024-09-20T20:31:35.488 INFO:tasks.workunit.client.0.smithi070.stdout:8/90: creat d4/d17/f20 x:0 0 0 2024-09-20T20:31:35.488 INFO:tasks.workunit.client.0.smithi070.stdout:7/20: chown d2/d3/f6 22 1 2024-09-20T20:31:35.489 INFO:tasks.workunit.client.0.smithi070.stdout:1/36: rename d4/c8 to d4/d6/c12 0 2024-09-20T20:31:35.489 INFO:tasks.workunit.client.0.smithi070.stdout:8/91: creat d4/d17/f21 x:0 0 0 2024-09-20T20:31:35.489 INFO:tasks.workunit.client.0.smithi070.stdout:8/92: fsync d4/db/f11 0 2024-09-20T20:31:35.490 INFO:tasks.workunit.client.0.smithi070.stdout:8/93: write d4/db/f13 [709818,53006] 0 2024-09-20T20:31:35.491 INFO:tasks.workunit.client.0.smithi070.stdout:8/94: write d4/d17/f21 [950531,69270] 0 2024-09-20T20:31:35.492 INFO:tasks.workunit.client.0.smithi070.stdout:4/60: fsync d6/d7/f9 0 2024-09-20T20:31:35.492 INFO:tasks.workunit.client.0.smithi070.stdout:8/95: symlink d4/db/l22 0 2024-09-20T20:31:35.493 INFO:tasks.workunit.client.0.smithi070.stdout:1/37: dread f2 [0,4194304] 0 2024-09-20T20:31:35.493 INFO:tasks.workunit.client.0.smithi070.stdout:4/61: mkdir d6/d7/dc/d12 0 2024-09-20T20:31:35.493 INFO:tasks.workunit.client.0.smithi070.stdout:8/96: rename d4/db/l1a to d4/db/l23 0 2024-09-20T20:31:35.493 INFO:tasks.workunit.client.0.smithi070.stdout:4/62: stat d6 0 2024-09-20T20:31:35.493 INFO:tasks.workunit.client.0.smithi070.stdout:1/38: truncate f2 4647027 0 2024-09-20T20:31:35.493 INFO:tasks.workunit.client.0.smithi070.stdout:1/39: dread - d4/d6/d11/f10 zero size 2024-09-20T20:31:35.494 INFO:tasks.workunit.client.0.smithi070.stdout:1/40: creat d4/d6/d11/f13 x:0 0 0 2024-09-20T20:31:35.495 INFO:tasks.workunit.client.0.smithi070.stdout:1/41: creat d4/d6/f14 x:0 0 0 2024-09-20T20:31:35.499 INFO:tasks.workunit.client.0.smithi070.stdout:3/47: read f0 [136311,22584] 0 2024-09-20T20:31:35.500 INFO:tasks.workunit.client.0.smithi070.stdout:3/48: dread - d7/fb zero size 2024-09-20T20:31:35.500 INFO:tasks.workunit.client.0.smithi070.stdout:4/63: dwrite d6/d7/f9 [0,4194304] 0 2024-09-20T20:31:35.501 INFO:tasks.workunit.client.0.smithi070.stdout:2/20: truncate d3/f4 143939 0 2024-09-20T20:31:35.501 INFO:tasks.workunit.client.0.smithi070.stdout:8/97: dwrite d4/db/f16 [0,4194304] 0 2024-09-20T20:31:35.505 INFO:tasks.workunit.client.0.smithi070.stdout:1/42: dwrite d4/d6/f14 [0,4194304] 0 2024-09-20T20:31:35.505 INFO:tasks.workunit.client.0.smithi070.stdout:4/64: mknod d6/d7/dc/c13 0 2024-09-20T20:31:35.506 INFO:tasks.workunit.client.0.smithi070.stdout:2/21: creat d3/d5/f7 x:0 0 0 2024-09-20T20:31:35.506 INFO:tasks.workunit.client.0.smithi070.stdout:4/65: mkdir d6/d7/dc/d14 0 2024-09-20T20:31:35.507 INFO:tasks.workunit.client.0.smithi070.stdout:2/22: mknod d3/d5/c8 0 2024-09-20T20:31:35.508 INFO:tasks.workunit.client.0.smithi070.stdout:8/98: dread d4/db/ff [0,4194304] 0 2024-09-20T20:31:35.508 INFO:tasks.workunit.client.0.smithi070.stdout:2/23: mkdir d3/d5/d9 0 2024-09-20T20:31:35.508 INFO:tasks.workunit.client.0.smithi070.stdout:8/99: readlink d4/l5 0 2024-09-20T20:31:35.509 INFO:tasks.workunit.client.0.smithi070.stdout:2/24: read - d3/d5/f7 zero size 2024-09-20T20:31:35.510 INFO:tasks.workunit.client.0.smithi070.stdout:2/25: unlink d3/f6 0 2024-09-20T20:31:35.510 INFO:tasks.workunit.client.0.smithi070.stdout:3/49: dwrite f3 [0,4194304] 0 2024-09-20T20:31:35.513 INFO:tasks.workunit.client.0.smithi070.stdout:3/50: creat d7/fd x:0 0 0 2024-09-20T20:31:35.514 INFO:tasks.workunit.client.0.smithi070.stdout:3/51: rename d7 to d7/d8/de 22 2024-09-20T20:31:35.516 INFO:tasks.workunit.client.0.smithi070.stdout:3/52: truncate f3 4726635 0 2024-09-20T20:31:35.517 INFO:tasks.workunit.client.0.smithi070.stdout:3/53: readlink l1 0 2024-09-20T20:31:35.518 INFO:tasks.workunit.client.0.smithi070.stdout:3/54: symlink d7/lf 0 2024-09-20T20:31:35.520 INFO:tasks.workunit.client.0.smithi070.stdout:4/66: dwrite d6/d7/dc/fe [0,4194304] 0 2024-09-20T20:31:35.520 INFO:tasks.workunit.client.0.smithi070.stdout:1/43: getdents d4 0 2024-09-20T20:31:35.520 INFO:tasks.workunit.client.0.smithi070.stdout:8/100: dwrite d4/d17/f1c [0,4194304] 0 2024-09-20T20:31:35.522 INFO:tasks.workunit.client.0.smithi070.stdout:3/55: symlink d7/d8/l10 0 2024-09-20T20:31:35.522 INFO:tasks.workunit.client.0.smithi070.stdout:4/67: chown d6/d7/dc/fe 1 1 2024-09-20T20:31:35.522 INFO:tasks.workunit.client.0.smithi070.stdout:2/26: dwrite f2 [0,4194304] 0 2024-09-20T20:31:35.522 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:35.515+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:35.523 INFO:tasks.workunit.client.0.smithi070.stdout:4/68: mknod d6/d7/c15 0 2024-09-20T20:31:35.523 INFO:tasks.workunit.client.0.smithi070.stdout:3/56: write f0 [926167,14825] 0 2024-09-20T20:31:35.523 INFO:tasks.workunit.client.0.smithi070.stdout:4/69: read - d6/ff zero size 2024-09-20T20:31:35.526 INFO:tasks.workunit.client.0.smithi070.stdout:4/70: chown d6/f8 3741 1 2024-09-20T20:31:35.528 INFO:tasks.workunit.client.0.smithi070.stdout:4/71: creat d6/d7/f16 x:0 0 0 2024-09-20T20:31:35.528 INFO:tasks.workunit.client.0.smithi070.stdout:8/101: dread d4/d17/f21 [0,4194304] 0 2024-09-20T20:31:35.528 INFO:tasks.workunit.client.0.smithi070.stdout:4/72: fsync f2 0 2024-09-20T20:31:35.529 INFO:tasks.workunit.client.0.smithi070.stdout:8/102: truncate d4/db/f13 1570595 0 2024-09-20T20:31:35.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/44: dwrite d4/d6/d11/f13 [0,4194304] 0 2024-09-20T20:31:35.530 INFO:tasks.workunit.client.0.smithi070.stdout:8/103: fsync d4/d17/f20 0 2024-09-20T20:31:35.530 INFO:tasks.workunit.client.0.smithi070.stdout:4/73: mkdir d6/d7/dc/d12/d17 0 2024-09-20T20:31:35.530 INFO:tasks.workunit.client.0.smithi070.stdout:8/104: write d4/f12 [6984795,58282] 0 2024-09-20T20:31:35.531 INFO:tasks.workunit.client.0.smithi070.stdout:4/74: link f2 d6/d7/dc/d14/f18 0 2024-09-20T20:31:35.531 INFO:tasks.workunit.client.0.smithi070.stdout:8/105: symlink d4/l24 0 2024-09-20T20:31:35.532 INFO:tasks.workunit.client.0.smithi070.stdout:8/106: chown d4/db/f1b 300 1 2024-09-20T20:31:35.532 INFO:tasks.workunit.client.0.smithi070.stdout:4/75: mknod d6/d7/dc/d14/c19 0 2024-09-20T20:31:35.532 INFO:tasks.workunit.client.0.smithi070.stdout:4/76: fdatasync d6/d7/f16 0 2024-09-20T20:31:35.532 INFO:tasks.workunit.client.0.smithi070.stdout:8/107: creat d4/f25 x:0 0 0 2024-09-20T20:31:35.533 INFO:tasks.workunit.client.0.smithi070.stdout:4/77: write d6/d7/f16 [405362,10385] 0 2024-09-20T20:31:35.533 INFO:tasks.workunit.client.0.smithi070.stdout:8/108: read d4/f7 [648156,38149] 0 2024-09-20T20:31:35.533 INFO:tasks.workunit.client.0.smithi070.stdout:4/78: symlink d6/d7/l1a 0 2024-09-20T20:31:35.538 INFO:tasks.workunit.client.0.smithi070.stdout:8/109: dread d4/db/f16 [0,4194304] 0 2024-09-20T20:31:35.539 INFO:tasks.workunit.client.0.smithi070.stdout:8/110: creat d4/d17/f26 x:0 0 0 2024-09-20T20:31:35.540 INFO:tasks.workunit.client.0.smithi070.stdout:2/27: chown d3/f4 139926233 1 2024-09-20T20:31:35.540 INFO:tasks.workunit.client.0.smithi070.stdout:2/28: mkdir d3/d5/da 0 2024-09-20T20:31:35.541 INFO:tasks.workunit.client.0.smithi070.stdout:4/79: dwrite d6/d7/f16 [0,4194304] 0 2024-09-20T20:31:35.541 INFO:tasks.workunit.client.0.smithi070.stdout:2/29: write f0 [1326674,30077] 0 2024-09-20T20:31:35.542 INFO:tasks.workunit.client.0.smithi070.stdout:2/30: write f2 [962854,47245] 0 2024-09-20T20:31:35.543 INFO:tasks.workunit.client.0.smithi070.stdout:4/80: rename d6/d7/l1a to d6/d7/dc/l1b 0 2024-09-20T20:31:35.543 INFO:tasks.workunit.client.0.smithi070.stdout:4/81: stat d6/d7/dc/fe 0 2024-09-20T20:31:35.544 INFO:tasks.workunit.client.0.smithi070.stdout:4/82: creat d6/d7/dc/d12/f1c x:0 0 0 2024-09-20T20:31:35.545 INFO:tasks.workunit.client.0.smithi070.stdout:4/83: symlink d6/d7/l1d 0 2024-09-20T20:31:35.546 INFO:tasks.workunit.client.0.smithi070.stdout:8/111: dwrite f0 [4194304,4194304] 0 2024-09-20T20:31:35.546 INFO:tasks.workunit.client.0.smithi070.stdout:8/112: dread - d4/f18 zero size 2024-09-20T20:31:35.562 INFO:tasks.workunit.client.0.smithi070.stdout:4/84: write f2 [1480456,49767] 0 2024-09-20T20:31:35.562 INFO:tasks.workunit.client.0.smithi070.stdout:1/45: fdatasync d4/d6/d11/f13 0 2024-09-20T20:31:35.563 INFO:tasks.workunit.client.0.smithi070.stdout:1/46: unlink d4/d6/c12 0 2024-09-20T20:31:35.564 INFO:tasks.workunit.client.0.smithi070.stdout:1/47: unlink d4/d6/d11/ce 0 2024-09-20T20:31:35.564 INFO:tasks.workunit.client.0.smithi070.stdout:1/48: creat d4/f15 x:0 0 0 2024-09-20T20:31:35.565 INFO:tasks.workunit.client.0.smithi070.stdout:1/49: symlink d4/l16 0 2024-09-20T20:31:35.565 INFO:tasks.workunit.client.0.smithi070.stdout:1/50: chown f1 391544724 1 2024-09-20T20:31:35.566 INFO:tasks.workunit.client.0.smithi070.stdout:4/85: dread d6/f8 [0,4194304] 0 2024-09-20T20:31:35.566 INFO:tasks.workunit.client.0.smithi070.stdout:1/51: rename f1 to d4/d6/f17 0 2024-09-20T20:31:35.566 INFO:tasks.workunit.client.0.smithi070.stdout:1/52: dread - d4/fc zero size 2024-09-20T20:31:35.567 INFO:tasks.workunit.client.0.smithi070.stdout:4/86: link c3 d6/c1e 0 2024-09-20T20:31:35.567 INFO:tasks.workunit.client.0.smithi070.stdout:1/53: readlink d4/d6/la 0 2024-09-20T20:31:35.567 INFO:tasks.workunit.client.0.smithi070.stdout:4/87: dread - d6/ff zero size 2024-09-20T20:31:35.567 INFO:tasks.workunit.client.0.smithi070.stdout:4/88: read d6/d7/f16 [1650044,34023] 0 2024-09-20T20:31:35.568 INFO:tasks.workunit.client.0.smithi070.stdout:4/89: fdatasync f2 0 2024-09-20T20:31:35.569 INFO:tasks.workunit.client.0.smithi070.stdout:4/90: creat d6/d7/dc/d12/d17/f1f x:0 0 0 2024-09-20T20:31:35.570 INFO:tasks.workunit.client.0.smithi070.stdout:1/54: getdents d4/d6 0 2024-09-20T20:31:35.571 INFO:tasks.workunit.client.0.smithi070.stdout:1/55: creat d4/d6/d11/f18 x:0 0 0 2024-09-20T20:31:35.571 INFO:tasks.workunit.client.0.smithi070.stdout:1/56: mknod d4/c19 0 2024-09-20T20:31:35.572 INFO:tasks.workunit.client.0.smithi070.stdout:1/57: dread - d4/d6/d11/f18 zero size 2024-09-20T20:31:35.572 INFO:tasks.workunit.client.0.smithi070.stdout:1/58: dread - d4/d6/d11/f18 zero size 2024-09-20T20:31:35.573 INFO:tasks.workunit.client.0.smithi070.stdout:1/59: mkdir d4/d6/d1a 0 2024-09-20T20:31:35.573 INFO:tasks.workunit.client.0.smithi070.stdout:1/60: read - d4/d6/f7 zero size 2024-09-20T20:31:35.573 INFO:tasks.workunit.client.0.smithi070.stdout:1/61: truncate d4/fc 640724 0 2024-09-20T20:31:35.574 INFO:tasks.workunit.client.0.smithi070.stdout:1/62: unlink d4/fc 0 2024-09-20T20:31:35.580 INFO:tasks.workunit.client.0.smithi070.stdout:1/63: dwrite d4/f15 [0,4194304] 0 2024-09-20T20:31:35.586 INFO:tasks.workunit.client.0.smithi070.stdout:1/64: dwrite d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:35.586 INFO:tasks.workunit.client.0.smithi070.stdout:1/65: chown d4 1 1 2024-09-20T20:31:35.594 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:35.594 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:35.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:35.623 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:35.619+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:35.724 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:35.721+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:35.730 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:35.730 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:35.744 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:35.825 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:35.821+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:35.875 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:35.875 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:35.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:35.926 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:35.921+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:36.011 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:36.011 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:36.025 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:36.026 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:36.021+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:36.128 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:36.123+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:36.147 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:36.147 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:36.161 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:36.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:36.229 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:36.225+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:36.291 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:36.292 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:36.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:36.347 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:36.345+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:36.378 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:36.379 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:36.398 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:36.418 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:36.430 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:36.421+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:36.468 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:36.469 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:36.482 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:36.531 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:36.529+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.615482761, 2024-09-20T20:31:36.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:36.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:36.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:36.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.61510580700001, 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:36.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.615001765, 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:36.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:36.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:36.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:36.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:36.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:36.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:36.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:36.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:36.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:36.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:36.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.61390052599999, 2024-09-20T20:31:36.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:36.627 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.627 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:36.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:36.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:36.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:36.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:36.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:36.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:36.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:36.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:36.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:36.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:36.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:36.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:36.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:36.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:36.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:36.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:36.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.636 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.636 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.61380987, 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.613737398, 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:36.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.613675251, 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:36.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:36.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:36.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:36.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:36.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.613612502, 2024-09-20T20:31:36.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:36.655 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.656 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.656 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:36.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:36.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:36.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:36.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:36.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:36.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:36.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:36.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:36.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:36.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:36.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:36.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:36.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:36.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:36.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:36.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:36.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:36.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:36.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:36.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:36.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:36.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:36.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:36.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.666 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.613503959, 2024-09-20T20:31:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:36.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:36.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:36.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:36.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:36.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:36.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:36.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:36.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:36.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:36.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:36.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:36.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:36.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:36.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:36.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:36.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:36.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:36.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:36.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:36.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:36.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:36.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.677 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.678 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.678 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:36.678 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.613438673, 2024-09-20T20:31:36.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:36.678 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.679 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:36.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:36.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:36.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:36.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:36.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:36.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:36.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:36.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:36.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:36.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:36.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:36.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:36.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:36.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:36.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:36.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:36.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:36.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:36.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:36.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.687 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:36.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.613376774, 2024-09-20T20:31:36.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:36.689 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.689 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:36.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:36.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:36.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:36.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:36.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:36.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:36.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:36.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:36.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:36.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:36.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:36.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:36.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:36.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:36.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:36.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:36.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.698 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.699 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:36.699 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.611189004, 2024-09-20T20:31:36.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:36.699 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.699 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:36.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:36.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:36.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:36.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:36.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:36.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:36.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:36.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:36.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:36.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:36.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.707 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.707 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:36.707 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.61109100100001, 2024-09-20T20:31:36.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:36.708 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.708 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:36.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:36.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:36.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:36.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.610029673, 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.714 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:36.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.609587203, 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:36.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:36.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:36.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.726 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.726 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:36.726 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.60871026, 2024-09-20T20:31:36.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:36.727 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.727 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:36.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:36.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.608554548, 2024-09-20T20:31:36.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:36.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:36.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:36.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:36.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:36.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 101.60704124599999, 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:36.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:36.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:36.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:36.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:36.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:36.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:36.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:36.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:36.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.745 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.746 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-20T20:31:36.746 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:36.746 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.062506572, 2024-09-20T20:31:36.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029882941, 2024-09-20T20:31:36.746 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.747 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.747 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:36.747 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:36.747 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:36.747 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4 2024-09-20T20:31:36.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.747 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:36.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:36.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539835+0000", 2024-09-20T20:31:36.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-09-20T20:31:36.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547409+0000", 2024-09-20T20:31:36.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075741580000000001 2024-09-20T20:31:36.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547449+0000", 2024-09-20T20:31:36.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9165999999999997e-05 2024-09-20T20:31:36.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547467+0000", 2024-09-20T20:31:36.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-09-20T20:31:36.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547722+0000", 2024-09-20T20:31:36.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025469099999999998 2024-09-20T20:31:36.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547987+0000", 2024-09-20T20:31:36.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026537400000000002 2024-09-20T20:31:36.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:36.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.548388+0000", 2024-09-20T20:31:36.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040049399999999999 2024-09-20T20:31:36.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.566710+0000", 2024-09-20T20:31:36.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018322767 2024-09-20T20:31:36.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569495+0000", 2024-09-20T20:31:36.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027841799999999998 2024-09-20T20:31:36.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569587+0000", 2024-09-20T20:31:36.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2744000000000005e-05 2024-09-20T20:31:36.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569714+0000", 2024-09-20T20:31:36.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127021 2024-09-20T20:31:36.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:9757 4.3a 4:5e14edba:::10000002cd2.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T20:31:36.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:36.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.7664742960000002, 2024-09-20T20:31:36.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039178256000000002, 2024-09-20T20:31:36.758 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:36.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:36.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:36.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:36.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:36.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:36.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9757 2024-09-20T20:31:36.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.759 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:36.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:36.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:36.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:36.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:36.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:36.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:36.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835867+0000", 2024-09-20T20:31:36.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8899999999999999e-06 2024-09-20T20:31:36.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:36.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840142+0000", 2024-09-20T20:31:36.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042754359999999996 2024-09-20T20:31:36.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:36.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840177+0000", 2024-09-20T20:31:36.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5045000000000001e-05 2024-09-20T20:31:36.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:36.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840192+0000", 2024-09-20T20:31:36.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4922e-05 2024-09-20T20:31:36.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:36.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840396+0000", 2024-09-20T20:31:36.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-20T20:31:36.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840663+0000", 2024-09-20T20:31:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026629300000000002 2024-09-20T20:31:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840888+0000", 2024-09-20T20:31:36.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022530200000000001 2024-09-20T20:31:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.872083+0000", 2024-09-20T20:31:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031194700999999998 2024-09-20T20:31:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:36.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.874767+0000", 2024-09-20T20:31:36.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002683904 2024-09-20T20:31:36.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:36.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.874918+0000", 2024-09-20T20:31:36.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015160600000000001 2024-09-20T20:31:36.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:36.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:36.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:36.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.875042+0000", 2024-09-20T20:31:36.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012374 2024-09-20T20:31:36.767 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.767 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:36.768 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:36.768 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:36.770 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:36.771 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:36.765+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:36.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:31:36.870 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:36.865+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:36.901 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:36.901 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:36.901 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:36.901 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:36.915 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:36.971 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:36.969+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:37.072 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:37.069+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:37.087 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:37.087 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:37.087 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:37.087 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:37.087 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:37.102 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:37.172 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:37.165+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2754807719999999, 2024-09-20T20:31:37.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:37.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:37.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.236 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2754292610000002, 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:37.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:37.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:37.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.243 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2753828069999997, 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:37.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:37.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.250 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.275344606, 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:37.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2753130270000002, 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.257 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:37.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2752615330000001, 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:37.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:37.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2752271879999997, 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.270 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:37.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:37.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.275 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.276 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:37.278 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2751962900000002, 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:37.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.281 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:37.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2751472259999996, 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:37.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:37.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2751144610000003, 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.291 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:37.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:37.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.297 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2569046889999997, 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:37.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:37.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.256348461, 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:37.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:37.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:37.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.25585331, 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.311 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:37.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.317 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2551876740000001, 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:37.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:37.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2545929789999999, 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.324 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.326 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:37.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2544664550000002, 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.331 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:37.332 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:37.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2543831699999997, 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:37.337 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:37.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:37.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:37.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:37.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.343 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2534027170000002, 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:37.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:37.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:37.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:37.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:37.350 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2532917359999995, 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:37.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:37.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 5.2477047319999999, 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:37.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:37.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:37.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:37.363 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.363 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.363 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.363 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:37.363 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:37.363 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:37.365 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:37.365 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:37.361+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:37.465 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:37.461+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:37.497 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:37.498 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:37.498 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:37.498 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:37.511 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:37.566 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:37.561+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:37.632 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:37.633 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:37.633 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:37.633 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:37.633 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:37.647 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:37.695 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:37.691+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:37.768 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:37.765+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:37.773 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:37.773 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:37.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:37.773 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:37.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.773 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:373 3.2 3:4272d415:::200.0000000b:head [write 778889~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.773 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:37.773 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.815146131, 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105808761, 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:37.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953113+0000", 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5999999999999999e-06 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953122+0000", 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0729999999999994e-06 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953145+0000", 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3312999999999999e-05 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953162+0000", 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6402999999999999e-05 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054491+0000", 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10132910000000001 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054636+0000", 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014555699999999999 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054826+0000", 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019007299999999999 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058425+0000", 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035988589999999998 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058640+0000", 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021432800000000001 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058775+0000", 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013597500000000001 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058920+0000", 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014448 2024-09-20T20:31:37.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:374 3.2 3:4272d415:::200.0000000b:head [write 780291~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81432923499999998, 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.106652574, 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953930+0000", 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1900000000000002e-06 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953942+0000", 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1355999999999999e-05 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953968+0000", 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6380000000000002e-05 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953983+0000", 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4686e-05 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055691+0000", 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101707783 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055801+0000", 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110568 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055978+0000", 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000177119 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058598+0000", 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002620196 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060327+0000", 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017290210000000001 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060476+0000", 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000148527 2024-09-20T20:31:37.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060581+0000", 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010474799999999999 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:375 3.2 3:4272d415:::200.0000000b:head [write 781692~2432 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81248413500000005, 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.106557868, 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.784 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955776+0000", 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4569999999999999e-06 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955790+0000", 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4532000000000001e-05 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955845+0000", 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4401999999999999e-05 2024-09-20T20:31:37.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955887+0000", 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2648999999999998e-05 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056678+0000", 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100791148 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056801+0000", 2024-09-20T20:31:37.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012273399999999999 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056976+0000", 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017484299999999999 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062015+0000", 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050385459999999996 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062053+0000", 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8569000000000003e-05 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062221+0000", 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016815299999999999 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062331+0000", 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010983499999999999 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:376 3.2 3:4272d415:::200.0000000b:head [write 784124~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81217262199999996, 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.108173241, 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956087+0000", 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0870000000000001e-06 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956116+0000", 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9042000000000001e-05 2024-09-20T20:31:37.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956142+0000", 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6452999999999999e-05 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956155+0000", 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2306e-05 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059009+0000", 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10285475199999999 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059206+0000", 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019710300000000001 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059539+0000", 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033236600000000001 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062493+0000", 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029542629999999999 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.063998+0000", 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001504921 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064139+0000", 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000141347 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064258+0000", 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000118601 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:377 3.2 3:4272d415:::200.0000000b:head [write 785531~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81161678100000001, 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.109408697, 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.795 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956643+0000", 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1299999999999999e-06 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956654+0000", 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.115e-05 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956681+0000", 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6726000000000001e-05 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956695+0000", 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4893e-05 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060694+0000", 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103998043 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060878+0000", 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018448499999999999 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.061167+0000", 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000289194 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065734+0000", 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045670190000000003 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065780+0000", 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5658999999999998e-05 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065933+0000", 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015302 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066049+0000", 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116378 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.800 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:378 3.2 3:4272d415:::200.0000000b:head [write 786941~2442 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81151153600000003, 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.111232968, 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956747+0000", 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7999999999999993e-07 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956760+0000", 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3696000000000001e-05 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956774+0000", 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3266e-05 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956783+0000", 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8899999999999996e-06 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062642+0000", 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10585894999999999 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062863+0000", 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022100200000000001 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.063215+0000", 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035195000000000002 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066222+0000", 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003007904 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067697+0000", 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014745629999999999 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067866+0000", 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000168849 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067979+0000", 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011291800000000001 2024-09-20T20:31:37.805 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:379 3.2 3:4272d415:::200.0000000b:head [write 789383~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81123350299999997, 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11286650500000001, 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957025+0000", 2024-09-20T20:31:37.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.33e-06 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957037+0000", 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1936999999999999e-05 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957056+0000", 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8459999999999999e-05 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957066+0000", 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0266e-05 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064381+0000", 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107315483 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064643+0000", 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026130800000000003 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064877+0000", 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023413899999999999 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069614+0000", 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0047370750000000003 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069654+0000", 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0541999999999999e-05 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069786+0000", 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013186400000000001 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069890+0000", 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104101 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.811 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:380 3.2 3:4272d415:::200.0000000b:head [write 790782~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81111784799999997, 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11330689300000001, 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957141+0000", 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3400000000000001e-06 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957150+0000", 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8230000000000001e-06 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957171+0000", 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1331999999999998e-05 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957231+0000", 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9698999999999999e-05 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066361+0000", 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.109130173 2024-09-20T20:31:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066587+0000", 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022618599999999999 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066926+0000", 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033860299999999998 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069996+0000", 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003070672 2024-09-20T20:31:37.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070196+0000", 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019970599999999999 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070339+0000", 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000143067 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070446+0000", 2024-09-20T20:31:37.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107292 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:381 3.2 3:4272d415:::200.0000000b:head [write 792697~6542 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.81097842799999997, 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117989833, 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957286+0000", 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0829999999999998e-06 2024-09-20T20:31:37.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957305+0000", 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9216e-05 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957321+0000", 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5787e-05 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957331+0000", 2024-09-20T20:31:37.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068072+0000", 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11074125899999999 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068198+0000", 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126007 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068391+0000", 2024-09-20T20:31:37.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019251899999999999 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070149+0000", 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017585910000000001 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.074999+0000", 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048502629999999996 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075145+0000", 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014563 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075269+0000", 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123628 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:382 3.2 3:4272d415:::200.0000000b:head [write 799239~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:37.822 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.80986502199999999, 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117478417, 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958395+0000", 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1030000000000002e-06 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958409+0000", 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4059999999999999e-05 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958442+0000", 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2085999999999997e-05 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958466+0000", 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070538+0000", 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11207286399999999 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070770+0000", 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023195799999999999 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.071118+0000", 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034751299999999998 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075415+0000", 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042975080000000002 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075621+0000", 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000205622 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075757+0000", 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608399999999999 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075871+0000", 2024-09-20T20:31:37.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113577 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:383 3.2 3:4272d415:::200.0000000b:head [write 800641~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.809688823, 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11757527299999999, 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958575+0000", 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6540000000000002e-06 2024-09-20T20:31:37.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958586+0000", 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1293e-05 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958612+0000", 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5792e-05 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958634+0000", 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1287000000000001e-05 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072108+0000", 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.113474767 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072345+0000", 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000237178 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072615+0000", 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026950800000000001 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075583+0000", 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002967679 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075895+0000", 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031276699999999998 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076020+0000", 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012504700000000001 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076144+0000", 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123301 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:384 3.2 3:4272d415:::200.0000000b:head [write 802559~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.80959713099999997, 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.119348309, 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958662+0000", 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3859999999999999e-06 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958678+0000", 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6779999999999999e-05 2024-09-20T20:31:37.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958705+0000", 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6403000000000001e-05 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958732+0000", 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6818999999999999e-05 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073242+0000", 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.114510876 2024-09-20T20:31:37.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073474+0000", 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023108499999999999 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073807+0000", 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033322700000000001 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076255+0000", 2024-09-20T20:31:37.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024479860000000001 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.077749+0000", 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014944820000000001 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.077892+0000", 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014243700000000001 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078009+0000", 2024-09-20T20:31:37.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116828 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:385 3.2 3:4272d415:::200.0000000b:head [write 804479~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.80912204799999998, 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121337555, 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959137+0000", 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0499999999999999e-06 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959165+0000", 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7256000000000001e-05 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959238+0000", 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2974999999999998e-05 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959259+0000", 2024-09-20T20:31:37.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1005999999999998e-05 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076373+0000", 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117114513 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076598+0000", 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022489100000000001 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076941+0000", 2024-09-20T20:31:37.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034298999999999999 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080222+0000", 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032812589999999999 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080337+0000", 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115148 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080411+0000", 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3891000000000001e-05 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080473+0000", 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1575999999999995e-05 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:386 3.2 3:4272d415:::200.0000000b:head [write 806408~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.80894713200000001, 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12330429499999999, 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959312+0000", 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1129999999999999e-06 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959322+0000", 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5570000000000001e-06 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959386+0000", 2024-09-20T20:31:37.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3805000000000003e-05 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959407+0000", 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1583e-05 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078149+0000", 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11874132900000001 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078289+0000", 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014025999999999999 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078474+0000", 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018509599999999999 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080317+0000", 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001842752 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082471+0000", 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021539160000000001 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082550+0000", 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9515e-05 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082615+0000", 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4369000000000007e-05 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:387 3.2 3:4272d415:::200.0000000b:head [write 807809~2445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.80882590499999996, 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12458949499999999, 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:37.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959433+0000", 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-06 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959496+0000", 2024-09-20T20:31:37.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2744999999999996e-05 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959525+0000", 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9346e-05 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959541+0000", 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6143000000000001e-05 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079333+0000", 2024-09-20T20:31:37.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.119791804 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079451+0000", 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117821 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079630+0000", 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017930999999999999 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082759+0000", 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031291050000000001 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083884+0000", 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011246699999999999 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083957+0000", 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3192e-05 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084021+0000", 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3995e-05 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:388 3.2 3:4272d415:::200.0000000b:head [write 810254~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.80869217400000004, 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12698309799999999, 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.855 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959566+0000", 2024-09-20T20:31:37.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.316e-06 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959584+0000", 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7183000000000001e-05 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959603+0000", 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9474e-05 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959618+0000", 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4491999999999999e-05 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080537+0000", 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120919765 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080655+0000", 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011762 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080836+0000", 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018099699999999999 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083744+0000", 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029083220000000001 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086406+0000", 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026616650000000001 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086484+0000", 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7511999999999999e-05 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086548+0000", 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4752000000000006e-05 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:389 3.2 3:4272d415:::200.0000000b:head [write 811657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.860 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.80859711000000001, 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12703187799999999, 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959661+0000", 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7000000000000004e-07 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959678+0000", 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7357e-05 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959691+0000", 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2176e-05 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959699+0000", 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4030000000000007e-06 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081607+0000", 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121908401 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081736+0000", 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857999999999999 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081922+0000", 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018580300000000001 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083854+0000", 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019327669999999999 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086573+0000", 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027184370000000002 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086642+0000", 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8841e-05 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086692+0000", 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0343000000000002e-05 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.865 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:390 3.2 3:4272d415:::200.0000000b:head [write 813056~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.808546231, 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12969470299999999, 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959712+0000", 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4e-07 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959716+0000", 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2570000000000001e-06 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959733+0000", 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959744+0000", 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.049e-05 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082847+0000", 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123103439 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082956+0000", 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010941400000000001 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083149+0000", 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000192843 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086278+0000", 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031285480000000001 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089265+0000", 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029868920000000001 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089341+0000", 2024-09-20T20:31:37.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6075000000000006e-05 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089406+0000", 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5001999999999999e-05 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 814477~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.80850396199999996, 2024-09-20T20:31:37.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12979708400000001, 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959754+0000", 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4000000000000001e-07 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959766+0000", 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2403e-05 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959782+0000", 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5224e-05 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959791+0000", 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2760000000000006e-06 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084105+0000", 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.124313734 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084235+0000", 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129877 2024-09-20T20:31:37.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084418+0000", 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018307999999999999 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086381+0000", 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019628890000000002 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089429+0000", 2024-09-20T20:31:37.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030487800000000001 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089499+0000", 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9791999999999999e-05 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089550+0000", 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1388999999999999e-05 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 816399~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.79976263400000003, 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12436905700000001, 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968497+0000", 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1859999999999999e-06 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968511+0000", 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3740000000000001e-05 2024-09-20T20:31:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968540+0000", 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9039000000000001e-05 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968566+0000", 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6703000000000002e-05 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085239+0000", 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.116672501 2024-09-20T20:31:37.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085380+0000", 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014088999999999999 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085619+0000", 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023910899999999999 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089129+0000", 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003510567 2024-09-20T20:31:37.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092708+0000", 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003578566 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092798+0000", 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0241000000000006e-05 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092864+0000", 2024-09-20T20:31:37.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5514999999999999e-05 2024-09-20T20:31:37.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:37.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:37.882 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:37.884 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:31:37.884 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:37.879+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:37.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:37.984 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:37.979+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:38.018 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:38.018 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:38.034 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:38.085 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:38.081+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:38.153 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:38.154 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:38.154 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:38.154 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:38.154 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:38.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:38.215 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:38.213+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:38.287 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:38.285+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:38.294 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.304986185, 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.295 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:38.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:38.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.304609231, 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:38.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:38.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:38.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:38.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:38.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.304505189, 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:38.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:38.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.30340395, 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:38.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:38.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:38.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.30331329400001, 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031677509999999999, 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988528+0000", 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988530+0000", 2024-09-20T20:31:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:38.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988540+0000", 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0206e-05 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988561+0000", 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0696999999999999e-05 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988576+0000", 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5896000000000002e-05 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992674+0000", 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040977119999999999 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993834+0000", 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001159438 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994193+0000", 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000359403 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002450+0000", 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082567669999999999 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019904+0000", 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017454032000000001 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020116+0000", 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211981 2024-09-20T20:31:38.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020206+0000", 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9827999999999994e-05 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.30324082200001, 2024-09-20T20:31:38.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031098402000000001, 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988601+0000", 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988602+0000", 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.35e-06 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988609+0000", 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5969999999999997e-06 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988629+0000", 2024-09-20T20:31:38.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.997e-05 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988643+0000", 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4693e-05 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994438+0000", 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057947349999999996 2024-09-20T20:31:38.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994710+0000", 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000271725 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995005+0000", 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294961 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002465+0000", 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074604989999999998 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019513+0000", 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017047910999999999 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019606+0000", 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3241999999999999e-05 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019699+0000", 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2719000000000005e-05 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.303178675, 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:38.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:38.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.303115926, 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:38.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:38.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:38.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.30300738299999, 2024-09-20T20:31:38.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:38.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.302942097, 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:38.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:38.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.354 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.302880198, 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032697907999999998, 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988961+0000", 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988962+0000", 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.26e-06 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988969+0000", 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7469999999999999e-06 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988990+0000", 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1216000000000002e-05 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.989006+0000", 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5722999999999998e-05 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994869+0000", 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005862702 2024-09-20T20:31:38.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994986+0000", 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116692 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995147+0000", 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016186299999999999 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002477+0000", 2024-09-20T20:31:38.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073296790000000004 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021377+0000", 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018899678 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021525+0000", 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148195 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021659+0000", 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134153 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.300692428, 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030350328999999999, 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991149+0000", 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991151+0000", 2024-09-20T20:31:38.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991163+0000", 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449999999999999e-05 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991193+0000", 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9706e-05 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991215+0000", 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1827e-05 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995604+0000", 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043888460000000001 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995817+0000", 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000213382 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997635+0000", 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001817733 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007122+0000", 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094873360000000007 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021228+0000", 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014105444 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021378+0000", 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015065200000000001 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021499+0000", 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012095300000000001 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.300594425, 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026122500999999999, 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991247+0000", 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991248+0000", 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4699999999999999e-06 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991279+0000", 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0916e-05 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991304+0000", 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-05 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.991322+0000", 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7198999999999999e-05 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996771+0000", 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054497019999999998 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997047+0000", 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027542099999999998 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.997807+0000", 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076061499999999997 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006686+0000", 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088791809999999999 2024-09-20T20:31:38.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017122+0000", 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010436015999999999 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017269+0000", 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014671899999999999 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.017369+0000", 2024-09-20T20:31:38.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010029199999999999 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.29953309699999, 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029752587, 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992308+0000", 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992310+0000", 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0200000000000001e-06 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992322+0000", 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1202999999999999e-05 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992349+0000", 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7212999999999998e-05 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992373+0000", 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4130000000000001e-05 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995650+0000", 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032769320000000002 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999017+0000", 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003367114 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.999362+0000", 2024-09-20T20:31:38.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034523699999999997 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006728+0000", 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073662459999999999 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021826+0000", 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015097523999999999 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021934+0000", 2024-09-20T20:31:38.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108402 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022061+0000", 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012656599999999999 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.299090627, 2024-09-20T20:31:38.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026751527000000001, 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992751+0000", 2024-09-20T20:31:38.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992753+0000", 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.992765+0000", 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2649999999999999e-05 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993550+0000", 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078446799999999997 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993577+0000", 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6976000000000001e-05 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993727+0000", 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150142 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994069+0000", 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034166399999999999 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.994393+0000", 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032415100000000001 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005627+0000", 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011233767 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019266+0000", 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013639401000000001 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019419+0000", 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000153502 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019502+0000", 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.284e-05 2024-09-20T20:31:38.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.298213684, 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029367027, 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993628+0000", 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993630+0000", 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1660000000000001e-06 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993651+0000", 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993676+0000", 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4706999999999999e-05 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993692+0000", 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6235999999999998e-05 2024-09-20T20:31:38.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000258+0000", 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065652699999999998 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000531+0000", 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027332399999999997 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.000851+0000", 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032026500000000002 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007870+0000", 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007018448 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022804+0000", 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014934121999999999 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022905+0000", 2024-09-20T20:31:38.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010095899999999999 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022995+0000", 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0043000000000005e-05 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.298057972, 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029174735, 2024-09-20T20:31:38.387 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993783+0000", 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993785+0000", 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993812+0000", 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7563e-05 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993833+0000", 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.02e-05 2024-09-20T20:31:38.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.993850+0000", 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7166000000000001e-05 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995395+0000", 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015457019999999999 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995648+0000", 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025241800000000002 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.996434+0000", 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078593399999999996 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003900+0000", 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074665520000000004 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022730+0000", 2024-09-20T20:31:38.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018829987999999999 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022862+0000", 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013127599999999999 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.022958+0000", 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6528999999999997e-05 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.29654467, 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028705542000000001, 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995297+0000", 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995299+0000", 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.88e-06 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995308+0000", 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1770000000000004e-06 2024-09-20T20:31:38.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995338+0000", 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0528999999999999e-05 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.995359+0000", 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0316999999999999e-05 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004437+0000", 2024-09-20T20:31:38.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090784960000000001 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004750+0000", 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031282499999999997 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024002+0000", 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019252318000000001 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.752009995999998, 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029882941, 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539831+0000", 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.539835+0000", 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-09-20T20:31:38.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547409+0000", 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075741580000000001 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547449+0000", 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9165999999999997e-05 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547467+0000", 2024-09-20T20:31:38.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547722+0000", 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025469099999999998 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.547987+0000", 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026537400000000002 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.548388+0000", 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040049399999999999 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.566710+0000", 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018322767 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569495+0000", 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027841799999999998 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569587+0000", 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2744000000000005e-05 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:20.569714+0000", 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127021 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:9757 4.3a 4:5e14edba:::10000002cd2.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:38.402 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4559777199999999, 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039178256000000002, 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9757 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:38.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835867+0000", 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8899999999999999e-06 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840142+0000", 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042754359999999996 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840177+0000", 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5045000000000001e-05 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840192+0000", 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4922e-05 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840396+0000", 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840663+0000", 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026629300000000002 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840888+0000", 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022530200000000001 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.872083+0000", 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031194700999999998 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.874767+0000", 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002683904 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.874918+0000", 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015160600000000001 2024-09-20T20:31:38.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.875042+0000", 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012374 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:38.408 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:38.410 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:3/57: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:1/66: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:6/21: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:0/29: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:7/21: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:8/113: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:2/31: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:4/91: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:9/2: sync 2024-09-20T20:31:38.411 INFO:tasks.workunit.client.0.smithi070.stdout:5/17: sync 2024-09-20T20:31:38.412 INFO:tasks.workunit.client.0.smithi070.stdout:6/22: fdatasync d4/f7 0 2024-09-20T20:31:38.412 INFO:tasks.workunit.client.0.smithi070.stdout:5/18: chown d2 398 1 2024-09-20T20:31:38.412 INFO:tasks.workunit.client.0.smithi070.stdout:0/30: write f1 [270078,87724] 0 2024-09-20T20:31:38.412 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:38.403+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:38.413 INFO:tasks.workunit.client.0.smithi070.stdout:8/114: fdatasync d4/f7 0 2024-09-20T20:31:38.413 INFO:tasks.workunit.client.0.smithi070.stdout:7/22: mknod d2/c7 0 2024-09-20T20:31:38.413 INFO:tasks.workunit.client.0.smithi070.stdout:4/92: mkdir d6/d7/dc/d20 0 2024-09-20T20:31:38.413 INFO:tasks.workunit.client.0.smithi070.stdout:3/58: creat d7/d8/f11 x:0 0 0 2024-09-20T20:31:38.413 INFO:tasks.workunit.client.0.smithi070.stdout:1/67: symlink d4/l1b 0 2024-09-20T20:31:38.413 INFO:tasks.workunit.client.0.smithi070.stdout:0/31: mkdir d4/d8 0 2024-09-20T20:31:38.414 INFO:tasks.workunit.client.0.smithi070.stdout:7/23: write f1 [3325943,102712] 0 2024-09-20T20:31:38.414 INFO:tasks.workunit.client.0.smithi070.stdout:4/93: write f4 [6067559,24526] 0 2024-09-20T20:31:38.415 INFO:tasks.workunit.client.0.smithi070.stdout:0/32: chown d4/f7 0 1 2024-09-20T20:31:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:8/115: mkdir d4/d27 0 2024-09-20T20:31:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:7/24: dread - d2/d3/f4 zero size 2024-09-20T20:31:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:2/32: dread f1 [0,4194304] 0 2024-09-20T20:31:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:2/33: readlink - no filename 2024-09-20T20:31:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:9/3: getdents . 0 2024-09-20T20:31:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:0/33: chown c3 13 1 2024-09-20T20:31:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:4/94: read - d6/d7/dc/d12/f1c zero size 2024-09-20T20:31:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:1/68: rmdir d4/d6/d1a 0 2024-09-20T20:31:38.417 INFO:tasks.workunit.client.0.smithi070.stdout:6/23: dread f0 [0,4194304] 0 2024-09-20T20:31:38.417 INFO:tasks.workunit.client.0.smithi070.stdout:2/34: fdatasync d3/f4 0 2024-09-20T20:31:38.417 INFO:tasks.workunit.client.0.smithi070.stdout:0/34: readlink d4/l6 0 2024-09-20T20:31:38.417 INFO:tasks.workunit.client.0.smithi070.stdout:6/24: write f0 [1169473,89881] 0 2024-09-20T20:31:38.417 INFO:tasks.workunit.client.0.smithi070.stdout:1/69: symlink d4/d6/l1c 0 2024-09-20T20:31:38.418 INFO:tasks.workunit.client.0.smithi070.stdout:3/59: dread d7/f9 [0,4194304] 0 2024-09-20T20:31:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:1/70: write d4/d6/f14 [2336101,40667] 0 2024-09-20T20:31:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:9/4: chown f0 569 1 2024-09-20T20:31:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:2/35: mkdir d3/d5/db 0 2024-09-20T20:31:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:9/5: mkdir d1 0 2024-09-20T20:31:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:6/25: mkdir d4/d8 0 2024-09-20T20:31:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:2/36: chown d3 180930866 1 2024-09-20T20:31:38.424 INFO:tasks.workunit.client.0.smithi070.stdout:7/25: dread f1 [4194304,4194304] 0 2024-09-20T20:31:38.424 INFO:tasks.workunit.client.0.smithi070.stdout:2/37: stat f1 0 2024-09-20T20:31:38.425 INFO:tasks.workunit.client.0.smithi070.stdout:9/6: creat d1/f2 x:0 0 0 2024-09-20T20:31:38.426 INFO:tasks.workunit.client.0.smithi070.stdout:6/26: creat d4/f9 x:0 0 0 2024-09-20T20:31:38.426 INFO:tasks.workunit.client.0.smithi070.stdout:2/38: symlink d3/lc 0 2024-09-20T20:31:38.427 INFO:tasks.workunit.client.0.smithi070.stdout:6/27: chown d4 27802 1 2024-09-20T20:31:38.428 INFO:tasks.workunit.client.0.smithi070.stdout:9/7: dread - d1/f2 zero size 2024-09-20T20:31:38.428 INFO:tasks.workunit.client.0.smithi070.stdout:7/26: read - d2/d3/f6 zero size 2024-09-20T20:31:38.428 INFO:tasks.workunit.client.0.smithi070.stdout:6/28: stat f1 0 2024-09-20T20:31:38.429 INFO:tasks.workunit.client.0.smithi070.stdout:9/8: stat d1 0 2024-09-20T20:31:38.432 INFO:tasks.workunit.client.0.smithi070.stdout:8/116: dwrite d4/db/f1b [0,4194304] 0 2024-09-20T20:31:38.434 INFO:tasks.workunit.client.0.smithi070.stdout:6/29: creat d4/d8/fa x:0 0 0 2024-09-20T20:31:38.434 INFO:tasks.workunit.client.0.smithi070.stdout:0/35: dwrite d4/f5 [4194304,4194304] 0 2024-09-20T20:31:38.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:38.435 INFO:tasks.workunit.client.0.smithi070.stdout:4/95: dwrite d6/f8 [4194304,4194304] 0 2024-09-20T20:31:38.437 INFO:tasks.workunit.client.0.smithi070.stdout:3/60: dwrite f2 [0,4194304] 0 2024-09-20T20:31:38.437 INFO:tasks.workunit.client.0.smithi070.stdout:0/36: creat d4/f9 x:0 0 0 2024-09-20T20:31:38.438 INFO:tasks.workunit.client.0.smithi070.stdout:0/37: readlink d4/l6 0 2024-09-20T20:31:38.439 INFO:tasks.workunit.client.0.smithi070.stdout:6/30: creat d4/d8/fb x:0 0 0 2024-09-20T20:31:38.440 INFO:tasks.workunit.client.0.smithi070.stdout:6/31: chown f0 13666 1 2024-09-20T20:31:38.441 INFO:tasks.workunit.client.0.smithi070.stdout:2/39: dread f2 [0,4194304] 0 2024-09-20T20:31:38.444 INFO:tasks.workunit.client.0.smithi070.stdout:7/27: dread f1 [4194304,4194304] 0 2024-09-20T20:31:38.444 INFO:tasks.workunit.client.0.smithi070.stdout:2/40: stat d3/d5 0 2024-09-20T20:31:38.449 INFO:tasks.workunit.client.0.smithi070.stdout:4/96: dwrite d6/ff [0,4194304] 0 2024-09-20T20:31:38.454 INFO:tasks.workunit.client.0.smithi070.stdout:0/38: dwrite f2 [0,4194304] 0 2024-09-20T20:31:38.455 INFO:tasks.workunit.client.0.smithi070.stdout:9/9: dwrite f0 [0,4194304] 0 2024-09-20T20:31:38.455 INFO:tasks.workunit.client.0.smithi070.stdout:8/117: creat d4/f28 x:0 0 0 2024-09-20T20:31:38.456 INFO:tasks.workunit.client.0.smithi070.stdout:0/39: chown c3 11 1 2024-09-20T20:31:38.462 INFO:tasks.workunit.client.0.smithi070.stdout:6/32: dwrite f1 [0,4194304] 0 2024-09-20T20:31:38.464 INFO:tasks.workunit.client.0.smithi070.stdout:7/28: fdatasync f1 0 2024-09-20T20:31:38.464 INFO:tasks.workunit.client.0.smithi070.stdout:2/41: rmdir d3/d5 39 2024-09-20T20:31:38.469 INFO:tasks.workunit.client.0.smithi070.stdout:1/71: truncate d4/d6/f14 3584374 0 2024-09-20T20:31:38.469 INFO:tasks.workunit.client.0.smithi070.stdout:4/97: creat d6/d7/dc/d14/f21 x:0 0 0 2024-09-20T20:31:38.469 INFO:tasks.workunit.client.0.smithi070.stdout:3/61: truncate f2 228877 0 2024-09-20T20:31:38.469 INFO:tasks.workunit.client.0.smithi070.stdout:9/10: symlink d1/l3 0 2024-09-20T20:31:38.470 INFO:tasks.workunit.client.0.smithi070.stdout:4/98: chown d6/d7/dc/d20 50976 1 2024-09-20T20:31:38.470 INFO:tasks.workunit.client.0.smithi070.stdout:6/33: creat d4/d8/fc x:0 0 0 2024-09-20T20:31:38.470 INFO:tasks.workunit.client.0.smithi070.stdout:6/34: readlink - no filename 2024-09-20T20:31:38.470 INFO:tasks.workunit.client.0.smithi070.stdout:7/29: rename d2/d3 to d2/d8 0 2024-09-20T20:31:38.470 INFO:tasks.workunit.client.0.smithi070.stdout:8/118: mknod d4/c29 0 2024-09-20T20:31:38.470 INFO:tasks.workunit.client.0.smithi070.stdout:0/40: creat d4/d8/fa x:0 0 0 2024-09-20T20:31:38.470 INFO:tasks.workunit.client.0.smithi070.stdout:1/72: symlink d4/d6/l1d 0 2024-09-20T20:31:38.471 INFO:tasks.workunit.client.0.smithi070.stdout:9/11: write d1/f2 [1024740,56517] 0 2024-09-20T20:31:38.471 INFO:tasks.workunit.client.0.smithi070.stdout:6/35: mknod d4/cd 0 2024-09-20T20:31:38.471 INFO:tasks.workunit.client.0.smithi070.stdout:8/119: write d4/f28 [590363,72749] 0 2024-09-20T20:31:38.471 INFO:tasks.workunit.client.0.smithi070.stdout:1/73: truncate d4/f15 4645161 0 2024-09-20T20:31:38.472 INFO:tasks.workunit.client.0.smithi070.stdout:3/62: link f4 d7/f12 0 2024-09-20T20:31:38.472 INFO:tasks.workunit.client.0.smithi070.stdout:7/30: creat d2/f9 x:0 0 0 2024-09-20T20:31:38.473 INFO:tasks.workunit.client.0.smithi070.stdout:7/31: fsync d2/d8/f6 0 2024-09-20T20:31:38.479 INFO:tasks.workunit.client.0.smithi070.stdout:1/74: write d4/d6/f17 [2930184,55081] 0 2024-09-20T20:31:38.480 INFO:tasks.workunit.client.0.smithi070.stdout:8/120: dread d4/db/ff [0,4194304] 0 2024-09-20T20:31:38.481 INFO:tasks.workunit.client.0.smithi070.stdout:2/42: dwrite f1 [0,4194304] 0 2024-09-20T20:31:38.484 INFO:tasks.workunit.client.0.smithi070.stdout:7/32: dread f1 [4194304,4194304] 0 2024-09-20T20:31:38.485 INFO:tasks.workunit.client.0.smithi070.stdout:6/36: dwrite d4/d8/fa [0,4194304] 0 2024-09-20T20:31:38.487 INFO:tasks.workunit.client.0.smithi070.stdout:0/41: getdents d4/d8 0 2024-09-20T20:31:38.488 INFO:tasks.workunit.client.0.smithi070.stdout:7/33: rmdir d2 39 2024-09-20T20:31:38.489 INFO:tasks.workunit.client.0.smithi070.stdout:9/12: dwrite f0 [4194304,4194304] 0 2024-09-20T20:31:38.489 INFO:tasks.workunit.client.0.smithi070.stdout:4/99: dwrite d6/d7/dc/d12/d17/f1f [0,4194304] 0 2024-09-20T20:31:38.489 INFO:tasks.workunit.client.0.smithi070.stdout:2/43: rename d3/d5/db to d3/d5/dd 0 2024-09-20T20:31:38.490 INFO:tasks.workunit.client.0.smithi070.stdout:7/34: read f1 [815419,109585] 0 2024-09-20T20:31:38.490 INFO:tasks.workunit.client.0.smithi070.stdout:6/37: rename f1 to d4/fe 0 2024-09-20T20:31:38.491 INFO:tasks.workunit.client.0.smithi070.stdout:1/75: link d4/d6/l1d d4/l1e 0 2024-09-20T20:31:38.492 INFO:tasks.workunit.client.0.smithi070.stdout:3/63: dwrite f5 [0,4194304] 0 2024-09-20T20:31:38.493 INFO:tasks.workunit.client.0.smithi070.stdout:6/38: creat d4/d8/ff x:0 0 0 2024-09-20T20:31:38.493 INFO:tasks.workunit.client.0.smithi070.stdout:2/44: mkdir d3/de 0 2024-09-20T20:31:38.493 INFO:tasks.workunit.client.0.smithi070.stdout:4/100: mknod d6/d7/dc/d20/c22 0 2024-09-20T20:31:38.493 INFO:tasks.workunit.client.0.smithi070.stdout:3/64: write d7/d8/fc [465124,84020] 0 2024-09-20T20:31:38.494 INFO:tasks.workunit.client.0.smithi070.stdout:7/35: creat d2/fa x:0 0 0 2024-09-20T20:31:38.494 INFO:tasks.workunit.client.0.smithi070.stdout:6/39: mkdir d4/d8/d10 0 2024-09-20T20:31:38.494 INFO:tasks.workunit.client.0.smithi070.stdout:7/36: write f1 [3097209,65262] 0 2024-09-20T20:31:38.495 INFO:tasks.workunit.client.0.smithi070.stdout:7/37: creat d2/fb x:0 0 0 2024-09-20T20:31:38.497 INFO:tasks.workunit.client.0.smithi070.stdout:1/76: dread d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:38.499 INFO:tasks.workunit.client.0.smithi070.stdout:1/77: fdatasync d4/f15 0 2024-09-20T20:31:38.500 INFO:tasks.workunit.client.0.smithi070.stdout:1/78: mkdir d4/d1f 0 2024-09-20T20:31:38.503 INFO:tasks.workunit.client.0.smithi070.stdout:3/65: dwrite f3 [0,4194304] 0 2024-09-20T20:31:38.503 INFO:tasks.workunit.client.0.smithi070.stdout:8/121: truncate d4/d17/f1c 2500300 0 2024-09-20T20:31:38.504 INFO:tasks.workunit.client.0.smithi070.stdout:6/40: getdents d4 0 2024-09-20T20:31:38.510 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:38.505+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:38.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/79: dwrite d4/d6/d11/f10 [0,4194304] 0 2024-09-20T20:31:38.511 INFO:tasks.workunit.client.0.smithi070.stdout:1/80: read - d4/d6/f7 zero size 2024-09-20T20:31:38.516 INFO:tasks.workunit.client.0.smithi070.stdout:6/41: dwrite d4/f9 [0,4194304] 0 2024-09-20T20:31:38.517 INFO:tasks.workunit.client.0.smithi070.stdout:6/42: stat c2 0 2024-09-20T20:31:38.517 INFO:tasks.workunit.client.0.smithi070.stdout:6/43: link f0 d4/f11 0 2024-09-20T20:31:38.519 INFO:tasks.workunit.client.0.smithi070.stdout:4/101: truncate d6/d7/f9 1596527 0 2024-09-20T20:31:38.519 INFO:tasks.workunit.client.0.smithi070.stdout:7/38: truncate f1 1734484 0 2024-09-20T20:31:38.520 INFO:tasks.workunit.client.0.smithi070.stdout:6/44: mknod d4/d8/d10/c12 0 2024-09-20T20:31:38.520 INFO:tasks.workunit.client.0.smithi070.stdout:7/39: symlink d2/lc 0 2024-09-20T20:31:38.520 INFO:tasks.workunit.client.0.smithi070.stdout:4/102: chown d6/c10 3668430 1 2024-09-20T20:31:38.521 INFO:tasks.workunit.client.0.smithi070.stdout:6/45: write d4/d8/ff [603306,84773] 0 2024-09-20T20:31:38.521 INFO:tasks.workunit.client.0.smithi070.stdout:7/40: fdatasync d2/d8/f4 0 2024-09-20T20:31:38.521 INFO:tasks.workunit.client.0.smithi070.stdout:4/103: chown d6/d7/dc/d14 11239 1 2024-09-20T20:31:38.522 INFO:tasks.workunit.client.0.smithi070.stdout:8/122: rename d4/d17 to d4/d27/d2a 0 2024-09-20T20:31:38.523 INFO:tasks.workunit.client.0.smithi070.stdout:4/104: dread - d6/f11 zero size 2024-09-20T20:31:38.523 INFO:tasks.workunit.client.0.smithi070.stdout:7/41: dread - d2/d8/f6 zero size 2024-09-20T20:31:38.524 INFO:tasks.workunit.client.0.smithi070.stdout:1/81: dwrite d4/d6/d11/f10 [0,4194304] 0 2024-09-20T20:31:38.524 INFO:tasks.workunit.client.0.smithi070.stdout:6/46: truncate d4/d8/fb 115234 0 2024-09-20T20:31:38.524 INFO:tasks.workunit.client.0.smithi070.stdout:7/42: write d2/fb [382161,58816] 0 2024-09-20T20:31:38.526 INFO:tasks.workunit.client.0.smithi070.stdout:4/105: unlink d6/d7/dc/d12/f1c 0 2024-09-20T20:31:38.526 INFO:tasks.workunit.client.0.smithi070.stdout:1/82: symlink d4/d6/l20 0 2024-09-20T20:31:38.526 INFO:tasks.workunit.client.0.smithi070.stdout:7/43: mknod d2/cd 0 2024-09-20T20:31:38.527 INFO:tasks.workunit.client.0.smithi070.stdout:7/44: mknod d2/ce 0 2024-09-20T20:31:38.527 INFO:tasks.workunit.client.0.smithi070.stdout:1/83: readlink d4/d6/l1c 0 2024-09-20T20:31:38.528 INFO:tasks.workunit.client.0.smithi070.stdout:4/106: mkdir d6/d7/dc/d23 0 2024-09-20T20:31:38.528 INFO:tasks.workunit.client.0.smithi070.stdout:7/45: dread - d2/fa zero size 2024-09-20T20:31:38.528 INFO:tasks.workunit.client.0.smithi070.stdout:3/66: dwrite f4 [0,4194304] 0 2024-09-20T20:31:38.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/84: read - d4/d6/f7 zero size 2024-09-20T20:31:38.531 INFO:tasks.workunit.client.0.smithi070.stdout:4/107: creat d6/d7/dc/d20/f24 x:0 0 0 2024-09-20T20:31:38.531 INFO:tasks.workunit.client.0.smithi070.stdout:3/67: unlink d7/d8/l10 0 2024-09-20T20:31:38.531 INFO:tasks.workunit.client.0.smithi070.stdout:1/85: creat d4/d6/f21 x:0 0 0 2024-09-20T20:31:38.532 INFO:tasks.workunit.client.0.smithi070.stdout:3/68: readlink d7/lf 0 2024-09-20T20:31:38.532 INFO:tasks.workunit.client.0.smithi070.stdout:8/123: dwrite d4/db/ff [0,4194304] 0 2024-09-20T20:31:38.532 INFO:tasks.workunit.client.0.smithi070.stdout:1/86: symlink d4/l22 0 2024-09-20T20:31:38.533 INFO:tasks.workunit.client.0.smithi070.stdout:3/69: mkdir d7/d8/d13 0 2024-09-20T20:31:38.533 INFO:tasks.workunit.client.0.smithi070.stdout:8/124: creat d4/d27/d2a/f2b x:0 0 0 2024-09-20T20:31:38.535 INFO:tasks.workunit.client.0.smithi070.stdout:3/70: link f0 d7/f14 0 2024-09-20T20:31:38.535 INFO:tasks.workunit.client.0.smithi070.stdout:1/87: rename d4/l1e to d4/l23 0 2024-09-20T20:31:38.535 INFO:tasks.workunit.client.0.smithi070.stdout:8/125: rename d4/c6 to d4/db/c2c 0 2024-09-20T20:31:38.535 INFO:tasks.workunit.client.0.smithi070.stdout:3/71: chown d7/d8 689849471 1 2024-09-20T20:31:38.536 INFO:tasks.workunit.client.0.smithi070.stdout:3/72: mkdir d7/d15 0 2024-09-20T20:31:38.536 INFO:tasks.workunit.client.0.smithi070.stdout:1/88: creat d4/d6/d11/f24 x:0 0 0 2024-09-20T20:31:38.536 INFO:tasks.workunit.client.0.smithi070.stdout:8/126: mkdir d4/d2d 0 2024-09-20T20:31:38.538 INFO:tasks.workunit.client.0.smithi070.stdout:3/73: truncate d7/fb 450892 0 2024-09-20T20:31:38.538 INFO:tasks.workunit.client.0.smithi070.stdout:1/89: write d4/d6/d11/f24 [353867,75354] 0 2024-09-20T20:31:38.541 INFO:tasks.workunit.client.0.smithi070.stdout:1/90: unlink d4/d6/d11/f13 0 2024-09-20T20:31:38.541 INFO:tasks.workunit.client.0.smithi070.stdout:1/91: chown f2 430053084 1 2024-09-20T20:31:38.542 INFO:tasks.workunit.client.0.smithi070.stdout:7/46: dread f1 [0,4194304] 0 2024-09-20T20:31:38.542 INFO:tasks.workunit.client.0.smithi070.stdout:4/108: dwrite d6/d7/dc/d14/f18 [4194304,4194304] 0 2024-09-20T20:31:38.543 INFO:tasks.workunit.client.0.smithi070.stdout:1/92: fdatasync d4/d6/f14 0 2024-09-20T20:31:38.543 INFO:tasks.workunit.client.0.smithi070.stdout:9/13: dread d1/f2 [0,4194304] 0 2024-09-20T20:31:38.544 INFO:tasks.workunit.client.0.smithi070.stdout:7/47: fdatasync d2/fb 0 2024-09-20T20:31:38.544 INFO:tasks.workunit.client.0.smithi070.stdout:4/109: readlink d6/d7/dc/l1b 0 2024-09-20T20:31:38.544 INFO:tasks.workunit.client.0.smithi070.stdout:9/14: chown d1/l3 4 1 2024-09-20T20:31:38.545 INFO:tasks.workunit.client.0.smithi070.stdout:7/48: readlink d2/lc 0 2024-09-20T20:31:38.546 INFO:tasks.workunit.client.0.smithi070.stdout:4/110: write f2 [6600559,29292] 0 2024-09-20T20:31:38.546 INFO:tasks.workunit.client.0.smithi070.stdout:3/74: dread f5 [0,4194304] 0 2024-09-20T20:31:38.546 INFO:tasks.workunit.client.0.smithi070.stdout:9/15: write d1/f2 [1810180,47339] 0 2024-09-20T20:31:38.546 INFO:tasks.workunit.client.0.smithi070.stdout:7/49: mkdir d2/df 0 2024-09-20T20:31:38.547 INFO:tasks.workunit.client.0.smithi070.stdout:9/16: stat d1/l3 0 2024-09-20T20:31:38.547 INFO:tasks.workunit.client.0.smithi070.stdout:8/127: dwrite d4/f18 [0,4194304] 0 2024-09-20T20:31:38.547 INFO:tasks.workunit.client.0.smithi070.stdout:9/17: write f0 [2042059,8768] 0 2024-09-20T20:31:38.548 INFO:tasks.workunit.client.0.smithi070.stdout:4/111: write d6/d7/dc/d12/d17/f1f [4881257,16380] 0 2024-09-20T20:31:38.548 INFO:tasks.workunit.client.0.smithi070.stdout:9/18: rename d1 to d1/d4 22 2024-09-20T20:31:38.548 INFO:tasks.workunit.client.0.smithi070.stdout:4/112: chown d6/d7/c15 35804764 1 2024-09-20T20:31:38.549 INFO:tasks.workunit.client.0.smithi070.stdout:9/19: creat d1/f5 x:0 0 0 2024-09-20T20:31:38.549 INFO:tasks.workunit.client.0.smithi070.stdout:8/128: creat d4/d2d/f2e x:0 0 0 2024-09-20T20:31:38.550 INFO:tasks.workunit.client.0.smithi070.stdout:9/20: unlink d1/f2 0 2024-09-20T20:31:38.550 INFO:tasks.workunit.client.0.smithi070.stdout:1/93: dread d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:38.550 INFO:tasks.workunit.client.0.smithi070.stdout:4/113: creat d6/d7/dc/d12/f25 x:0 0 0 2024-09-20T20:31:38.552 INFO:tasks.workunit.client.0.smithi070.stdout:8/129: write d4/db/f1b [960382,26181] 0 2024-09-20T20:31:38.552 INFO:tasks.workunit.client.0.smithi070.stdout:9/21: creat d1/f6 x:0 0 0 2024-09-20T20:31:38.554 INFO:tasks.workunit.client.0.smithi070.stdout:8/130: dread - d4/d27/d2a/f26 zero size 2024-09-20T20:31:38.556 INFO:tasks.workunit.client.0.smithi070.stdout:8/131: creat d4/d27/f2f x:0 0 0 2024-09-20T20:31:38.565 INFO:tasks.workunit.client.0.smithi070.stdout:3/75: dwrite d7/fb [0,4194304] 0 2024-09-20T20:31:38.567 INFO:tasks.workunit.client.0.smithi070.stdout:7/50: dwrite d2/d8/f6 [0,4194304] 0 2024-09-20T20:31:38.568 INFO:tasks.workunit.client.0.smithi070.stdout:8/132: write d4/f7 [5154649,123980] 0 2024-09-20T20:31:38.568 INFO:tasks.workunit.client.0.smithi070.stdout:9/22: getdents d1 0 2024-09-20T20:31:38.570 INFO:tasks.workunit.client.0.smithi070.stdout:7/51: rename d2/f9 to d2/f10 0 2024-09-20T20:31:38.570 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:38.570 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:38.571 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:38.571 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:38.571 INFO:tasks.workunit.client.0.smithi070.stdout:3/76: mknod d7/d15/c16 0 2024-09-20T20:31:38.571 INFO:tasks.workunit.client.0.smithi070.stdout:4/114: dread d6/d7/f16 [0,4194304] 0 2024-09-20T20:31:38.571 INFO:tasks.workunit.client.0.smithi070.stdout:8/133: truncate d4/d2d/f2e 501848 0 2024-09-20T20:31:38.572 INFO:tasks.workunit.client.0.smithi070.stdout:4/115: mkdir d6/d26 0 2024-09-20T20:31:38.572 INFO:tasks.workunit.client.0.smithi070.stdout:8/134: fdatasync d4/db/f11 0 2024-09-20T20:31:38.573 INFO:tasks.workunit.client.0.smithi070.stdout:7/52: dread f1 [0,4194304] 0 2024-09-20T20:31:38.573 INFO:tasks.workunit.client.0.smithi070.stdout:4/116: fsync d6/d7/dc/d14/f18 0 2024-09-20T20:31:38.573 INFO:tasks.workunit.client.0.smithi070.stdout:1/94: dwrite d4/d6/d11/f24 [0,4194304] 0 2024-09-20T20:31:38.573 INFO:tasks.workunit.client.0.smithi070.stdout:8/135: creat d4/d2d/f30 x:0 0 0 2024-09-20T20:31:38.574 INFO:tasks.workunit.client.0.smithi070.stdout:1/95: read - d4/d6/f21 zero size 2024-09-20T20:31:38.576 INFO:tasks.workunit.client.0.smithi070.stdout:4/117: write d6/d7/dc/d14/f18 [1725235,122684] 0 2024-09-20T20:31:38.577 INFO:tasks.workunit.client.0.smithi070.stdout:4/118: creat d6/d26/f27 x:0 0 0 2024-09-20T20:31:38.583 INFO:tasks.workunit.client.0.smithi070.stdout:4/119: truncate f4 2671175 0 2024-09-20T20:31:38.583 INFO:tasks.workunit.client.0.smithi070.stdout:7/53: dwrite d2/d8/f6 [0,4194304] 0 2024-09-20T20:31:38.584 INFO:tasks.workunit.client.0.smithi070.stdout:4/120: rmdir d6/d7 39 2024-09-20T20:31:38.584 INFO:tasks.workunit.client.0.smithi070.stdout:8/136: dwrite d4/d27/d2a/f1c [0,4194304] 0 2024-09-20T20:31:38.585 INFO:tasks.workunit.client.0.smithi070.stdout:7/54: rmdir d2/df 0 2024-09-20T20:31:38.585 INFO:tasks.workunit.client.0.smithi070.stdout:4/121: unlink d6/d7/c15 0 2024-09-20T20:31:38.586 INFO:tasks.workunit.client.0.smithi070.stdout:8/137: mkdir d4/d2d/d31 0 2024-09-20T20:31:38.587 INFO:tasks.workunit.client.0.smithi070.stdout:7/55: symlink d2/d8/l11 0 2024-09-20T20:31:38.587 INFO:tasks.workunit.client.0.smithi070.stdout:1/96: dwrite d4/d6/d11/f10 [4194304,4194304] 0 2024-09-20T20:31:38.587 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:38.588 INFO:tasks.workunit.client.0.smithi070.stdout:8/138: fsync d4/d27/d2a/f2b 0 2024-09-20T20:31:38.588 INFO:tasks.workunit.client.0.smithi070.stdout:7/56: creat d2/d8/f12 x:0 0 0 2024-09-20T20:31:38.589 INFO:tasks.workunit.client.0.smithi070.stdout:7/57: chown d2/c7 1575 1 2024-09-20T20:31:38.589 INFO:tasks.workunit.client.0.smithi070.stdout:8/139: creat d4/db/f32 x:0 0 0 2024-09-20T20:31:38.589 INFO:tasks.workunit.client.0.smithi070.stdout:7/58: chown d2/c7 2830324 1 2024-09-20T20:31:38.590 INFO:tasks.workunit.client.0.smithi070.stdout:8/140: mknod d4/d27/c33 0 2024-09-20T20:31:38.590 INFO:tasks.workunit.client.0.smithi070.stdout:7/59: creat d2/d8/f13 x:0 0 0 2024-09-20T20:31:38.590 INFO:tasks.workunit.client.0.smithi070.stdout:7/60: readlink d2/lc 0 2024-09-20T20:31:38.590 INFO:tasks.workunit.client.0.smithi070.stdout:7/61: creat d2/f14 x:0 0 0 2024-09-20T20:31:38.590 INFO:tasks.workunit.client.0.smithi070.stdout:4/122: read f4 [2085230,49351] 0 2024-09-20T20:31:38.591 INFO:tasks.workunit.client.0.smithi070.stdout:4/123: creat d6/d7/dc/d14/f28 x:0 0 0 2024-09-20T20:31:38.592 INFO:tasks.workunit.client.0.smithi070.stdout:4/124: rmdir d6/d7/dc 39 2024-09-20T20:31:38.594 INFO:tasks.workunit.client.0.smithi070.stdout:4/125: creat d6/d7/f29 x:0 0 0 2024-09-20T20:31:38.594 INFO:tasks.workunit.client.0.smithi070.stdout:8/141: truncate d4/db/ff 798912 0 2024-09-20T20:31:38.594 INFO:tasks.workunit.client.0.smithi070.stdout:1/97: dwrite d4/d6/f14 [0,4194304] 0 2024-09-20T20:31:38.594 INFO:tasks.workunit.client.0.smithi070.stdout:8/142: symlink d4/d27/d2a/l34 0 2024-09-20T20:31:38.595 INFO:tasks.workunit.client.0.smithi070.stdout:1/98: symlink d4/l25 0 2024-09-20T20:31:38.596 INFO:tasks.workunit.client.0.smithi070.stdout:8/143: link d4/c15 d4/d2d/d31/c35 0 2024-09-20T20:31:38.602 INFO:tasks.workunit.client.0.smithi070.stdout:8/144: dwrite d4/d27/d2a/f26 [0,4194304] 0 2024-09-20T20:31:38.603 INFO:tasks.workunit.client.0.smithi070.stdout:8/145: unlink d4/d27/d2a/f26 0 2024-09-20T20:31:38.604 INFO:tasks.workunit.client.0.smithi070.stdout:8/146: read - d4/d27/d2a/f20 zero size 2024-09-20T20:31:38.604 INFO:tasks.workunit.client.0.smithi070.stdout:8/147: creat d4/d27/f36 x:0 0 0 2024-09-20T20:31:38.611 INFO:tasks.workunit.client.0.smithi070.stdout:8/148: getdents d4/d27/d2a 0 2024-09-20T20:31:38.612 INFO:tasks.workunit.client.0.smithi070.stdout:8/149: mknod d4/d27/c37 0 2024-09-20T20:31:38.613 INFO:tasks.workunit.client.0.smithi070.stdout:8/150: creat d4/f38 x:0 0 0 2024-09-20T20:31:38.613 INFO:tasks.workunit.client.0.smithi070.stdout:8/151: mkdir d4/d2d/d39 0 2024-09-20T20:31:38.614 INFO:tasks.workunit.client.0.smithi070.stdout:8/152: chown d4/db/f32 1332345 1 2024-09-20T20:31:38.615 INFO:tasks.workunit.client.0.smithi070.stdout:8/153: dread d4/d2d/f2e [0,4194304] 0 2024-09-20T20:31:38.616 INFO:tasks.workunit.client.0.smithi070.stdout:8/154: symlink d4/d27/d2a/l3a 0 2024-09-20T20:31:38.617 INFO:tasks.workunit.client.0.smithi070.stdout:8/155: symlink d4/d2d/d39/l3b 0 2024-09-20T20:31:38.620 INFO:tasks.workunit.client.0.smithi070.stdout:8/156: write d4/f25 [104051,96660] 0 2024-09-20T20:31:38.621 INFO:tasks.workunit.client.0.smithi070.stdout:8/157: chown d4/f38 28591 1 2024-09-20T20:31:38.621 INFO:tasks.workunit.client.0.smithi070.stdout:8/158: mknod d4/c3c 0 2024-09-20T20:31:38.622 INFO:tasks.workunit.client.0.smithi070.stdout:8/159: mknod d4/d2d/c3d 0 2024-09-20T20:31:38.625 INFO:tasks.workunit.client.0.smithi070.stdout:8/160: rename d4/d2d to d4/d27/d2a/d3e 0 2024-09-20T20:31:38.626 INFO:tasks.workunit.client.0.smithi070.stdout:8/161: rename d4/db/f13 to d4/d27/d2a/d3e/d31/f3f 0 2024-09-20T20:31:38.628 INFO:tasks.workunit.client.0.smithi070.stdout:8/162: dread d4/d27/d2a/d3e/f2e [0,4194304] 0 2024-09-20T20:31:38.632 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:38.632 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:38.634 INFO:tasks.workunit.client.0.smithi070.stdout:8/163: dwrite d4/f7 [0,4194304] 0 2024-09-20T20:31:38.634 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:38.633+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:38.635 INFO:tasks.workunit.client.0.smithi070.stdout:8/164: rename d4/f12 to d4/d27/f40 0 2024-09-20T20:31:38.635 INFO:tasks.workunit.client.0.smithi070.stdout:8/165: chown d4/db/c14 63 1 2024-09-20T20:31:38.636 INFO:tasks.workunit.client.0.smithi070.stdout:8/166: creat d4/d27/d2a/d3e/d39/f41 x:0 0 0 2024-09-20T20:31:38.637 INFO:tasks.workunit.client.0.smithi070.stdout:8/167: write d4/d27/d2a/d3e/d31/f3f [411007,73543] 0 2024-09-20T20:31:38.638 INFO:tasks.workunit.client.0.smithi070.stdout:8/168: mkdir d4/d27/d42 0 2024-09-20T20:31:38.638 INFO:tasks.workunit.client.0.smithi070.stdout:8/169: fdatasync d4/d27/d2a/f21 0 2024-09-20T20:31:38.639 INFO:tasks.workunit.client.0.smithi070.stdout:8/170: mkdir d4/d27/d2a/d43 0 2024-09-20T20:31:38.639 INFO:tasks.workunit.client.0.smithi070.stdout:8/171: chown d4/db/f16 3312625 1 2024-09-20T20:31:38.640 INFO:tasks.workunit.client.0.smithi070.stdout:8/172: write d4/d27/d2a/d3e/f30 [474995,43228] 0 2024-09-20T20:31:38.640 INFO:tasks.workunit.client.0.smithi070.stdout:8/173: readlink d4/d27/d2a/l3a 0 2024-09-20T20:31:38.641 INFO:tasks.workunit.client.0.smithi070.stdout:8/174: creat d4/d27/d42/f44 x:0 0 0 2024-09-20T20:31:38.647 INFO:tasks.workunit.client.0.smithi070.stdout:8/175: dwrite d4/db/f32 [0,4194304] 0 2024-09-20T20:31:38.648 INFO:tasks.workunit.client.0.smithi070.stdout:8/176: write d4/f38 [431219,123532] 0 2024-09-20T20:31:38.649 INFO:tasks.workunit.client.0.smithi070.stdout:8/177: rmdir d4/d27/d2a/d3e/d31 39 2024-09-20T20:31:38.650 INFO:tasks.workunit.client.0.smithi070.stdout:8/178: write d4/f7 [1207215,11736] 0 2024-09-20T20:31:38.651 INFO:tasks.workunit.client.0.smithi070.stdout:8/179: creat d4/d27/d2a/d43/f45 x:0 0 0 2024-09-20T20:31:38.651 INFO:tasks.workunit.client.0.smithi070.stdout:8/180: write d4/d27/f2f [345021,92406] 0 2024-09-20T20:31:38.652 INFO:tasks.workunit.client.0.smithi070.stdout:8/181: truncate d4/d27/d2a/d3e/f2e 252420 0 2024-09-20T20:31:38.653 INFO:tasks.workunit.client.0.smithi070.stdout:8/182: chown d4/d27/c37 117 1 2024-09-20T20:31:38.655 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:38.674 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:38.674 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:38.711 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:38.707+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:38.712 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:38.712 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:38.726 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:38.812 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:38.807+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:38.854 INFO:tasks.workunit.client.0.smithi070.stdout:5/19: sync 2024-09-20T20:31:38.855 INFO:tasks.workunit.client.0.smithi070.stdout:5/20: chown f0 726 1 2024-09-20T20:31:38.856 INFO:tasks.workunit.client.0.smithi070.stdout:5/21: mknod d2/c6 0 2024-09-20T20:31:38.858 INFO:tasks.workunit.client.0.smithi070.stdout:5/22: mkdir d2/d7 0 2024-09-20T20:31:38.859 INFO:tasks.workunit.client.0.smithi070.stdout:5/23: rename d2/c6 to d2/d4/c8 0 2024-09-20T20:31:38.866 INFO:tasks.workunit.client.0.smithi070.stdout:5/24: getdents d2/d4 0 2024-09-20T20:31:38.875 INFO:tasks.workunit.client.0.smithi070.stdout:5/25: truncate f1 665603 0 2024-09-20T20:31:38.885 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:38.885 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:38.893 INFO:tasks.workunit.client.0.smithi070.stdout:5/26: dwrite f1 [0,4194304] 0 2024-09-20T20:31:38.896 INFO:tasks.workunit.client.0.smithi070.stdout:5/27: creat d2/d7/f9 x:0 0 0 2024-09-20T20:31:38.898 INFO:tasks.workunit.client.0.smithi070.stdout:5/28: creat d2/d4/fa x:0 0 0 2024-09-20T20:31:38.898 INFO:tasks.workunit.client.0.smithi070.stdout:5/29: creat d2/fb x:0 0 0 2024-09-20T20:31:38.900 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:38.900 INFO:tasks.workunit.client.0.smithi070.stdout:5/30: write d2/d7/f9 [1012233,20743] 0 2024-09-20T20:31:38.900 INFO:tasks.workunit.client.0.smithi070.stdout:5/31: write d2/d4/fa [444304,50313] 0 2024-09-20T20:31:38.901 INFO:tasks.workunit.client.0.smithi070.stdout:5/32: link f0 d2/d7/fc 0 2024-09-20T20:31:38.913 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:38.909+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:38.913 INFO:tasks.workunit.client.0.smithi070.stdout:5/33: dwrite d2/d7/f9 [0,4194304] 0 2024-09-20T20:31:38.939 INFO:tasks.workunit.client.0.smithi070.stdout:5/34: getdents d2/d4 0 2024-09-20T20:31:38.940 INFO:tasks.workunit.client.0.smithi070.stdout:5/35: creat d2/d4/fd x:0 0 0 2024-09-20T20:31:38.941 INFO:tasks.workunit.client.0.smithi070.stdout:5/36: mkdir d2/d4/de 0 2024-09-20T20:31:38.952 INFO:tasks.workunit.client.0.smithi070.stdout:5/37: dwrite d2/d4/fa [0,4194304] 0 2024-09-20T20:31:38.954 INFO:tasks.workunit.client.0.smithi070.stdout:5/38: mkdir d2/df 0 2024-09-20T20:31:38.955 INFO:tasks.workunit.client.0.smithi070.stdout:5/39: write f1 [2423644,38378] 0 2024-09-20T20:31:38.958 INFO:tasks.workunit.client.0.smithi070.stdout:5/40: symlink d2/df/l10 0 2024-09-20T20:31:38.959 INFO:tasks.workunit.client.0.smithi070.stdout:5/41: fsync f0 0 2024-09-20T20:31:38.969 INFO:tasks.workunit.client.0.smithi070.stdout:5/42: dwrite f1 [0,4194304] 0 2024-09-20T20:31:38.970 INFO:tasks.workunit.client.0.smithi070.stdout:5/43: write d2/fb [87151,25229] 0 2024-09-20T20:31:38.971 INFO:tasks.workunit.client.0.smithi070.stdout:5/44: creat d2/d7/f11 x:0 0 0 2024-09-20T20:31:38.977 INFO:tasks.workunit.client.0.smithi070.stdout:0/42: sync 2024-09-20T20:31:38.982 INFO:tasks.workunit.client.0.smithi070.stdout:0/43: getdents d4/d8 0 2024-09-20T20:31:38.982 INFO:tasks.workunit.client.0.smithi070.stdout:5/45: getdents d2/d4 0 2024-09-20T20:31:38.985 INFO:tasks.workunit.client.0.smithi070.stdout:5/46: fdatasync d2/fb 0 2024-09-20T20:31:38.986 INFO:tasks.workunit.client.0.smithi070.stdout:0/44: dread d4/f5 [0,4194304] 0 2024-09-20T20:31:38.986 INFO:tasks.workunit.client.0.smithi070.stdout:0/45: creat d4/d8/fb x:0 0 0 2024-09-20T20:31:38.987 INFO:tasks.workunit.client.0.smithi070.stdout:0/46: chown d4/d8 21601 1 2024-09-20T20:31:38.995 INFO:tasks.workunit.client.0.smithi070.stdout:5/47: truncate f1 4003404 0 2024-09-20T20:31:38.995 INFO:tasks.workunit.client.0.smithi070.stdout:0/47: getdents d4/d8 0 2024-09-20T20:31:38.996 INFO:tasks.workunit.client.0.smithi070.stdout:0/48: creat d4/d8/fc x:0 0 0 2024-09-20T20:31:38.997 INFO:tasks.workunit.client.0.smithi070.stdout:0/49: creat d4/fd x:0 0 0 2024-09-20T20:31:38.997 INFO:tasks.workunit.client.0.smithi070.stdout:0/50: mknod d4/d8/ce 0 2024-09-20T20:31:39.008 INFO:tasks.workunit.client.0.smithi070.stdout:0/51: dwrite f1 [0,4194304] 0 2024-09-20T20:31:39.009 INFO:tasks.workunit.client.0.smithi070.stdout:0/52: write d4/f5 [992324,74496] 0 2024-09-20T20:31:39.009 INFO:tasks.workunit.client.0.smithi070.stdout:0/53: truncate d4/d8/fc 1039691 0 2024-09-20T20:31:39.010 INFO:tasks.workunit.client.0.smithi070.stdout:0/54: symlink d4/lf 0 2024-09-20T20:31:39.011 INFO:tasks.workunit.client.0.smithi070.stdout:0/55: readlink d4/l6 0 2024-09-20T20:31:39.011 INFO:tasks.workunit.client.0.smithi070.stdout:0/56: readlink d4/lf 0 2024-09-20T20:31:39.012 INFO:tasks.workunit.client.0.smithi070.stdout:0/57: truncate d4/d8/fc 1884880 0 2024-09-20T20:31:39.013 INFO:tasks.workunit.client.0.smithi070.stdout:0/58: rename d4/d8/fa to d4/d8/f10 0 2024-09-20T20:31:39.015 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:39.007+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:39.015 INFO:tasks.workunit.client.0.smithi070.stdout:0/59: write d4/fd [542260,7789] 0 2024-09-20T20:31:39.015 INFO:tasks.workunit.client.0.smithi070.stdout:0/60: rename f1 to d4/f11 0 2024-09-20T20:31:39.024 INFO:tasks.workunit.client.0.smithi070.stdout:0/61: dwrite d4/f11 [0,4194304] 0 2024-09-20T20:31:39.032 INFO:tasks.workunit.client.0.smithi070.stdout:0/62: dwrite d4/d8/fc [0,4194304] 0 2024-09-20T20:31:39.035 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:39.035 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:39.041 INFO:tasks.workunit.client.0.smithi070.stdout:0/63: dwrite d4/f5 [0,4194304] 0 2024-09-20T20:31:39.042 INFO:tasks.workunit.client.0.smithi070.stdout:0/64: write d4/f5 [2051275,53813] 0 2024-09-20T20:31:39.053 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:39.055 INFO:tasks.workunit.client.0.smithi070.stdout:0/65: fsync d4/d8/fc 0 2024-09-20T20:31:39.065 INFO:tasks.workunit.client.0.smithi070.stdout:0/66: dwrite d4/f7 [0,4194304] 0 2024-09-20T20:31:39.066 INFO:tasks.workunit.client.0.smithi070.stdout:0/67: truncate d4/d8/fb 91506 0 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:4/126: sync 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:3/77: sync 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:9/23: sync 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:2/45: sync 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:6/47: sync 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:1/99: sync 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:8/183: sync 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:7/62: sync 2024-09-20T20:31:39.067 INFO:tasks.workunit.client.0.smithi070.stdout:0/68: write d4/f9 [434125,17531] 0 2024-09-20T20:31:39.068 INFO:tasks.workunit.client.0.smithi070.stdout:1/100: stat d4/d6/l20 0 2024-09-20T20:31:39.068 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:31:39.068 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:31:39.068 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-20T20:31:39.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-20T20:31:39.070 INFO:tasks.workunit.client.0.smithi070.stdout:9/24: creat d1/f7 x:0 0 0 2024-09-20T20:31:39.070 INFO:tasks.workunit.client.0.smithi070.stdout:6/48: dread - d4/d8/fc zero size 2024-09-20T20:31:39.070 INFO:tasks.workunit.client.0.smithi070.stdout:8/184: symlink d4/db/l46 0 2024-09-20T20:31:39.070 INFO:tasks.workunit.client.0.smithi070.stdout:2/46: rename f1 to d3/d5/dd/ff 0 2024-09-20T20:31:39.070 INFO:tasks.workunit.client.0.smithi070.stdout:0/69: write f2 [4553663,73827] 0 2024-09-20T20:31:39.070 INFO:tasks.workunit.client.0.smithi070.stdout:3/78: read d7/d8/fc [465712,23348] 0 2024-09-20T20:31:39.071 INFO:tasks.workunit.client.0.smithi070.stdout:9/25: rename d1 to d1/d8 22 2024-09-20T20:31:39.071 INFO:tasks.workunit.client.0.smithi070.stdout:6/49: write d4/d8/ff [1350283,108445] 0 2024-09-20T20:31:39.072 INFO:tasks.workunit.client.0.smithi070.stdout:4/127: rename d6/d7/dc/d12/d17/f1f to d6/d7/dc/d23/f2a 0 2024-09-20T20:31:39.072 INFO:tasks.workunit.client.0.smithi070.stdout:3/79: fdatasync f5 0 2024-09-20T20:31:39.072 INFO:tasks.workunit.client.0.smithi070.stdout:9/26: rename d1/l3 to d1/l9 0 2024-09-20T20:31:39.072 INFO:tasks.workunit.client.0.smithi070.stdout:8/185: symlink d4/db/l47 0 2024-09-20T20:31:39.072 INFO:tasks.workunit.client.0.smithi070.stdout:2/47: rename d3/d5/da to d3/d5/d9/d10 0 2024-09-20T20:31:39.073 INFO:tasks.workunit.client.0.smithi070.stdout:9/27: creat d1/fa x:0 0 0 2024-09-20T20:31:39.073 INFO:tasks.workunit.client.0.smithi070.stdout:6/50: write d4/f6 [1147286,29189] 0 2024-09-20T20:31:39.074 INFO:tasks.workunit.client.0.smithi070.stdout:8/186: mknod d4/d27/c48 0 2024-09-20T20:31:39.075 INFO:tasks.workunit.client.0.smithi070.stdout:9/28: creat d1/fb x:0 0 0 2024-09-20T20:31:39.075 INFO:tasks.workunit.client.0.smithi070.stdout:6/51: chown d4/c5 4522561 1 2024-09-20T20:31:39.076 INFO:tasks.workunit.client.0.smithi070.stdout:4/128: mknod d6/d7/dc/d23/c2b 0 2024-09-20T20:31:39.076 INFO:tasks.workunit.client.0.smithi070.stdout:9/29: chown d1 478 1 2024-09-20T20:31:39.076 INFO:tasks.workunit.client.0.smithi070.stdout:8/187: mknod d4/d27/c49 0 2024-09-20T20:31:39.077 INFO:tasks.workunit.client.0.smithi070.stdout:2/48: rename d3/d5/f7 to d3/d5/d9/d10/f11 0 2024-09-20T20:31:39.077 INFO:tasks.workunit.client.0.smithi070.stdout:6/52: creat d4/f13 x:0 0 0 2024-09-20T20:31:39.079 INFO:tasks.workunit.client.0.smithi070.stdout:1/101: dwrite f2 [0,4194304] 0 2024-09-20T20:31:39.080 INFO:tasks.workunit.client.0.smithi070.stdout:9/30: write d1/f7 [504739,9248] 0 2024-09-20T20:31:39.080 INFO:tasks.workunit.client.0.smithi070.stdout:8/188: creat d4/db/f4a x:0 0 0 2024-09-20T20:31:39.082 INFO:tasks.workunit.client.0.smithi070.stdout:4/129: truncate d6/d7/dc/d14/f28 645653 0 2024-09-20T20:31:39.083 INFO:tasks.workunit.client.0.smithi070.stdout:9/31: readlink d1/l9 0 2024-09-20T20:31:39.083 INFO:tasks.workunit.client.0.smithi070.stdout:6/53: truncate d4/f11 3478497 0 2024-09-20T20:31:39.083 INFO:tasks.workunit.client.0.smithi070.stdout:1/102: mkdir d4/d6/d26 0 2024-09-20T20:31:39.083 INFO:tasks.workunit.client.0.smithi070.stdout:8/189: mkdir d4/d27/d2a/d4b 0 2024-09-20T20:31:39.083 INFO:tasks.workunit.client.0.smithi070.stdout:0/70: dwrite f2 [0,4194304] 0 2024-09-20T20:31:39.083 INFO:tasks.workunit.client.0.smithi070.stdout:3/80: dread d7/f14 [0,4194304] 0 2024-09-20T20:31:39.083 INFO:tasks.workunit.client.0.smithi070.stdout:8/190: fsync d4/d27/f2f 0 2024-09-20T20:31:39.084 INFO:tasks.workunit.client.0.smithi070.stdout:4/130: fdatasync d6/d7/dc/d20/f24 0 2024-09-20T20:31:39.084 INFO:tasks.workunit.client.0.smithi070.stdout:9/32: symlink d1/lc 0 2024-09-20T20:31:39.084 INFO:tasks.workunit.client.0.smithi070.stdout:1/103: mknod d4/c27 0 2024-09-20T20:31:39.084 INFO:tasks.workunit.client.0.smithi070.stdout:0/71: mkdir d4/d8/d12 0 2024-09-20T20:31:39.085 INFO:tasks.workunit.client.0.smithi070.stdout:9/33: chown d1/fb 3889110 1 2024-09-20T20:31:39.085 INFO:tasks.workunit.client.0.smithi070.stdout:6/54: getdents d4/d8 0 2024-09-20T20:31:39.085 INFO:tasks.workunit.client.0.smithi070.stdout:4/131: stat d6/d7/dc/d14/f28 0 2024-09-20T20:31:39.085 INFO:tasks.workunit.client.0.smithi070.stdout:0/72: mkdir d4/d13 0 2024-09-20T20:31:39.086 INFO:tasks.workunit.client.0.smithi070.stdout:8/191: mknod d4/d27/d2a/d3e/c4c 0 2024-09-20T20:31:39.087 INFO:tasks.workunit.client.0.smithi070.stdout:9/34: rename d1/fa to d1/fd 0 2024-09-20T20:31:39.088 INFO:tasks.workunit.client.0.smithi070.stdout:8/192: chown d4/d27/d2a/d43 13 1 2024-09-20T20:31:39.088 INFO:tasks.workunit.client.0.smithi070.stdout:0/73: creat d4/d8/d12/f14 x:0 0 0 2024-09-20T20:31:39.088 INFO:tasks.workunit.client.0.smithi070.stdout:4/132: write d6/d7/dc/d14/f21 [816548,39686] 0 2024-09-20T20:31:39.089 INFO:tasks.workunit.client.0.smithi070.stdout:2/49: dwrite d3/d5/dd/ff [0,4194304] 0 2024-09-20T20:31:39.089 INFO:tasks.workunit.client.0.smithi070.stdout:0/74: mknod d4/d8/d12/c15 0 2024-09-20T20:31:39.089 INFO:tasks.workunit.client.0.smithi070.stdout:8/193: write d4/d27/f40 [8322734,69708] 0 2024-09-20T20:31:39.090 INFO:tasks.workunit.client.0.smithi070.stdout:0/75: rmdir d4/d8/d12 39 2024-09-20T20:31:39.090 INFO:tasks.workunit.client.0.smithi070.stdout:4/133: link d6/ff d6/d7/dc/d23/f2c 0 2024-09-20T20:31:39.091 INFO:tasks.workunit.client.0.smithi070.stdout:2/50: mkdir d3/de/d12 0 2024-09-20T20:31:39.091 INFO:tasks.workunit.client.0.smithi070.stdout:8/194: rmdir d4/d27/d2a/d4b 0 2024-09-20T20:31:39.092 INFO:tasks.workunit.client.0.smithi070.stdout:4/134: rename f4 to d6/d7/dc/d14/f2d 0 2024-09-20T20:31:39.092 INFO:tasks.workunit.client.0.smithi070.stdout:6/55: dread d4/f9 [0,4194304] 0 2024-09-20T20:31:39.093 INFO:tasks.workunit.client.0.smithi070.stdout:8/195: read d4/f25 [65663,12104] 0 2024-09-20T20:31:39.093 INFO:tasks.workunit.client.0.smithi070.stdout:2/51: getdents d3/de/d12 0 2024-09-20T20:31:39.094 INFO:tasks.workunit.client.0.smithi070.stdout:4/135: write d6/d26/f27 [177930,72244] 0 2024-09-20T20:31:39.095 INFO:tasks.workunit.client.0.smithi070.stdout:6/56: creat d4/d8/d10/f14 x:0 0 0 2024-09-20T20:31:39.097 INFO:tasks.workunit.client.0.smithi070.stdout:6/57: creat d4/d8/d10/f15 x:0 0 0 2024-09-20T20:31:39.097 INFO:tasks.workunit.client.0.smithi070.stdout:9/35: dwrite d1/fb [0,4194304] 0 2024-09-20T20:31:39.097 INFO:tasks.workunit.client.0.smithi070.stdout:4/136: truncate d6/d7/dc/d14/f28 1337399 0 2024-09-20T20:31:39.098 INFO:tasks.workunit.client.0.smithi070.stdout:9/36: write d1/f7 [348591,65762] 0 2024-09-20T20:31:39.100 INFO:tasks.workunit.client.0.smithi070.stdout:6/58: rename d4/d8/fb to d4/d8/f16 0 2024-09-20T20:31:39.102 INFO:tasks.workunit.client.0.smithi070.stdout:4/137: write d6/d7/dc/d23/f2c [2320193,107125] 0 2024-09-20T20:31:39.103 INFO:tasks.workunit.client.0.smithi070.stdout:0/76: dwrite d4/d8/fc [4194304,4194304] 0 2024-09-20T20:31:39.104 INFO:tasks.workunit.client.0.smithi070.stdout:8/196: dwrite d4/db/f16 [0,4194304] 0 2024-09-20T20:31:39.105 INFO:tasks.workunit.client.0.smithi070.stdout:0/77: write d4/f5 [1654217,13705] 0 2024-09-20T20:31:39.105 INFO:tasks.workunit.client.0.smithi070.stdout:1/104: truncate d4/d6/f14 833151 0 2024-09-20T20:31:39.106 INFO:tasks.workunit.client.0.smithi070.stdout:8/197: unlink d4/d27/d2a/l19 0 2024-09-20T20:31:39.107 INFO:tasks.workunit.client.0.smithi070.stdout:1/105: link d4/l25 d4/l28 0 2024-09-20T20:31:39.107 INFO:tasks.workunit.client.0.smithi070.stdout:8/198: chown d4/l5 5 1 2024-09-20T20:31:39.109 INFO:tasks.workunit.client.0.smithi070.stdout:6/59: dread d4/d8/fa [0,4194304] 0 2024-09-20T20:31:39.110 INFO:tasks.workunit.client.0.smithi070.stdout:9/37: dwrite d1/fd [0,4194304] 0 2024-09-20T20:31:39.110 INFO:tasks.workunit.client.0.smithi070.stdout:8/199: mknod d4/db/c4d 0 2024-09-20T20:31:39.110 INFO:tasks.workunit.client.0.smithi070.stdout:1/106: creat d4/d6/f29 x:0 0 0 2024-09-20T20:31:39.112 INFO:tasks.workunit.client.0.smithi070.stdout:1/107: symlink d4/d1f/l2a 0 2024-09-20T20:31:39.113 INFO:tasks.workunit.client.0.smithi070.stdout:0/78: fsync f2 0 2024-09-20T20:31:39.113 INFO:tasks.workunit.client.0.smithi070.stdout:4/138: dwrite d6/d7/dc/d12/f25 [0,4194304] 0 2024-09-20T20:31:39.115 INFO:tasks.workunit.client.0.smithi070.stdout:1/108: chown d4/d6/l20 3050 1 2024-09-20T20:31:39.116 INFO:tasks.workunit.client.0.smithi070.stdout:9/38: getdents d1 0 2024-09-20T20:31:39.117 INFO:tasks.workunit.client.0.smithi070.stdout:4/139: truncate d6/d7/dc/d14/f2d 2679301 0 2024-09-20T20:31:39.118 INFO:tasks.workunit.client.0.smithi070.stdout:0/79: getdents d4/d13 0 2024-09-20T20:31:39.118 INFO:tasks.workunit.client.0.smithi070.stdout:9/39: creat d1/fe x:0 0 0 2024-09-20T20:31:39.118 INFO:tasks.workunit.client.0.smithi070.stdout:1/109: mknod d4/c2b 0 2024-09-20T20:31:39.119 INFO:tasks.workunit.client.0.smithi070.stdout:8/200: dread d4/f7 [0,4194304] 0 2024-09-20T20:31:39.119 INFO:tasks.workunit.client.0.smithi070.stdout:9/40: unlink d1/l9 0 2024-09-20T20:31:39.119 INFO:tasks.workunit.client.0.smithi070.stdout:0/80: creat d4/f16 x:0 0 0 2024-09-20T20:31:39.121 INFO:tasks.workunit.client.0.smithi070.stdout:6/60: dwrite d4/d8/fc [0,4194304] 0 2024-09-20T20:31:39.122 INFO:tasks.workunit.client.0.smithi070.stdout:0/81: creat d4/f17 x:0 0 0 2024-09-20T20:31:39.122 INFO:tasks.workunit.client.0.smithi070.stdout:8/201: symlink d4/l4e 0 2024-09-20T20:31:39.124 INFO:tasks.workunit.client.0.smithi070.stdout:2/52: fdatasync f2 0 2024-09-20T20:31:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:0/82: creat d4/d13/f18 x:0 0 0 2024-09-20T20:31:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:0/83: mkdir d4/d19 0 2024-09-20T20:31:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:2/53: creat d3/d5/d9/d10/f13 x:0 0 0 2024-09-20T20:31:39.133 INFO:tasks.workunit.client.0.smithi070.stdout:4/140: dwrite d6/d7/dc/d23/f2c [4194304,4194304] 0 2024-09-20T20:31:39.133 INFO:tasks.workunit.client.0.smithi070.stdout:1/110: dwrite d4/d6/d11/f10 [4194304,4194304] 0 2024-09-20T20:31:39.135 INFO:tasks.workunit.client.0.smithi070.stdout:2/54: chown d3/d5/d9/d10/f13 73 1 2024-09-20T20:31:39.135 INFO:tasks.workunit.client.0.smithi070.stdout:9/41: dwrite d1/f6 [0,4194304] 0 2024-09-20T20:31:39.136 INFO:tasks.workunit.client.0.smithi070.stdout:1/111: chown d4/l16 3 1 2024-09-20T20:31:39.136 INFO:tasks.workunit.client.0.smithi070.stdout:6/61: dread f0 [0,4194304] 0 2024-09-20T20:31:39.138 INFO:tasks.workunit.client.0.smithi070.stdout:0/84: fsync d4/d13/f18 0 2024-09-20T20:31:39.138 INFO:tasks.workunit.client.0.smithi070.stdout:8/202: dwrite d4/f28 [0,4194304] 0 2024-09-20T20:31:39.138 INFO:tasks.workunit.client.0.smithi070.stdout:2/55: rename f0 to d3/d5/f14 0 2024-09-20T20:31:39.138 INFO:tasks.workunit.client.0.smithi070.stdout:6/62: chown d4/d8/ff 7397738 1 2024-09-20T20:31:39.139 INFO:tasks.workunit.client.0.smithi070.stdout:9/42: unlink d1/fb 0 2024-09-20T20:31:39.140 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:39.135+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:39.140 INFO:tasks.workunit.client.0.smithi070.stdout:1/112: mkdir d4/d6/d11/d2c 0 2024-09-20T20:31:39.140 INFO:tasks.workunit.client.0.smithi070.stdout:6/63: rmdir d4/d8 39 2024-09-20T20:31:39.140 INFO:tasks.workunit.client.0.smithi070.stdout:2/56: link d3/d5/f14 d3/d5/dd/f15 0 2024-09-20T20:31:39.141 INFO:tasks.workunit.client.0.smithi070.stdout:8/203: dread d4/d27/d2a/d3e/f2e [0,4194304] 0 2024-09-20T20:31:39.141 INFO:tasks.workunit.client.0.smithi070.stdout:0/85: write d4/d8/d12/f14 [804038,38950] 0 2024-09-20T20:31:39.141 INFO:tasks.workunit.client.0.smithi070.stdout:2/57: chown f2 53402966 1 2024-09-20T20:31:39.142 INFO:tasks.workunit.client.0.smithi070.stdout:6/64: mkdir d4/d8/d17 0 2024-09-20T20:31:39.142 INFO:tasks.workunit.client.0.smithi070.stdout:0/86: chown f2 84536507 1 2024-09-20T20:31:39.142 INFO:tasks.workunit.client.0.smithi070.stdout:1/113: getdents d4/d6/d26 0 2024-09-20T20:31:39.143 INFO:tasks.workunit.client.0.smithi070.stdout:2/58: mknod d3/d5/d9/c16 0 2024-09-20T20:31:39.144 INFO:tasks.workunit.client.0.smithi070.stdout:0/87: write d4/f7 [364115,77474] 0 2024-09-20T20:31:39.144 INFO:tasks.workunit.client.0.smithi070.stdout:1/114: write d4/d6/d11/f10 [959330,25760] 0 2024-09-20T20:31:39.146 INFO:tasks.workunit.client.0.smithi070.stdout:4/141: dwrite d6/d7/dc/d14/f28 [0,4194304] 0 2024-09-20T20:31:39.146 INFO:tasks.workunit.client.0.smithi070.stdout:2/59: rename d3/d5/c8 to d3/de/d12/c17 0 2024-09-20T20:31:39.147 INFO:tasks.workunit.client.0.smithi070.stdout:0/88: dread d4/d8/fb [0,4194304] 0 2024-09-20T20:31:39.148 INFO:tasks.workunit.client.0.smithi070.stdout:4/142: write d6/d26/f27 [603593,27540] 0 2024-09-20T20:31:39.149 INFO:tasks.workunit.client.0.smithi070.stdout:4/143: chown d6/d7 318 1 2024-09-20T20:31:39.149 INFO:tasks.workunit.client.0.smithi070.stdout:2/60: link d3/d5/d9/d10/f11 d3/de/f18 0 2024-09-20T20:31:39.150 INFO:tasks.workunit.client.0.smithi070.stdout:6/65: dread d4/d8/f16 [0,4194304] 0 2024-09-20T20:31:39.151 INFO:tasks.workunit.client.0.smithi070.stdout:2/61: creat d3/de/f19 x:0 0 0 2024-09-20T20:31:39.152 INFO:tasks.workunit.client.0.smithi070.stdout:8/204: dwrite d4/d27/d2a/f2b [0,4194304] 0 2024-09-20T20:31:39.152 INFO:tasks.workunit.client.0.smithi070.stdout:6/66: truncate d4/d8/d10/f14 68711 0 2024-09-20T20:31:39.153 INFO:tasks.workunit.client.0.smithi070.stdout:1/115: dread f2 [0,4194304] 0 2024-09-20T20:31:39.155 INFO:tasks.workunit.client.0.smithi070.stdout:6/67: symlink d4/d8/l18 0 2024-09-20T20:31:39.155 INFO:tasks.workunit.client.0.smithi070.stdout:4/144: link d6/d7/dc/d23/f2a d6/d7/dc/d14/f2e 0 2024-09-20T20:31:39.156 INFO:tasks.workunit.client.0.smithi070.stdout:1/116: mknod d4/d6/d11/d2c/c2d 0 2024-09-20T20:31:39.157 INFO:tasks.workunit.client.0.smithi070.stdout:6/68: rmdir d4/d8 39 2024-09-20T20:31:39.157 INFO:tasks.workunit.client.0.smithi070.stdout:5/48: sync 2024-09-20T20:31:39.157 INFO:tasks.workunit.client.0.smithi070.stdout:1/117: symlink d4/d1f/l2e 0 2024-09-20T20:31:39.158 INFO:tasks.workunit.client.0.smithi070.stdout:4/145: mknod d6/d7/dc/d12/d17/c2f 0 2024-09-20T20:31:39.160 INFO:tasks.workunit.client.0.smithi070.stdout:5/49: rename d2/d4/c8 to d2/d7/c12 0 2024-09-20T20:31:39.160 INFO:tasks.workunit.client.0.smithi070.stdout:0/89: dread d4/f9 [0,4194304] 0 2024-09-20T20:31:39.161 INFO:tasks.workunit.client.0.smithi070.stdout:6/69: creat d4/d8/d17/f19 x:0 0 0 2024-09-20T20:31:39.161 INFO:tasks.workunit.client.0.smithi070.stdout:0/90: dread - d4/f16 zero size 2024-09-20T20:31:39.162 INFO:tasks.workunit.client.0.smithi070.stdout:4/146: link d6/d7/l1d d6/d7/l30 0 2024-09-20T20:31:39.162 INFO:tasks.workunit.client.0.smithi070.stdout:8/205: dwrite d4/d27/d2a/f20 [0,4194304] 0 2024-09-20T20:31:39.163 INFO:tasks.workunit.client.0.smithi070.stdout:6/70: write d4/d8/ff [2465499,28686] 0 2024-09-20T20:31:39.165 INFO:tasks.workunit.client.0.smithi070.stdout:8/206: write d4/d27/d42/f44 [508240,2145] 0 2024-09-20T20:31:39.165 INFO:tasks.workunit.client.0.smithi070.stdout:0/91: rmdir d4 39 2024-09-20T20:31:39.165 INFO:tasks.workunit.client.0.smithi070.stdout:6/71: creat d4/d8/d17/f1a x:0 0 0 2024-09-20T20:31:39.166 INFO:tasks.workunit.client.0.smithi070.stdout:2/62: dwrite d3/d5/dd/f15 [0,4194304] 0 2024-09-20T20:31:39.166 INFO:tasks.workunit.client.0.smithi070.stdout:8/207: write d4/f18 [2268871,75574] 0 2024-09-20T20:31:39.166 INFO:tasks.workunit.client.0.smithi070.stdout:2/63: chown d3 407107 1 2024-09-20T20:31:39.168 INFO:tasks.workunit.client.0.smithi070.stdout:1/118: dwrite d4/d6/d11/f10 [0,4194304] 0 2024-09-20T20:31:39.174 INFO:tasks.workunit.client.0.smithi070.stdout:1/119: dread d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:39.174 INFO:tasks.workunit.client.0.smithi070.stdout:6/72: dwrite d4/d8/d17/f1a [0,4194304] 0 2024-09-20T20:31:39.175 INFO:tasks.workunit.client.0.smithi070.stdout:8/208: dread d4/f25 [0,4194304] 0 2024-09-20T20:31:39.175 INFO:tasks.workunit.client.0.smithi070.stdout:6/73: chown d4/f9 649849 1 2024-09-20T20:31:39.175 INFO:tasks.workunit.client.0.smithi070.stdout:2/64: dwrite d3/d5/dd/ff [4194304,4194304] 0 2024-09-20T20:31:39.175 INFO:tasks.workunit.client.0.smithi070.stdout:8/209: readlink d4/d27/d2a/l3a 0 2024-09-20T20:31:39.176 INFO:tasks.workunit.client.0.smithi070.stdout:8/210: readlink d4/la 0 2024-09-20T20:31:39.176 INFO:tasks.workunit.client.0.smithi070.stdout:6/74: truncate d4/f11 1072820 0 2024-09-20T20:31:39.177 INFO:tasks.workunit.client.0.smithi070.stdout:2/65: mkdir d3/de/d12/d1a 0 2024-09-20T20:31:39.177 INFO:tasks.workunit.client.0.smithi070.stdout:2/66: rename d3/f4 to d3/de/f1b 0 2024-09-20T20:31:39.177 INFO:tasks.workunit.client.0.smithi070.stdout:6/75: rename d4/d8/d17/f19 to d4/d8/d17/f1b 0 2024-09-20T20:31:39.178 INFO:tasks.workunit.client.0.smithi070.stdout:2/67: mkdir d3/d5/d9/d1c 0 2024-09-20T20:31:39.179 INFO:tasks.workunit.client.0.smithi070.stdout:6/76: rename c2 to d4/c1c 0 2024-09-20T20:31:39.179 INFO:tasks.workunit.client.0.smithi070.stdout:2/68: fsync d3/de/f18 0 2024-09-20T20:31:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:2/69: chown d3/de/d12/d1a 1621712 1 2024-09-20T20:31:39.180 INFO:tasks.workunit.client.0.smithi070.stdout:6/77: link d4/f7 d4/d8/d10/f1d 0 2024-09-20T20:31:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:6/78: readlink d4/d8/l18 0 2024-09-20T20:31:39.181 INFO:tasks.workunit.client.0.smithi070.stdout:2/70: rename d3/de to d3/de/d12/d1d 22 2024-09-20T20:31:39.182 INFO:tasks.workunit.client.0.smithi070.stdout:1/120: dwrite d4/d6/f29 [0,4194304] 0 2024-09-20T20:31:39.182 INFO:tasks.workunit.client.0.smithi070.stdout:0/92: write d4/d8/fb [738233,40506] 0 2024-09-20T20:31:39.182 INFO:tasks.workunit.client.0.smithi070.stdout:2/71: write d3/d5/dd/f15 [3576668,26893] 0 2024-09-20T20:31:39.184 INFO:tasks.workunit.client.0.smithi070.stdout:0/93: symlink d4/d8/d12/l1a 0 2024-09-20T20:31:39.185 INFO:tasks.workunit.client.0.smithi070.stdout:1/121: getdents d4 0 2024-09-20T20:31:39.185 INFO:tasks.workunit.client.0.smithi070.stdout:0/94: mkdir d4/d1b 0 2024-09-20T20:31:39.187 INFO:tasks.workunit.client.0.smithi070.stdout:1/122: mkdir d4/d6/d2f 0 2024-09-20T20:31:39.190 INFO:tasks.workunit.client.0.smithi070.stdout:1/123: creat d4/d6/d11/f30 x:0 0 0 2024-09-20T20:31:39.190 INFO:tasks.workunit.client.0.smithi070.stdout:4/147: dwrite d6/d7/f9 [0,4194304] 0 2024-09-20T20:31:39.193 INFO:tasks.workunit.client.0.smithi070.stdout:1/124: write d4/d6/f29 [4319063,80631] 0 2024-09-20T20:31:39.193 INFO:tasks.workunit.client.0.smithi070.stdout:6/79: dwrite d4/f9 [4194304,4194304] 0 2024-09-20T20:31:39.193 INFO:tasks.workunit.client.0.smithi070.stdout:2/72: dwrite d3/d5/dd/f15 [0,4194304] 0 2024-09-20T20:31:39.194 INFO:tasks.workunit.client.0.smithi070.stdout:0/95: dread d4/f7 [0,4194304] 0 2024-09-20T20:31:39.195 INFO:tasks.workunit.client.0.smithi070.stdout:2/73: write d3/d5/d9/d10/f13 [1034677,7269] 0 2024-09-20T20:31:39.195 INFO:tasks.workunit.client.0.smithi070.stdout:0/96: chown d4/d13/f18 90538 1 2024-09-20T20:31:39.197 INFO:tasks.workunit.client.0.smithi070.stdout:4/148: unlink d6/d7/dc/d23/f2a 0 2024-09-20T20:31:39.197 INFO:tasks.workunit.client.0.smithi070.stdout:2/74: creat d3/d5/f1e x:0 0 0 2024-09-20T20:31:39.197 INFO:tasks.workunit.client.0.smithi070.stdout:0/97: mkdir d4/d1b/d1c 0 2024-09-20T20:31:39.198 INFO:tasks.workunit.client.0.smithi070.stdout:1/125: getdents d4/d6/d11/d2c 0 2024-09-20T20:31:39.198 INFO:tasks.workunit.client.0.smithi070.stdout:4/149: symlink d6/d7/dc/d12/l31 0 2024-09-20T20:31:39.199 INFO:tasks.workunit.client.0.smithi070.stdout:0/98: write d4/f9 [424545,18032] 0 2024-09-20T20:31:39.199 INFO:tasks.workunit.client.0.smithi070.stdout:2/75: mkdir d3/d5/d9/d1c/d1f 0 2024-09-20T20:31:39.199 INFO:tasks.workunit.client.0.smithi070.stdout:4/150: write d6/ff [656891,83696] 0 2024-09-20T20:31:39.199 INFO:tasks.workunit.client.0.smithi070.stdout:1/126: creat d4/d6/d2f/f31 x:0 0 0 2024-09-20T20:31:39.199 INFO:tasks.workunit.client.0.smithi070.stdout:0/99: mkdir d4/d1b/d1c/d1d 0 2024-09-20T20:31:39.200 INFO:tasks.workunit.client.0.smithi070.stdout:1/127: mkdir d4/d32 0 2024-09-20T20:31:39.200 INFO:tasks.workunit.client.0.smithi070.stdout:0/100: read - d4/f17 zero size 2024-09-20T20:31:39.200 INFO:tasks.workunit.client.0.smithi070.stdout:4/151: chown d6/d7/l1d 1972427 1 2024-09-20T20:31:39.200 INFO:tasks.workunit.client.0.smithi070.stdout:0/101: creat d4/d1b/d1c/f1e x:0 0 0 2024-09-20T20:31:39.201 INFO:tasks.workunit.client.0.smithi070.stdout:4/152: link d6/f11 d6/d7/dc/d12/f32 0 2024-09-20T20:31:39.201 INFO:tasks.workunit.client.0.smithi070.stdout:0/102: mkdir d4/d1b/d1c/d1f 0 2024-09-20T20:31:39.201 INFO:tasks.workunit.client.0.smithi070.stdout:4/153: dread - d6/d7/dc/d12/f32 zero size 2024-09-20T20:31:39.202 INFO:tasks.workunit.client.0.smithi070.stdout:4/154: link d6/d7/f16 d6/d7/dc/d12/f33 0 2024-09-20T20:31:39.203 INFO:tasks.workunit.client.0.smithi070.stdout:4/155: write d6/ff [3786312,32961] 0 2024-09-20T20:31:39.207 INFO:tasks.workunit.client.0.smithi070.stdout:2/76: write d3/de/f1b [979356,58029] 0 2024-09-20T20:31:39.207 INFO:tasks.workunit.client.0.smithi070.stdout:4/156: dread d6/d7/dc/d14/f28 [0,4194304] 0 2024-09-20T20:31:39.208 INFO:tasks.workunit.client.0.smithi070.stdout:6/80: dread d4/f11 [0,4194304] 0 2024-09-20T20:31:39.208 INFO:tasks.workunit.client.0.smithi070.stdout:2/77: symlink d3/de/l20 0 2024-09-20T20:31:39.209 INFO:tasks.workunit.client.0.smithi070.stdout:7/63: sync 2024-09-20T20:31:39.209 INFO:tasks.workunit.client.0.smithi070.stdout:9/43: sync 2024-09-20T20:31:39.209 INFO:tasks.workunit.client.0.smithi070.stdout:1/128: symlink d4/d1f/l33 0 2024-09-20T20:31:39.210 INFO:tasks.workunit.client.0.smithi070.stdout:7/64: getdents d2/d8 0 2024-09-20T20:31:39.211 INFO:tasks.workunit.client.0.smithi070.stdout:4/157: rename d6/d7/dc/d14 to d6/d26/d34 0 2024-09-20T20:31:39.211 INFO:tasks.workunit.client.0.smithi070.stdout:1/129: getdents d4/d6/d11 0 2024-09-20T20:31:39.211 INFO:tasks.workunit.client.0.smithi070.stdout:2/78: write d3/d5/d9/d10/f11 [748047,58072] 0 2024-09-20T20:31:39.212 INFO:tasks.workunit.client.0.smithi070.stdout:4/158: fdatasync d6/d7/dc/d23/f2c 0 2024-09-20T20:31:39.212 INFO:tasks.workunit.client.0.smithi070.stdout:1/130: mkdir d4/d32/d34 0 2024-09-20T20:31:39.213 INFO:tasks.workunit.client.0.smithi070.stdout:1/131: creat d4/d6/f35 x:0 0 0 2024-09-20T20:31:39.214 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:39.209+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:39.216 INFO:tasks.workunit.client.0.smithi070.stdout:2/79: dread d3/d5/dd/ff [4194304,4194304] 0 2024-09-20T20:31:39.216 INFO:tasks.workunit.client.0.smithi070.stdout:7/65: dwrite d2/d8/f6 [0,4194304] 0 2024-09-20T20:31:39.217 INFO:tasks.workunit.client.0.smithi070.stdout:7/66: write f1 [297560,81536] 0 2024-09-20T20:31:39.217 INFO:tasks.workunit.client.0.smithi070.stdout:7/67: read f1 [1086762,85992] 0 2024-09-20T20:31:39.218 INFO:tasks.workunit.client.0.smithi070.stdout:7/68: creat d2/f15 x:0 0 0 2024-09-20T20:31:39.219 INFO:tasks.workunit.client.0.smithi070.stdout:6/81: read d4/d8/d10/f14 [34636,104101] 0 2024-09-20T20:31:39.221 INFO:tasks.workunit.client.0.smithi070.stdout:2/80: dwrite d3/d5/d9/d10/f11 [0,4194304] 0 2024-09-20T20:31:39.223 INFO:tasks.workunit.client.0.smithi070.stdout:2/81: creat d3/de/d12/d1a/f21 x:0 0 0 2024-09-20T20:31:39.224 INFO:tasks.workunit.client.0.smithi070.stdout:2/82: creat d3/d5/f22 x:0 0 0 2024-09-20T20:31:39.225 INFO:tasks.workunit.client.0.smithi070.stdout:1/132: dread d4/f15 [4194304,4194304] 0 2024-09-20T20:31:39.227 INFO:tasks.workunit.client.0.smithi070.stdout:6/82: dwrite d4/d8/fc [4194304,4194304] 0 2024-09-20T20:31:39.227 INFO:tasks.workunit.client.0.smithi070.stdout:2/83: link d3/lc d3/d5/l23 0 2024-09-20T20:31:39.227 INFO:tasks.workunit.client.0.smithi070.stdout:6/83: stat d4/d8/d17/f1b 0 2024-09-20T20:31:39.227 INFO:tasks.workunit.client.0.smithi070.stdout:2/84: truncate f2 8811929 0 2024-09-20T20:31:39.229 INFO:tasks.workunit.client.0.smithi070.stdout:6/84: truncate f0 1521439 0 2024-09-20T20:31:39.232 INFO:tasks.workunit.client.0.smithi070.stdout:1/133: dwrite d4/d6/d11/f10 [0,4194304] 0 2024-09-20T20:31:39.234 INFO:tasks.workunit.client.0.smithi070.stdout:1/134: creat d4/d6/d11/d2c/f36 x:0 0 0 2024-09-20T20:31:39.234 INFO:tasks.workunit.client.0.smithi070.stdout:2/85: dwrite d3/d5/f14 [0,4194304] 0 2024-09-20T20:31:39.234 INFO:tasks.workunit.client.0.smithi070.stdout:2/86: chown d3/d5/f14 19058 1 2024-09-20T20:31:39.236 INFO:tasks.workunit.client.0.smithi070.stdout:7/69: fsync f1 0 2024-09-20T20:31:39.236 INFO:tasks.workunit.client.0.smithi070.stdout:9/44: dread d1/f7 [0,4194304] 0 2024-09-20T20:31:39.236 INFO:tasks.workunit.client.0.smithi070.stdout:1/135: symlink d4/d1f/l37 0 2024-09-20T20:31:39.236 INFO:tasks.workunit.client.0.smithi070.stdout:7/70: chown f1 716811848 1 2024-09-20T20:31:39.237 INFO:tasks.workunit.client.0.smithi070.stdout:2/87: symlink d3/l24 0 2024-09-20T20:31:39.237 INFO:tasks.workunit.client.0.smithi070.stdout:1/136: creat d4/d6/d11/f38 x:0 0 0 2024-09-20T20:31:39.237 INFO:tasks.workunit.client.0.smithi070.stdout:2/88: symlink d3/de/d12/d1a/l25 0 2024-09-20T20:31:39.239 INFO:tasks.workunit.client.0.smithi070.stdout:2/89: symlink d3/d5/l26 0 2024-09-20T20:31:39.239 INFO:tasks.workunit.client.0.smithi070.stdout:1/137: creat d4/d6/d26/f39 x:0 0 0 2024-09-20T20:31:39.239 INFO:tasks.workunit.client.0.smithi070.stdout:1/138: chown d4/d6/d11 63 1 2024-09-20T20:31:39.239 INFO:tasks.workunit.client.0.smithi070.stdout:2/90: fdatasync d3/d5/f1e 0 2024-09-20T20:31:39.240 INFO:tasks.workunit.client.0.smithi070.stdout:7/71: dread d2/d8/f6 [0,4194304] 0 2024-09-20T20:31:39.241 INFO:tasks.workunit.client.0.smithi070.stdout:2/91: write d3/de/d12/d1a/f21 [836220,22232] 0 2024-09-20T20:31:39.241 INFO:tasks.workunit.client.0.smithi070.stdout:1/139: write d4/d6/d11/f18 [371753,75084] 0 2024-09-20T20:31:39.241 INFO:tasks.workunit.client.0.smithi070.stdout:7/72: readlink d2/lc 0 2024-09-20T20:31:39.241 INFO:tasks.workunit.client.0.smithi070.stdout:2/92: truncate d3/d5/f22 5588 0 2024-09-20T20:31:39.242 INFO:tasks.workunit.client.0.smithi070.stdout:1/140: truncate d4/d6/f29 5303082 0 2024-09-20T20:31:39.242 INFO:tasks.workunit.client.0.smithi070.stdout:7/73: rename d2/d8/f13 to d2/d8/f16 0 2024-09-20T20:31:39.242 INFO:tasks.workunit.client.0.smithi070.stdout:2/93: symlink d3/de/d12/l27 0 2024-09-20T20:31:39.243 INFO:tasks.workunit.client.0.smithi070.stdout:9/45: dwrite d1/f7 [0,4194304] 0 2024-09-20T20:31:39.244 INFO:tasks.workunit.client.0.smithi070.stdout:2/94: truncate d3/d5/d9/d10/f13 1621994 0 2024-09-20T20:31:39.249 INFO:tasks.workunit.client.0.smithi070.stdout:6/85: dwrite d4/f11 [0,4194304] 0 2024-09-20T20:31:39.250 INFO:tasks.workunit.client.0.smithi070.stdout:1/141: dwrite d4/d6/d26/f39 [0,4194304] 0 2024-09-20T20:31:39.251 INFO:tasks.workunit.client.0.smithi070.stdout:7/74: getdents d2/d8 0 2024-09-20T20:31:39.252 INFO:tasks.workunit.client.0.smithi070.stdout:2/95: dwrite d3/d5/dd/f15 [0,4194304] 0 2024-09-20T20:31:39.253 INFO:tasks.workunit.client.0.smithi070.stdout:0/103: sync 2024-09-20T20:31:39.253 INFO:tasks.workunit.client.0.smithi070.stdout:5/50: sync 2024-09-20T20:31:39.253 INFO:tasks.workunit.client.0.smithi070.stdout:3/81: sync 2024-09-20T20:31:39.254 INFO:tasks.workunit.client.0.smithi070.stdout:8/211: sync 2024-09-20T20:31:39.254 INFO:tasks.workunit.client.0.smithi070.stdout:2/96: fdatasync d3/d5/d9/d10/f13 0 2024-09-20T20:31:39.254 INFO:tasks.workunit.client.0.smithi070.stdout:9/46: sync 2024-09-20T20:31:39.254 INFO:tasks.workunit.client.0.smithi070.stdout:8/212: stat d4/f28 0 2024-09-20T20:31:39.254 INFO:tasks.workunit.client.0.smithi070.stdout:0/104: chown d4/f7 5905409 1 2024-09-20T20:31:39.254 INFO:tasks.workunit.client.0.smithi070.stdout:4/159: sync 2024-09-20T20:31:39.254 INFO:tasks.workunit.client.0.smithi070.stdout:9/47: chown d1/f7 347 1 2024-09-20T20:31:39.255 INFO:tasks.workunit.client.0.smithi070.stdout:5/51: rename d2/d4/fd to d2/f13 0 2024-09-20T20:31:39.256 INFO:tasks.workunit.client.0.smithi070.stdout:0/105: chown d4/d8/d12/f14 204503 1 2024-09-20T20:31:39.256 INFO:tasks.workunit.client.0.smithi070.stdout:0/106: sync 2024-09-20T20:31:39.256 INFO:tasks.workunit.client.0.smithi070.stdout:9/48: chown f0 52715066 1 2024-09-20T20:31:39.256 INFO:tasks.workunit.client.0.smithi070.stdout:4/160: symlink d6/d7/dc/d23/l35 0 2024-09-20T20:31:39.256 INFO:tasks.workunit.client.0.smithi070.stdout:5/52: mknod d2/d7/c14 0 2024-09-20T20:31:39.256 INFO:tasks.workunit.client.0.smithi070.stdout:3/82: link d7/f14 d7/d8/d13/f17 0 2024-09-20T20:31:39.257 INFO:tasks.workunit.client.0.smithi070.stdout:9/49: fsync d1/f6 0 2024-09-20T20:31:39.258 INFO:tasks.workunit.client.0.smithi070.stdout:0/107: creat d4/d19/f20 x:0 0 0 2024-09-20T20:31:39.258 INFO:tasks.workunit.client.0.smithi070.stdout:6/86: write d4/f7 [306126,45430] 0 2024-09-20T20:31:39.258 INFO:tasks.workunit.client.0.smithi070.stdout:9/50: mkdir d1/df 0 2024-09-20T20:31:39.258 INFO:tasks.workunit.client.0.smithi070.stdout:5/53: mkdir d2/df/d15 0 2024-09-20T20:31:39.260 INFO:tasks.workunit.client.0.smithi070.stdout:7/75: dwrite d2/d8/f4 [0,4194304] 0 2024-09-20T20:31:39.260 INFO:tasks.workunit.client.0.smithi070.stdout:0/108: mkdir d4/d21 0 2024-09-20T20:31:39.260 INFO:tasks.workunit.client.0.smithi070.stdout:5/54: symlink d2/l16 0 2024-09-20T20:31:39.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/109: chown d4/d8/d12 54411218 1 2024-09-20T20:31:39.261 INFO:tasks.workunit.client.0.smithi070.stdout:8/213: dread d4/f18 [0,4194304] 0 2024-09-20T20:31:39.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/110: chown d4/d8/fb 2044650 1 2024-09-20T20:31:39.261 INFO:tasks.workunit.client.0.smithi070.stdout:9/51: rmdir d1 39 2024-09-20T20:31:39.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/111: fdatasync d4/fd 0 2024-09-20T20:31:39.262 INFO:tasks.workunit.client.0.smithi070.stdout:6/87: unlink d4/d8/fc 0 2024-09-20T20:31:39.262 INFO:tasks.workunit.client.0.smithi070.stdout:7/76: symlink d2/d8/l17 0 2024-09-20T20:31:39.262 INFO:tasks.workunit.client.0.smithi070.stdout:8/214: rmdir d4 39 2024-09-20T20:31:39.262 INFO:tasks.workunit.client.0.smithi070.stdout:7/77: sync 2024-09-20T20:31:39.262 INFO:tasks.workunit.client.0.smithi070.stdout:5/55: creat d2/df/d15/f17 x:0 0 0 2024-09-20T20:31:39.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/112: write f2 [420136,3479] 0 2024-09-20T20:31:39.263 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:39.263 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:39.263 INFO:tasks.workunit.client.0.smithi070.stdout:7/78: chown d2/ce 6033 1 2024-09-20T20:31:39.264 INFO:tasks.workunit.client.0.smithi070.stdout:6/88: mkdir d4/d8/d1e 0 2024-09-20T20:31:39.264 INFO:tasks.workunit.client.0.smithi070.stdout:9/52: symlink d1/df/l10 0 2024-09-20T20:31:39.264 INFO:tasks.workunit.client.0.smithi070.stdout:5/56: mknod d2/d7/c18 0 2024-09-20T20:31:39.266 INFO:tasks.workunit.client.0.smithi070.stdout:5/57: mkdir d2/d4/de/d19 0 2024-09-20T20:31:39.267 INFO:tasks.workunit.client.0.smithi070.stdout:3/83: dwrite d7/f14 [0,4194304] 0 2024-09-20T20:31:39.269 INFO:tasks.workunit.client.0.smithi070.stdout:0/113: truncate d4/d19/f20 958059 0 2024-09-20T20:31:39.269 INFO:tasks.workunit.client.0.smithi070.stdout:3/84: write d7/fd [155607,74113] 0 2024-09-20T20:31:39.270 INFO:tasks.workunit.client.0.smithi070.stdout:1/142: dwrite d4/d6/f14 [0,4194304] 0 2024-09-20T20:31:39.272 INFO:tasks.workunit.client.0.smithi070.stdout:7/79: dread d2/d8/f4 [0,4194304] 0 2024-09-20T20:31:39.272 INFO:tasks.workunit.client.0.smithi070.stdout:6/89: dread d4/f11 [0,4194304] 0 2024-09-20T20:31:39.273 INFO:tasks.workunit.client.0.smithi070.stdout:1/143: mkdir d4/d6/d11/d2c/d3a 0 2024-09-20T20:31:39.274 INFO:tasks.workunit.client.0.smithi070.stdout:8/215: dread d4/d27/d2a/f2b [0,4194304] 0 2024-09-20T20:31:39.274 INFO:tasks.workunit.client.0.smithi070.stdout:9/53: dwrite d1/fe [0,4194304] 0 2024-09-20T20:31:39.274 INFO:tasks.workunit.client.0.smithi070.stdout:3/85: truncate d7/d8/f11 641116 0 2024-09-20T20:31:39.275 INFO:tasks.workunit.client.0.smithi070.stdout:1/144: chown d4/d6/f14 0 1 2024-09-20T20:31:39.276 INFO:tasks.workunit.client.0.smithi070.stdout:9/54: write d1/f7 [4503782,66186] 0 2024-09-20T20:31:39.276 INFO:tasks.workunit.client.0.smithi070.stdout:7/80: rename d2/d8/f4 to d2/d8/f18 0 2024-09-20T20:31:39.276 INFO:tasks.workunit.client.0.smithi070.stdout:2/97: truncate d3/d5/d9/d10/f11 392966 0 2024-09-20T20:31:39.278 INFO:tasks.workunit.client.0.smithi070.stdout:5/58: getdents d2/d4/de 0 2024-09-20T20:31:39.278 INFO:tasks.workunit.client.0.smithi070.stdout:3/86: creat d7/d15/f18 x:0 0 0 2024-09-20T20:31:39.278 INFO:tasks.workunit.client.0.smithi070.stdout:1/145: mkdir d4/d6/d11/d2c/d3b 0 2024-09-20T20:31:39.278 INFO:tasks.workunit.client.0.smithi070.stdout:8/216: mknod d4/d27/d2a/c4f 0 2024-09-20T20:31:39.279 INFO:tasks.workunit.client.0.smithi070.stdout:6/90: link d4/f6 d4/d8/f1f 0 2024-09-20T20:31:39.279 INFO:tasks.workunit.client.0.smithi070.stdout:0/114: dwrite f2 [4194304,4194304] 0 2024-09-20T20:31:39.279 INFO:tasks.workunit.client.0.smithi070.stdout:1/146: mkdir d4/d1f/d3c 0 2024-09-20T20:31:39.279 INFO:tasks.workunit.client.0.smithi070.stdout:1/147: chown d4/d6 25306 1 2024-09-20T20:31:39.280 INFO:tasks.workunit.client.0.smithi070.stdout:8/217: write d4/db/f4a [628962,86778] 0 2024-09-20T20:31:39.282 INFO:tasks.workunit.client.0.smithi070.stdout:1/148: rmdir d4/d1f/d3c 0 2024-09-20T20:31:39.282 INFO:tasks.workunit.client.0.smithi070.stdout:9/55: rename d1/f6 to d1/f11 0 2024-09-20T20:31:39.283 INFO:tasks.workunit.client.0.smithi070.stdout:4/161: dread d6/d26/d34/f21 [0,4194304] 0 2024-09-20T20:31:39.283 INFO:tasks.workunit.client.0.smithi070.stdout:9/56: read d1/f11 [3573277,82179] 0 2024-09-20T20:31:39.285 INFO:tasks.workunit.client.0.smithi070.stdout:9/57: fdatasync d1/fd 0 2024-09-20T20:31:39.285 INFO:tasks.workunit.client.0.smithi070.stdout:1/149: creat d4/d6/d11/d2c/d3b/f3d x:0 0 0 2024-09-20T20:31:39.286 INFO:tasks.workunit.client.0.smithi070.stdout:7/81: dwrite d2/d8/f6 [0,4194304] 0 2024-09-20T20:31:39.287 INFO:tasks.workunit.client.0.smithi070.stdout:1/150: chown d4/d6/f17 96463 1 2024-09-20T20:31:39.288 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:39.289 INFO:tasks.workunit.client.0.smithi070.stdout:4/162: truncate d6/d7/dc/fe 4610179 0 2024-09-20T20:31:39.289 INFO:tasks.workunit.client.0.smithi070.stdout:4/163: sync 2024-09-20T20:31:39.289 INFO:tasks.workunit.client.0.smithi070.stdout:7/82: mkdir d2/d19 0 2024-09-20T20:31:39.289 INFO:tasks.workunit.client.0.smithi070.stdout:0/115: dwrite d4/f5 [0,4194304] 0 2024-09-20T20:31:39.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/59: dwrite d2/f13 [0,4194304] 0 2024-09-20T20:31:39.290 INFO:tasks.workunit.client.0.smithi070.stdout:4/164: write d6/d26/f27 [1067638,11579] 0 2024-09-20T20:31:39.291 INFO:tasks.workunit.client.0.smithi070.stdout:7/83: write d2/f14 [87514,96325] 0 2024-09-20T20:31:39.291 INFO:tasks.workunit.client.0.smithi070.stdout:8/218: dwrite d4/d27/d2a/f21 [0,4194304] 0 2024-09-20T20:31:39.291 INFO:tasks.workunit.client.0.smithi070.stdout:2/98: fsync d3/d5/dd/f15 0 2024-09-20T20:31:39.292 INFO:tasks.workunit.client.0.smithi070.stdout:5/60: chown d2/d7/c18 324164559 1 2024-09-20T20:31:39.292 INFO:tasks.workunit.client.0.smithi070.stdout:1/151: creat d4/d6/d11/d2c/d3b/f3e x:0 0 0 2024-09-20T20:31:39.292 INFO:tasks.workunit.client.0.smithi070.stdout:0/116: symlink d4/d1b/d1c/d1f/l22 0 2024-09-20T20:31:39.295 INFO:tasks.workunit.client.0.smithi070.stdout:0/117: mkdir d4/d8/d12/d23 0 2024-09-20T20:31:39.295 INFO:tasks.workunit.client.0.smithi070.stdout:1/152: rmdir d4/d6/d11/d2c/d3b 39 2024-09-20T20:31:39.296 INFO:tasks.workunit.client.0.smithi070.stdout:9/58: dwrite d1/f5 [0,4194304] 0 2024-09-20T20:31:39.296 INFO:tasks.workunit.client.0.smithi070.stdout:4/165: rename d6/d7/l30 to d6/d26/d34/l36 0 2024-09-20T20:31:39.299 INFO:tasks.workunit.client.0.smithi070.stdout:4/166: readlink d6/d7/dc/d23/l35 0 2024-09-20T20:31:39.301 INFO:tasks.workunit.client.0.smithi070.stdout:9/59: mknod d1/df/c12 0 2024-09-20T20:31:39.301 INFO:tasks.workunit.client.0.smithi070.stdout:2/99: rename d3/d5/f22 to d3/d5/d9/f28 0 2024-09-20T20:31:39.302 INFO:tasks.workunit.client.0.smithi070.stdout:9/60: readlink d1/df/l10 0 2024-09-20T20:31:39.303 INFO:tasks.workunit.client.0.smithi070.stdout:5/61: dwrite d2/d7/f9 [0,4194304] 0 2024-09-20T20:31:39.304 INFO:tasks.workunit.client.0.smithi070.stdout:7/84: dwrite d2/fa [0,4194304] 0 2024-09-20T20:31:39.304 INFO:tasks.workunit.client.0.smithi070.stdout:3/87: dread d7/fd [0,4194304] 0 2024-09-20T20:31:39.304 INFO:tasks.workunit.client.0.smithi070.stdout:8/219: rename d4/d27/d2a/l34 to d4/d27/d2a/d3e/d31/l50 0 2024-09-20T20:31:39.305 INFO:tasks.workunit.client.0.smithi070.stdout:2/100: creat d3/d5/d9/f29 x:0 0 0 2024-09-20T20:31:39.305 INFO:tasks.workunit.client.0.smithi070.stdout:3/88: stat d7/f9 0 2024-09-20T20:31:39.306 INFO:tasks.workunit.client.0.smithi070.stdout:7/85: truncate d2/f10 532532 0 2024-09-20T20:31:39.306 INFO:tasks.workunit.client.0.smithi070.stdout:6/91: dread d4/d8/d10/f1d [0,4194304] 0 2024-09-20T20:31:39.306 INFO:tasks.workunit.client.0.smithi070.stdout:0/118: dwrite d4/f9 [0,4194304] 0 2024-09-20T20:31:39.307 INFO:tasks.workunit.client.0.smithi070.stdout:9/61: mknod d1/c13 0 2024-09-20T20:31:39.308 INFO:tasks.workunit.client.0.smithi070.stdout:5/62: dread - d2/df/d15/f17 zero size 2024-09-20T20:31:39.309 INFO:tasks.workunit.client.0.smithi070.stdout:0/119: read d4/f9 [2932656,2573] 0 2024-09-20T20:31:39.310 INFO:tasks.workunit.client.0.smithi070.stdout:4/167: dwrite d6/d7/dc/d12/f25 [4194304,4194304] 0 2024-09-20T20:31:39.311 INFO:tasks.workunit.client.0.smithi070.stdout:1/153: dwrite d4/d6/d11/f10 [8388608,4194304] 0 2024-09-20T20:31:39.315 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:39.313+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:39.315 INFO:tasks.workunit.client.0.smithi070.stdout:3/89: creat d7/d8/f19 x:0 0 0 2024-09-20T20:31:39.316 INFO:tasks.workunit.client.0.smithi070.stdout:2/101: symlink d3/l2a 0 2024-09-20T20:31:39.318 INFO:tasks.workunit.client.0.smithi070.stdout:1/154: creat d4/d6/d11/f3f x:0 0 0 2024-09-20T20:31:39.319 INFO:tasks.workunit.client.0.smithi070.stdout:7/86: creat d2/d19/f1a x:0 0 0 2024-09-20T20:31:39.319 INFO:tasks.workunit.client.0.smithi070.stdout:6/92: dwrite d4/f13 [0,4194304] 0 2024-09-20T20:31:39.320 INFO:tasks.workunit.client.0.smithi070.stdout:3/90: write f2 [674578,128591] 0 2024-09-20T20:31:39.320 INFO:tasks.workunit.client.0.smithi070.stdout:0/120: dwrite f2 [4194304,4194304] 0 2024-09-20T20:31:39.321 INFO:tasks.workunit.client.0.smithi070.stdout:5/63: dwrite d2/d4/fa [0,4194304] 0 2024-09-20T20:31:39.322 INFO:tasks.workunit.client.0.smithi070.stdout:7/87: rmdir d2/d19 39 2024-09-20T20:31:39.322 INFO:tasks.workunit.client.0.smithi070.stdout:3/91: mkdir d7/d15/d1a 0 2024-09-20T20:31:39.324 INFO:tasks.workunit.client.0.smithi070.stdout:9/62: dwrite d1/f7 [0,4194304] 0 2024-09-20T20:31:39.324 INFO:tasks.workunit.client.0.smithi070.stdout:8/220: getdents d4/d27/d2a/d43 0 2024-09-20T20:31:39.324 INFO:tasks.workunit.client.0.smithi070.stdout:6/93: dread d4/d8/d10/f14 [0,4194304] 0 2024-09-20T20:31:39.324 INFO:tasks.workunit.client.0.smithi070.stdout:9/63: stat d1/fe 0 2024-09-20T20:31:39.324 INFO:tasks.workunit.client.0.smithi070.stdout:4/168: dwrite d6/d26/f27 [0,4194304] 0 2024-09-20T20:31:39.325 INFO:tasks.workunit.client.0.smithi070.stdout:2/102: rename d3/d5/d9/c16 to d3/d5/d9/d1c/c2b 0 2024-09-20T20:31:39.329 INFO:tasks.workunit.client.0.smithi070.stdout:1/155: dread d4/d6/f14 [0,4194304] 0 2024-09-20T20:31:39.330 INFO:tasks.workunit.client.0.smithi070.stdout:8/221: rename d4/d27/d2a/f2b to d4/d27/d2a/d3e/d39/f51 0 2024-09-20T20:31:39.330 INFO:tasks.workunit.client.0.smithi070.stdout:0/121: getdents d4/d19 0 2024-09-20T20:31:39.331 INFO:tasks.workunit.client.0.smithi070.stdout:8/222: rmdir d4/db 39 2024-09-20T20:31:39.331 INFO:tasks.workunit.client.0.smithi070.stdout:4/169: link d6/d7/dc/d20/c22 d6/d7/c37 0 2024-09-20T20:31:39.332 INFO:tasks.workunit.client.0.smithi070.stdout:7/88: dwrite d2/d8/f18 [0,4194304] 0 2024-09-20T20:31:39.332 INFO:tasks.workunit.client.0.smithi070.stdout:5/64: getdents d2/df/d15 0 2024-09-20T20:31:39.335 INFO:tasks.workunit.client.0.smithi070.stdout:8/223: read d4/d27/d2a/f20 [2169162,39889] 0 2024-09-20T20:31:39.335 INFO:tasks.workunit.client.0.smithi070.stdout:7/89: fsync d2/fa 0 2024-09-20T20:31:39.335 INFO:tasks.workunit.client.0.smithi070.stdout:6/94: dwrite d4/f7 [0,4194304] 0 2024-09-20T20:31:39.335 INFO:tasks.workunit.client.0.smithi070.stdout:1/156: creat d4/f40 x:0 0 0 2024-09-20T20:31:39.335 INFO:tasks.workunit.client.0.smithi070.stdout:8/224: dread d4/f25 [0,4194304] 0 2024-09-20T20:31:39.335 INFO:tasks.workunit.client.0.smithi070.stdout:3/92: truncate d7/fd 94253 0 2024-09-20T20:31:39.336 INFO:tasks.workunit.client.0.smithi070.stdout:7/90: rmdir d2/d8 39 2024-09-20T20:31:39.336 INFO:tasks.workunit.client.0.smithi070.stdout:4/170: creat d6/d7/dc/d20/f38 x:0 0 0 2024-09-20T20:31:39.336 INFO:tasks.workunit.client.0.smithi070.stdout:2/103: fsync f2 0 2024-09-20T20:31:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:3/93: write d7/d8/f11 [212494,50606] 0 2024-09-20T20:31:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:5/65: symlink d2/d4/de/d19/l1a 0 2024-09-20T20:31:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:8/225: creat d4/d27/d2a/d3e/d31/f52 x:0 0 0 2024-09-20T20:31:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:7/91: creat d2/f1b x:0 0 0 2024-09-20T20:31:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:5/66: chown d2/d7/f11 83 1 2024-09-20T20:31:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:3/94: dread - d7/d8/f19 zero size 2024-09-20T20:31:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:2/104: mknod d3/d5/d9/d10/c2c 0 2024-09-20T20:31:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:9/64: truncate d1/f11 2562112 0 2024-09-20T20:31:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:6/95: link d4/d8/d17/f1b d4/d8/f20 0 2024-09-20T20:31:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:0/122: dwrite d4/f9 [0,4194304] 0 2024-09-20T20:31:39.342 INFO:tasks.workunit.client.0.smithi070.stdout:8/226: creat d4/d27/f53 x:0 0 0 2024-09-20T20:31:39.342 INFO:tasks.workunit.client.0.smithi070.stdout:1/157: dread f2 [0,4194304] 0 2024-09-20T20:31:39.342 INFO:tasks.workunit.client.0.smithi070.stdout:9/65: fsync d1/fd 0 2024-09-20T20:31:39.343 INFO:tasks.workunit.client.0.smithi070.stdout:5/67: symlink d2/d4/de/d19/l1b 0 2024-09-20T20:31:39.343 INFO:tasks.workunit.client.0.smithi070.stdout:3/95: write f3 [4561716,120841] 0 2024-09-20T20:31:39.344 INFO:tasks.workunit.client.0.smithi070.stdout:6/96: fdatasync d4/d8/f1f 0 2024-09-20T20:31:39.344 INFO:tasks.workunit.client.0.smithi070.stdout:0/123: dread - d4/f16 zero size 2024-09-20T20:31:39.344 INFO:tasks.workunit.client.0.smithi070.stdout:4/171: rename d6/d7/ca to d6/d26/d34/c39 0 2024-09-20T20:31:39.344 INFO:tasks.workunit.client.0.smithi070.stdout:5/68: stat d2 0 2024-09-20T20:31:39.344 INFO:tasks.workunit.client.0.smithi070.stdout:5/69: write d2/d7/f9 [573740,98619] 0 2024-09-20T20:31:39.345 INFO:tasks.workunit.client.0.smithi070.stdout:2/105: symlink d3/d5/d9/d10/l2d 0 2024-09-20T20:31:39.346 INFO:tasks.workunit.client.0.smithi070.stdout:7/92: link d2/fa d2/d8/f1c 0 2024-09-20T20:31:39.346 INFO:tasks.workunit.client.0.smithi070.stdout:0/124: creat d4/d13/f24 x:0 0 0 2024-09-20T20:31:39.346 INFO:tasks.workunit.client.0.smithi070.stdout:9/66: creat d1/f14 x:0 0 0 2024-09-20T20:31:39.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/172: rename d6/d7/dc/d20/c22 to d6/d26/c3a 0 2024-09-20T20:31:39.347 INFO:tasks.workunit.client.0.smithi070.stdout:2/106: creat d3/d5/f2e x:0 0 0 2024-09-20T20:31:39.348 INFO:tasks.workunit.client.0.smithi070.stdout:6/97: symlink d4/d8/d17/l21 0 2024-09-20T20:31:39.348 INFO:tasks.workunit.client.0.smithi070.stdout:4/173: readlink d6/d7/dc/l1b 0 2024-09-20T20:31:39.350 INFO:tasks.workunit.client.0.smithi070.stdout:0/125: rename d4/f17 to d4/d8/d12/f25 0 2024-09-20T20:31:39.351 INFO:tasks.workunit.client.0.smithi070.stdout:3/96: dwrite d7/d15/f18 [0,4194304] 0 2024-09-20T20:31:39.352 INFO:tasks.workunit.client.0.smithi070.stdout:6/98: write d4/d8/f16 [624685,11035] 0 2024-09-20T20:31:39.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/174: creat d6/d7/f3b x:0 0 0 2024-09-20T20:31:39.354 INFO:tasks.workunit.client.0.smithi070.stdout:0/126: write d4/d8/f10 [326404,19715] 0 2024-09-20T20:31:39.355 INFO:tasks.workunit.client.0.smithi070.stdout:3/97: creat d7/f1b x:0 0 0 2024-09-20T20:31:39.355 INFO:tasks.workunit.client.0.smithi070.stdout:5/70: dwrite f1 [0,4194304] 0 2024-09-20T20:31:39.355 INFO:tasks.workunit.client.0.smithi070.stdout:1/158: getdents d4/d32 0 2024-09-20T20:31:39.356 INFO:tasks.workunit.client.0.smithi070.stdout:5/71: mknod d2/c1c 0 2024-09-20T20:31:39.357 INFO:tasks.workunit.client.0.smithi070.stdout:9/67: dread d1/f11 [0,4194304] 0 2024-09-20T20:31:39.357 INFO:tasks.workunit.client.0.smithi070.stdout:4/175: write d6/d7/f3b [640859,63458] 0 2024-09-20T20:31:39.357 INFO:tasks.workunit.client.0.smithi070.stdout:0/127: unlink d4/d19/f20 0 2024-09-20T20:31:39.357 INFO:tasks.workunit.client.0.smithi070.stdout:1/159: dread - d4/d6/f35 zero size 2024-09-20T20:31:39.357 INFO:tasks.workunit.client.0.smithi070.stdout:9/68: symlink d1/df/l15 0 2024-09-20T20:31:39.358 INFO:tasks.workunit.client.0.smithi070.stdout:2/107: dwrite d3/de/f1b [0,4194304] 0 2024-09-20T20:31:39.359 INFO:tasks.workunit.client.0.smithi070.stdout:2/108: stat d3/de/l20 0 2024-09-20T20:31:39.359 INFO:tasks.workunit.client.0.smithi070.stdout:9/69: chown d1/df/l10 27464 1 2024-09-20T20:31:39.359 INFO:tasks.workunit.client.0.smithi070.stdout:4/176: creat d6/d7/dc/d23/f3c x:0 0 0 2024-09-20T20:31:39.362 INFO:tasks.workunit.client.0.smithi070.stdout:0/128: rename d4/d1b/d1c to d4/d8/d12/d23/d26 0 2024-09-20T20:31:39.362 INFO:tasks.workunit.client.0.smithi070.stdout:9/70: creat d1/df/f16 x:0 0 0 2024-09-20T20:31:39.362 INFO:tasks.workunit.client.0.smithi070.stdout:4/177: mkdir d6/d7/dc/d12/d17/d3d 0 2024-09-20T20:31:39.363 INFO:tasks.workunit.client.0.smithi070.stdout:0/129: dread - d4/d8/d12/f25 zero size 2024-09-20T20:31:39.363 INFO:tasks.workunit.client.0.smithi070.stdout:9/71: mknod d1/c17 0 2024-09-20T20:31:39.363 INFO:tasks.workunit.client.0.smithi070.stdout:2/109: rename d3/l24 to d3/l2f 0 2024-09-20T20:31:39.364 INFO:tasks.workunit.client.0.smithi070.stdout:1/160: getdents d4/d6/d11/d2c/d3b 0 2024-09-20T20:31:39.364 INFO:tasks.workunit.client.0.smithi070.stdout:9/72: write d1/fe [4378959,76520] 0 2024-09-20T20:31:39.364 INFO:tasks.workunit.client.0.smithi070.stdout:4/178: creat d6/d7/f3e x:0 0 0 2024-09-20T20:31:39.364 INFO:tasks.workunit.client.0.smithi070.stdout:1/161: fsync d4/d6/f35 0 2024-09-20T20:31:39.365 INFO:tasks.workunit.client.0.smithi070.stdout:9/73: mkdir d1/df/d18 0 2024-09-20T20:31:39.365 INFO:tasks.workunit.client.0.smithi070.stdout:2/110: truncate d3/d5/d9/d10/f13 2139700 0 2024-09-20T20:31:39.365 INFO:tasks.workunit.client.0.smithi070.stdout:1/162: rename d4/d6/d11 to d4/d6/d11/d2c/d41 22 2024-09-20T20:31:39.366 INFO:tasks.workunit.client.0.smithi070.stdout:1/163: creat d4/d6/d11/f42 x:0 0 0 2024-09-20T20:31:39.366 INFO:tasks.workunit.client.0.smithi070.stdout:2/111: link d3/d5/f2e d3/de/d12/d1a/f30 0 2024-09-20T20:31:39.368 INFO:tasks.workunit.client.0.smithi070.stdout:2/112: creat d3/d5/d9/f31 x:0 0 0 2024-09-20T20:31:39.369 INFO:tasks.workunit.client.0.smithi070.stdout:4/179: dread d6/d7/dc/d12/f25 [4194304,4194304] 0 2024-09-20T20:31:39.369 INFO:tasks.workunit.client.0.smithi070.stdout:3/98: truncate d7/fd 397176 0 2024-09-20T20:31:39.370 INFO:tasks.workunit.client.0.smithi070.stdout:7/93: dread d2/f10 [0,4194304] 0 2024-09-20T20:31:39.371 INFO:tasks.workunit.client.0.smithi070.stdout:3/99: write f3 [1505907,28945] 0 2024-09-20T20:31:39.371 INFO:tasks.workunit.client.0.smithi070.stdout:4/180: chown d6/d26/d34/c19 27424 1 2024-09-20T20:31:39.371 INFO:tasks.workunit.client.0.smithi070.stdout:6/99: fsync d4/d8/f16 0 2024-09-20T20:31:39.372 INFO:tasks.workunit.client.0.smithi070.stdout:7/94: link f1 d2/d8/f1d 0 2024-09-20T20:31:39.372 INFO:tasks.workunit.client.0.smithi070.stdout:0/130: rmdir d4/d8/d12/d23/d26 39 2024-09-20T20:31:39.373 INFO:tasks.workunit.client.0.smithi070.stdout:9/74: dwrite d1/f11 [0,4194304] 0 2024-09-20T20:31:39.373 INFO:tasks.workunit.client.0.smithi070.stdout:2/113: truncate d3/d5/d9/d10/f13 2044108 0 2024-09-20T20:31:39.374 INFO:tasks.workunit.client.0.smithi070.stdout:6/100: write d4/d8/fa [3574768,81282] 0 2024-09-20T20:31:39.374 INFO:tasks.workunit.client.0.smithi070.stdout:3/100: truncate d7/f9 796729 0 2024-09-20T20:31:39.375 INFO:tasks.workunit.client.0.smithi070.stdout:7/95: creat d2/f1e x:0 0 0 2024-09-20T20:31:39.376 INFO:tasks.workunit.client.0.smithi070.stdout:6/101: unlink d4/c1c 0 2024-09-20T20:31:39.376 INFO:tasks.workunit.client.0.smithi070.stdout:9/75: creat d1/df/f19 x:0 0 0 2024-09-20T20:31:39.376 INFO:tasks.workunit.client.0.smithi070.stdout:0/131: rename d4/d21 to d4/d8/d27 0 2024-09-20T20:31:39.377 INFO:tasks.workunit.client.0.smithi070.stdout:3/101: mkdir d7/d8/d13/d1c 0 2024-09-20T20:31:39.377 INFO:tasks.workunit.client.0.smithi070.stdout:9/76: write d1/df/f19 [370522,24804] 0 2024-09-20T20:31:39.378 INFO:tasks.workunit.client.0.smithi070.stdout:6/102: rename d4/d8/f16 to d4/d8/d1e/f22 0 2024-09-20T20:31:39.379 INFO:tasks.workunit.client.0.smithi070.stdout:3/102: mkdir d7/d8/d13/d1d 0 2024-09-20T20:31:39.379 INFO:tasks.workunit.client.0.smithi070.stdout:5/72: dwrite d2/d7/fc [0,4194304] 0 2024-09-20T20:31:39.379 INFO:tasks.workunit.client.0.smithi070.stdout:0/132: creat d4/f28 x:0 0 0 2024-09-20T20:31:39.379 INFO:tasks.workunit.client.0.smithi070.stdout:3/103: readlink l6 0 2024-09-20T20:31:39.380 INFO:tasks.workunit.client.0.smithi070.stdout:4/181: truncate d6/d7/f9 1530309 0 2024-09-20T20:31:39.381 INFO:tasks.workunit.client.0.smithi070.stdout:5/73: dread - d2/df/d15/f17 zero size 2024-09-20T20:31:39.382 INFO:tasks.workunit.client.0.smithi070.stdout:0/133: creat d4/d19/f29 x:0 0 0 2024-09-20T20:31:39.382 INFO:tasks.workunit.client.0.smithi070.stdout:6/103: write d4/d8/d10/f14 [621241,129322] 0 2024-09-20T20:31:39.383 INFO:tasks.workunit.client.0.smithi070.stdout:5/74: write d2/f13 [1557353,120372] 0 2024-09-20T20:31:39.383 INFO:tasks.workunit.client.0.smithi070.stdout:3/104: rmdir d7/d8/d13/d1c 0 2024-09-20T20:31:39.386 INFO:tasks.workunit.client.0.smithi070.stdout:0/134: fdatasync d4/d13/f24 0 2024-09-20T20:31:39.386 INFO:tasks.workunit.client.0.smithi070.stdout:4/182: write d6/f11 [616153,26258] 0 2024-09-20T20:31:39.387 INFO:tasks.workunit.client.0.smithi070.stdout:5/75: symlink d2/df/d15/l1d 0 2024-09-20T20:31:39.387 INFO:tasks.workunit.client.0.smithi070.stdout:3/105: chown d7/d8/fc 452 1 2024-09-20T20:31:39.387 INFO:tasks.workunit.client.0.smithi070.stdout:7/96: dwrite d2/fb [0,4194304] 0 2024-09-20T20:31:39.387 INFO:tasks.workunit.client.0.smithi070.stdout:6/104: unlink d4/d8/d17/f1b 0 2024-09-20T20:31:39.388 INFO:tasks.workunit.client.0.smithi070.stdout:9/77: dread d1/fd [0,4194304] 0 2024-09-20T20:31:39.389 INFO:tasks.workunit.client.0.smithi070.stdout:2/114: dwrite d3/d5/d9/d10/f11 [0,4194304] 0 2024-09-20T20:31:39.389 INFO:tasks.workunit.client.0.smithi070.stdout:1/164: dread d4/d6/d11/f24 [0,4194304] 0 2024-09-20T20:31:39.389 INFO:tasks.workunit.client.0.smithi070.stdout:5/76: rmdir d2/df/d15 39 2024-09-20T20:31:39.390 INFO:tasks.workunit.client.0.smithi070.stdout:2/115: dread - d3/de/d12/d1a/f30 zero size 2024-09-20T20:31:39.391 INFO:tasks.workunit.client.0.smithi070.stdout:9/78: creat d1/f1a x:0 0 0 2024-09-20T20:31:39.392 INFO:tasks.workunit.client.0.smithi070.stdout:7/97: rename d2/d8/f1c to d2/d19/f1f 0 2024-09-20T20:31:39.392 INFO:tasks.workunit.client.0.smithi070.stdout:4/183: getdents d6 0 2024-09-20T20:31:39.392 INFO:tasks.workunit.client.0.smithi070.stdout:7/98: chown d2/f14 2219485 1 2024-09-20T20:31:39.393 INFO:tasks.workunit.client.0.smithi070.stdout:0/135: link f2 d4/d8/d12/d23/d26/f2a 0 2024-09-20T20:31:39.393 INFO:tasks.workunit.client.0.smithi070.stdout:1/165: mknod d4/d6/d11/d2c/d3a/c43 0 2024-09-20T20:31:39.393 INFO:tasks.workunit.client.0.smithi070.stdout:2/116: write d3/d5/d9/f31 [172619,77849] 0 2024-09-20T20:31:39.394 INFO:tasks.workunit.client.0.smithi070.stdout:9/79: write d1/df/f19 [251631,45413] 0 2024-09-20T20:31:39.394 INFO:tasks.workunit.client.0.smithi070.stdout:7/99: rmdir d2/d19 39 2024-09-20T20:31:39.394 INFO:tasks.workunit.client.0.smithi070.stdout:0/136: rename d4/d8 to d4/d8/d12/d2b 22 2024-09-20T20:31:39.394 INFO:tasks.workunit.client.0.smithi070.stdout:6/105: dread d4/d8/fa [0,4194304] 0 2024-09-20T20:31:39.394 INFO:tasks.workunit.client.0.smithi070.stdout:9/80: write f0 [2835413,118780] 0 2024-09-20T20:31:39.394 INFO:tasks.workunit.client.0.smithi070.stdout:1/166: truncate d4/d6/d11/d2c/f36 390659 0 2024-09-20T20:31:39.395 INFO:tasks.workunit.client.0.smithi070.stdout:2/117: symlink d3/l32 0 2024-09-20T20:31:39.395 INFO:tasks.workunit.client.0.smithi070.stdout:0/137: rmdir d4 39 2024-09-20T20:31:39.395 INFO:tasks.workunit.client.0.smithi070.stdout:6/106: chown d4/fe 342519 1 2024-09-20T20:31:39.395 INFO:tasks.workunit.client.0.smithi070.stdout:7/100: rename d2 to d2/d19/d20 22 2024-09-20T20:31:39.396 INFO:tasks.workunit.client.0.smithi070.stdout:3/106: truncate d7/fb 2177883 0 2024-09-20T20:31:39.396 INFO:tasks.workunit.client.0.smithi070.stdout:9/81: write d1/fe [841388,122340] 0 2024-09-20T20:31:39.397 INFO:tasks.workunit.client.0.smithi070.stdout:1/167: mkdir d4/d32/d34/d44 0 2024-09-20T20:31:39.397 INFO:tasks.workunit.client.0.smithi070.stdout:0/138: dread - d4/f28 zero size 2024-09-20T20:31:39.398 INFO:tasks.workunit.client.0.smithi070.stdout:5/77: dwrite d2/d7/f11 [0,4194304] 0 2024-09-20T20:31:39.398 INFO:tasks.workunit.client.0.smithi070.stdout:4/184: fdatasync d6/d7/f9 0 2024-09-20T20:31:39.398 INFO:tasks.workunit.client.0.smithi070.stdout:2/118: creat d3/d5/d9/d1c/d1f/f33 x:0 0 0 2024-09-20T20:31:39.400 INFO:tasks.workunit.client.0.smithi070.stdout:1/168: symlink d4/d6/d26/l45 0 2024-09-20T20:31:39.400 INFO:tasks.workunit.client.0.smithi070.stdout:0/139: rmdir d4/d8/d12/d23/d26/d1f 39 2024-09-20T20:31:39.400 INFO:tasks.workunit.client.0.smithi070.stdout:4/185: mknod d6/d26/c3f 0 2024-09-20T20:31:39.400 INFO:tasks.workunit.client.0.smithi070.stdout:2/119: rename d3/de/f19 to d3/d5/f34 0 2024-09-20T20:31:39.401 INFO:tasks.workunit.client.0.smithi070.stdout:0/140: dread - d4/d13/f24 zero size 2024-09-20T20:31:39.401 INFO:tasks.workunit.client.0.smithi070.stdout:5/78: getdents d2/d4/de/d19 0 2024-09-20T20:31:39.402 INFO:tasks.workunit.client.0.smithi070.stdout:5/79: read d2/d7/f9 [1831587,105431] 0 2024-09-20T20:31:39.403 INFO:tasks.workunit.client.0.smithi070.stdout:9/82: dread d1/f7 [0,4194304] 0 2024-09-20T20:31:39.403 INFO:tasks.workunit.client.0.smithi070.stdout:0/141: dread d4/d8/fb [0,4194304] 0 2024-09-20T20:31:39.405 INFO:tasks.workunit.client.0.smithi070.stdout:0/142: dread - d4/d8/d12/f25 zero size 2024-09-20T20:31:39.405 INFO:tasks.workunit.client.0.smithi070.stdout:9/83: creat d1/df/f1b x:0 0 0 2024-09-20T20:31:39.405 INFO:tasks.workunit.client.0.smithi070.stdout:7/101: truncate d2/fb 1002898 0 2024-09-20T20:31:39.405 INFO:tasks.workunit.client.0.smithi070.stdout:3/107: truncate f4 2896422 0 2024-09-20T20:31:39.405 INFO:tasks.workunit.client.0.smithi070.stdout:0/143: creat d4/d8/d27/f2c x:0 0 0 2024-09-20T20:31:39.406 INFO:tasks.workunit.client.0.smithi070.stdout:1/169: dread d4/d6/f29 [0,4194304] 0 2024-09-20T20:31:39.406 INFO:tasks.workunit.client.0.smithi070.stdout:9/84: symlink d1/df/l1c 0 2024-09-20T20:31:39.406 INFO:tasks.workunit.client.0.smithi070.stdout:7/102: symlink d2/d19/l21 0 2024-09-20T20:31:39.406 INFO:tasks.workunit.client.0.smithi070.stdout:0/144: write d4/f16 [293075,37665] 0 2024-09-20T20:31:39.408 INFO:tasks.workunit.client.0.smithi070.stdout:9/85: rename d1/df/l1c to d1/df/d18/l1d 0 2024-09-20T20:31:39.408 INFO:tasks.workunit.client.0.smithi070.stdout:1/170: creat d4/d6/d11/d2c/f46 x:0 0 0 2024-09-20T20:31:39.409 INFO:tasks.workunit.client.0.smithi070.stdout:0/145: mkdir d4/d8/d12/d23/d26/d2d 0 2024-09-20T20:31:39.410 INFO:tasks.workunit.client.0.smithi070.stdout:5/80: dwrite f0 [4194304,4194304] 0 2024-09-20T20:31:39.412 INFO:tasks.workunit.client.0.smithi070.stdout:2/120: dwrite d3/de/d12/d1a/f30 [0,4194304] 0 2024-09-20T20:31:39.412 INFO:tasks.workunit.client.0.smithi070.stdout:0/146: truncate d4/d8/d12/d23/d26/f1e 296641 0 2024-09-20T20:31:39.413 INFO:tasks.workunit.client.0.smithi070.stdout:0/147: chown d4/f16 7941946 1 2024-09-20T20:31:39.414 INFO:tasks.workunit.client.0.smithi070.stdout:1/171: dread f2 [0,4194304] 0 2024-09-20T20:31:39.415 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:39.412+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:39.416 INFO:tasks.workunit.client.0.smithi070.stdout:7/103: write d2/d19/f1f [4043112,70430] 0 2024-09-20T20:31:39.416 INFO:tasks.workunit.client.0.smithi070.stdout:9/86: dwrite d1/f11 [0,4194304] 0 2024-09-20T20:31:39.418 INFO:tasks.workunit.client.0.smithi070.stdout:7/104: creat d2/d8/f22 x:0 0 0 2024-09-20T20:31:39.419 INFO:tasks.workunit.client.0.smithi070.stdout:2/121: dread d3/d5/d9/d10/f11 [0,4194304] 0 2024-09-20T20:31:39.419 INFO:tasks.workunit.client.0.smithi070.stdout:7/105: chown d2/d8/l17 11 1 2024-09-20T20:31:39.420 INFO:tasks.workunit.client.0.smithi070.stdout:1/172: dread d4/d6/f14 [0,4194304] 0 2024-09-20T20:31:39.421 INFO:tasks.workunit.client.0.smithi070.stdout:7/106: symlink d2/d8/l23 0 2024-09-20T20:31:39.422 INFO:tasks.workunit.client.0.smithi070.stdout:2/122: link d3/de/l20 d3/d5/d9/d1c/l35 0 2024-09-20T20:31:39.422 INFO:tasks.workunit.client.0.smithi070.stdout:9/87: dread d1/fd [0,4194304] 0 2024-09-20T20:31:39.422 INFO:tasks.workunit.client.0.smithi070.stdout:7/107: truncate d2/d8/f1d 2177408 0 2024-09-20T20:31:39.422 INFO:tasks.workunit.client.0.smithi070.stdout:1/173: write d4/d6/d26/f39 [999586,54502] 0 2024-09-20T20:31:39.423 INFO:tasks.workunit.client.0.smithi070.stdout:0/148: dwrite d4/f7 [0,4194304] 0 2024-09-20T20:31:39.423 INFO:tasks.workunit.client.0.smithi070.stdout:2/123: rmdir d3/de/d12 39 2024-09-20T20:31:39.424 INFO:tasks.workunit.client.0.smithi070.stdout:1/174: rmdir d4/d6/d11/d2c/d3b 39 2024-09-20T20:31:39.425 INFO:tasks.workunit.client.0.smithi070.stdout:2/124: creat d3/f36 x:0 0 0 2024-09-20T20:31:39.425 INFO:tasks.workunit.client.0.smithi070.stdout:1/175: creat d4/d6/f47 x:0 0 0 2024-09-20T20:31:39.426 INFO:tasks.workunit.client.0.smithi070.stdout:0/149: mkdir d4/d8/d12/d23/d26/d1f/d2e 0 2024-09-20T20:31:39.426 INFO:tasks.workunit.client.0.smithi070.stdout:2/125: dread - d3/f36 zero size 2024-09-20T20:31:39.427 INFO:tasks.workunit.client.0.smithi070.stdout:8/227: dread d4/d27/f40 [4194304,4194304] 0 2024-09-20T20:31:39.427 INFO:tasks.workunit.client.0.smithi070.stdout:5/81: fsync d2/d7/fc 0 2024-09-20T20:31:39.427 INFO:tasks.workunit.client.0.smithi070.stdout:1/176: mkdir d4/d32/d34/d44/d48 0 2024-09-20T20:31:39.428 INFO:tasks.workunit.client.0.smithi070.stdout:2/126: chown d3/d5/d9/d10/l2d 1008292 1 2024-09-20T20:31:39.428 INFO:tasks.workunit.client.0.smithi070.stdout:8/228: stat d4/db/f11 0 2024-09-20T20:31:39.429 INFO:tasks.workunit.client.0.smithi070.stdout:2/127: mkdir d3/d37 0 2024-09-20T20:31:39.429 INFO:tasks.workunit.client.0.smithi070.stdout:1/177: symlink d4/d32/l49 0 2024-09-20T20:31:39.430 INFO:tasks.workunit.client.0.smithi070.stdout:5/82: write d2/fb [431027,113026] 0 2024-09-20T20:31:39.430 INFO:tasks.workunit.client.0.smithi070.stdout:8/229: rename d4/f18 to d4/d27/d42/f54 0 2024-09-20T20:31:39.431 INFO:tasks.workunit.client.0.smithi070.stdout:1/178: write d4/d6/d11/f38 [1011428,111694] 0 2024-09-20T20:31:39.431 INFO:tasks.workunit.client.0.smithi070.stdout:9/88: dwrite d1/f7 [4194304,4194304] 0 2024-09-20T20:31:39.433 INFO:tasks.workunit.client.0.smithi070.stdout:9/89: symlink d1/l1e 0 2024-09-20T20:31:39.433 INFO:tasks.workunit.client.0.smithi070.stdout:1/179: symlink d4/d6/l4a 0 2024-09-20T20:31:39.434 INFO:tasks.workunit.client.0.smithi070.stdout:3/108: dread d7/fb [0,4194304] 0 2024-09-20T20:31:39.434 INFO:tasks.workunit.client.0.smithi070.stdout:9/90: write d1/f5 [2612532,34632] 0 2024-09-20T20:31:39.435 INFO:tasks.workunit.client.0.smithi070.stdout:1/180: write d4/d6/d11/f30 [880919,33155] 0 2024-09-20T20:31:39.436 INFO:tasks.workunit.client.0.smithi070.stdout:0/150: dwrite d4/d8/d12/d23/d26/f1e [0,4194304] 0 2024-09-20T20:31:39.436 INFO:tasks.workunit.client.0.smithi070.stdout:3/109: mkdir d7/d15/d1e 0 2024-09-20T20:31:39.436 INFO:tasks.workunit.client.0.smithi070.stdout:1/181: readlink d4/d6/l1d 0 2024-09-20T20:31:39.436 INFO:tasks.workunit.client.0.smithi070.stdout:9/91: write d1/df/f19 [787764,88072] 0 2024-09-20T20:31:39.438 INFO:tasks.workunit.client.0.smithi070.stdout:9/92: read - d1/f1a zero size 2024-09-20T20:31:39.438 INFO:tasks.workunit.client.0.smithi070.stdout:3/110: mknod d7/d15/d1e/c1f 0 2024-09-20T20:31:39.438 INFO:tasks.workunit.client.0.smithi070.stdout:0/151: truncate d4/d13/f18 188305 0 2024-09-20T20:31:39.438 INFO:tasks.workunit.client.0.smithi070.stdout:1/182: write d4/d6/d11/f3f [213607,8290] 0 2024-09-20T20:31:39.439 INFO:tasks.workunit.client.0.smithi070.stdout:9/93: creat d1/f1f x:0 0 0 2024-09-20T20:31:39.439 INFO:tasks.workunit.client.0.smithi070.stdout:0/152: read d4/d8/fb [143858,68176] 0 2024-09-20T20:31:39.439 INFO:tasks.workunit.client.0.smithi070.stdout:1/183: readlink d4/l23 0 2024-09-20T20:31:39.439 INFO:tasks.workunit.client.0.smithi070.stdout:0/153: readlink d4/lf 0 2024-09-20T20:31:39.440 INFO:tasks.workunit.client.0.smithi070.stdout:1/184: mkdir d4/d32/d34/d44/d4b 0 2024-09-20T20:31:39.441 INFO:tasks.workunit.client.0.smithi070.stdout:0/154: getdents d4/d8/d12/d23/d26/d1f/d2e 0 2024-09-20T20:31:39.441 INFO:tasks.workunit.client.0.smithi070.stdout:2/128: dwrite d3/de/d12/d1a/f21 [0,4194304] 0 2024-09-20T20:31:39.441 INFO:tasks.workunit.client.0.smithi070.stdout:1/185: mkdir d4/d32/d4c 0 2024-09-20T20:31:39.443 INFO:tasks.workunit.client.0.smithi070.stdout:1/186: mkdir d4/d32/d4d 0 2024-09-20T20:31:39.444 INFO:tasks.workunit.client.0.smithi070.stdout:0/155: mknod d4/d8/d12/d23/d26/c2f 0 2024-09-20T20:31:39.444 INFO:tasks.workunit.client.0.smithi070.stdout:2/129: creat d3/f38 x:0 0 0 2024-09-20T20:31:39.444 INFO:tasks.workunit.client.0.smithi070.stdout:7/108: dread d2/d8/f1d [0,4194304] 0 2024-09-20T20:31:39.445 INFO:tasks.workunit.client.0.smithi070.stdout:7/109: rmdir d2/d19 39 2024-09-20T20:31:39.446 INFO:tasks.workunit.client.0.smithi070.stdout:7/110: fsync d2/fb 0 2024-09-20T20:31:39.446 INFO:tasks.workunit.client.0.smithi070.stdout:7/111: chown c0 844 1 2024-09-20T20:31:39.447 INFO:tasks.workunit.client.0.smithi070.stdout:7/112: creat d2/d19/f24 x:0 0 0 2024-09-20T20:31:39.448 INFO:tasks.workunit.client.0.smithi070.stdout:9/94: dwrite d1/f14 [0,4194304] 0 2024-09-20T20:31:39.448 INFO:tasks.workunit.client.0.smithi070.stdout:9/95: dread - d1/f1a zero size 2024-09-20T20:31:39.449 INFO:tasks.workunit.client.0.smithi070.stdout:7/113: mkdir d2/d19/d25 0 2024-09-20T20:31:39.451 INFO:tasks.workunit.client.0.smithi070.stdout:9/96: creat d1/df/d18/f20 x:0 0 0 2024-09-20T20:31:39.451 INFO:tasks.workunit.client.0.smithi070.stdout:7/114: write d2/d8/f1d [1222772,101713] 0 2024-09-20T20:31:39.451 INFO:tasks.workunit.client.0.smithi070.stdout:3/111: truncate d7/f14 1204977 0 2024-09-20T20:31:39.451 INFO:tasks.workunit.client.0.smithi070.stdout:0/156: dwrite d4/d19/f29 [0,4194304] 0 2024-09-20T20:31:39.452 INFO:tasks.workunit.client.0.smithi070.stdout:9/97: chown d1/df/l10 277529 1 2024-09-20T20:31:39.452 INFO:tasks.workunit.client.0.smithi070.stdout:7/115: unlink d2/lc 0 2024-09-20T20:31:39.452 INFO:tasks.workunit.client.0.smithi070.stdout:6/107: sync 2024-09-20T20:31:39.452 INFO:tasks.workunit.client.0.smithi070.stdout:2/130: dwrite d3/d5/f14 [0,4194304] 0 2024-09-20T20:31:39.453 INFO:tasks.workunit.client.0.smithi070.stdout:5/83: sync 2024-09-20T20:31:39.454 INFO:tasks.workunit.client.0.smithi070.stdout:5/84: chown d2/d7/c14 14 1 2024-09-20T20:31:39.456 INFO:tasks.workunit.client.0.smithi070.stdout:0/157: link d4/f16 d4/d8/f30 0 2024-09-20T20:31:39.456 INFO:tasks.workunit.client.0.smithi070.stdout:7/116: creat d2/f26 x:0 0 0 2024-09-20T20:31:39.457 INFO:tasks.workunit.client.0.smithi070.stdout:6/108: chown d4/d8/d17/f1a 1 1 2024-09-20T20:31:39.457 INFO:tasks.workunit.client.0.smithi070.stdout:2/131: creat d3/de/f39 x:0 0 0 2024-09-20T20:31:39.457 INFO:tasks.workunit.client.0.smithi070.stdout:0/158: readlink d4/lf 0 2024-09-20T20:31:39.457 INFO:tasks.workunit.client.0.smithi070.stdout:6/109: fsync d4/f11 0 2024-09-20T20:31:39.458 INFO:tasks.workunit.client.0.smithi070.stdout:3/112: dwrite f2 [0,4194304] 0 2024-09-20T20:31:39.459 INFO:tasks.workunit.client.0.smithi070.stdout:5/85: dread d2/f13 [0,4194304] 0 2024-09-20T20:31:39.461 INFO:tasks.workunit.client.0.smithi070.stdout:6/110: rename d4/d8/d1e/f22 to d4/f23 0 2024-09-20T20:31:39.462 INFO:tasks.workunit.client.0.smithi070.stdout:6/111: creat d4/d8/d17/f24 x:0 0 0 2024-09-20T20:31:39.463 INFO:tasks.workunit.client.0.smithi070.stdout:7/117: dwrite d2/d8/f12 [0,4194304] 0 2024-09-20T20:31:39.464 INFO:tasks.workunit.client.0.smithi070.stdout:7/118: stat d2/d8/f16 0 2024-09-20T20:31:39.464 INFO:tasks.workunit.client.0.smithi070.stdout:5/86: dread d2/fb [0,4194304] 0 2024-09-20T20:31:39.464 INFO:tasks.workunit.client.0.smithi070.stdout:7/119: chown d2/d8/f22 19398977 1 2024-09-20T20:31:39.466 INFO:tasks.workunit.client.0.smithi070.stdout:6/112: dread d4/f13 [0,4194304] 0 2024-09-20T20:31:39.466 INFO:tasks.workunit.client.0.smithi070.stdout:7/120: link d2/f26 d2/d19/f27 0 2024-09-20T20:31:39.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/121: dread d2/d19/f1f [0,4194304] 0 2024-09-20T20:31:39.469 INFO:tasks.workunit.client.0.smithi070.stdout:6/113: dread d4/f23 [0,4194304] 0 2024-09-20T20:31:39.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/122: chown d2/d19/d25 248 1 2024-09-20T20:31:39.470 INFO:tasks.workunit.client.0.smithi070.stdout:7/123: chown d2/d8/l11 92 1 2024-09-20T20:31:39.471 INFO:tasks.workunit.client.0.smithi070.stdout:9/98: truncate d1/f7 971196 0 2024-09-20T20:31:39.472 INFO:tasks.workunit.client.0.smithi070.stdout:2/132: truncate d3/de/d12/d1a/f21 3398651 0 2024-09-20T20:31:39.472 INFO:tasks.workunit.client.0.smithi070.stdout:5/87: truncate d2/d7/f11 580243 0 2024-09-20T20:31:39.472 INFO:tasks.workunit.client.0.smithi070.stdout:9/99: chown d1/f14 17456025 1 2024-09-20T20:31:39.473 INFO:tasks.workunit.client.0.smithi070.stdout:7/124: dread f1 [0,4194304] 0 2024-09-20T20:31:39.473 INFO:tasks.workunit.client.0.smithi070.stdout:3/113: dread d7/f14 [0,4194304] 0 2024-09-20T20:31:39.473 INFO:tasks.workunit.client.0.smithi070.stdout:2/133: truncate d3/de/f39 113404 0 2024-09-20T20:31:39.473 INFO:tasks.workunit.client.0.smithi070.stdout:9/100: symlink d1/df/d18/l21 0 2024-09-20T20:31:39.473 INFO:tasks.workunit.client.0.smithi070.stdout:7/125: symlink d2/d19/l28 0 2024-09-20T20:31:39.474 INFO:tasks.workunit.client.0.smithi070.stdout:9/101: stat d1/f1a 0 2024-09-20T20:31:39.474 INFO:tasks.workunit.client.0.smithi070.stdout:3/114: creat d7/d8/d13/d1d/f20 x:0 0 0 2024-09-20T20:31:39.475 INFO:tasks.workunit.client.0.smithi070.stdout:9/102: getdents d1 0 2024-09-20T20:31:39.475 INFO:tasks.workunit.client.0.smithi070.stdout:3/115: mknod d7/d8/d13/d1d/c21 0 2024-09-20T20:31:39.475 INFO:tasks.workunit.client.0.smithi070.stdout:2/134: link d3/d5/d9/d10/l2d d3/d5/d9/d1c/d1f/l3a 0 2024-09-20T20:31:39.476 INFO:tasks.workunit.client.0.smithi070.stdout:9/103: write d1/f1f [248926,116648] 0 2024-09-20T20:31:39.477 INFO:tasks.workunit.client.0.smithi070.stdout:9/104: rename d1/df/f16 to d1/df/f22 0 2024-09-20T20:31:39.477 INFO:tasks.workunit.client.0.smithi070.stdout:2/135: link d3/d5/l26 d3/d5/l3b 0 2024-09-20T20:31:39.477 INFO:tasks.workunit.client.0.smithi070.stdout:9/105: write d1/f14 [4413198,116552] 0 2024-09-20T20:31:39.478 INFO:tasks.workunit.client.0.smithi070.stdout:7/126: dread d2/d8/f12 [0,4194304] 0 2024-09-20T20:31:39.478 INFO:tasks.workunit.client.0.smithi070.stdout:9/106: creat d1/f23 x:0 0 0 2024-09-20T20:31:39.478 INFO:tasks.workunit.client.0.smithi070.stdout:7/127: mknod d2/d8/c29 0 2024-09-20T20:31:39.479 INFO:tasks.workunit.client.0.smithi070.stdout:9/107: creat d1/f24 x:0 0 0 2024-09-20T20:31:39.480 INFO:tasks.workunit.client.0.smithi070.stdout:5/88: truncate d2/fb 507142 0 2024-09-20T20:31:39.481 INFO:tasks.workunit.client.0.smithi070.stdout:5/89: chown d2/d4/de/d19/l1b 1617 1 2024-09-20T20:31:39.481 INFO:tasks.workunit.client.0.smithi070.stdout:2/136: dread d3/d5/dd/f15 [0,4194304] 0 2024-09-20T20:31:39.483 INFO:tasks.workunit.client.0.smithi070.stdout:7/128: truncate d2/d8/f12 2695260 0 2024-09-20T20:31:39.483 INFO:tasks.workunit.client.0.smithi070.stdout:5/90: unlink d2/df/d15/f17 0 2024-09-20T20:31:39.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/116: write f4 [2615199,99331] 0 2024-09-20T20:31:39.483 INFO:tasks.workunit.client.0.smithi070.stdout:2/137: write d3/f38 [836105,122853] 0 2024-09-20T20:31:39.484 INFO:tasks.workunit.client.0.smithi070.stdout:5/91: creat d2/d4/f1e x:0 0 0 2024-09-20T20:31:39.484 INFO:tasks.workunit.client.0.smithi070.stdout:7/129: mkdir d2/d19/d25/d2a 0 2024-09-20T20:31:39.484 INFO:tasks.workunit.client.0.smithi070.stdout:9/108: dread d1/fe [0,4194304] 0 2024-09-20T20:31:39.485 INFO:tasks.workunit.client.0.smithi070.stdout:5/92: rmdir d2/d4/de/d19 39 2024-09-20T20:31:39.485 INFO:tasks.workunit.client.0.smithi070.stdout:9/109: mkdir d1/df/d25 0 2024-09-20T20:31:39.485 INFO:tasks.workunit.client.0.smithi070.stdout:2/138: link d3/d5/f14 d3/d5/d9/d1c/d1f/f3c 0 2024-09-20T20:31:39.487 INFO:tasks.workunit.client.0.smithi070.stdout:2/139: creat d3/de/d12/d1a/f3d x:0 0 0 2024-09-20T20:31:39.487 INFO:tasks.workunit.client.0.smithi070.stdout:5/93: getdents d2/d4/de 0 2024-09-20T20:31:39.491 INFO:tasks.workunit.client.0.smithi070.stdout:1/187: dread d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:39.491 INFO:tasks.workunit.client.0.smithi070.stdout:3/117: dwrite d7/f1b [0,4194304] 0 2024-09-20T20:31:39.492 INFO:tasks.workunit.client.0.smithi070.stdout:7/130: dwrite d2/f1b [0,4194304] 0 2024-09-20T20:31:39.493 INFO:tasks.workunit.client.0.smithi070.stdout:7/131: truncate d2/d19/f24 882354 0 2024-09-20T20:31:39.494 INFO:tasks.workunit.client.0.smithi070.stdout:2/140: dread d3/d5/f2e [0,4194304] 0 2024-09-20T20:31:39.494 INFO:tasks.workunit.client.0.smithi070.stdout:5/94: dwrite f1 [0,4194304] 0 2024-09-20T20:31:39.495 INFO:tasks.workunit.client.0.smithi070.stdout:5/95: fsync d2/d4/fa 0 2024-09-20T20:31:39.496 INFO:tasks.workunit.client.0.smithi070.stdout:7/132: symlink d2/d19/l2b 0 2024-09-20T20:31:39.496 INFO:tasks.workunit.client.0.smithi070.stdout:1/188: symlink d4/d6/d11/d2c/d3b/l4e 0 2024-09-20T20:31:39.496 INFO:tasks.workunit.client.0.smithi070.stdout:7/133: truncate d2/f14 554451 0 2024-09-20T20:31:39.497 INFO:tasks.workunit.client.0.smithi070.stdout:1/189: dread - d4/d6/d11/d2c/d3b/f3d zero size 2024-09-20T20:31:39.497 INFO:tasks.workunit.client.0.smithi070.stdout:7/134: dread - d2/d8/f22 zero size 2024-09-20T20:31:39.498 INFO:tasks.workunit.client.0.smithi070.stdout:1/190: write d4/d6/d26/f39 [4821193,56346] 0 2024-09-20T20:31:39.500 INFO:tasks.workunit.client.0.smithi070.stdout:1/191: symlink d4/d32/l4f 0 2024-09-20T20:31:39.501 INFO:tasks.workunit.client.0.smithi070.stdout:5/96: dread d2/d7/fc [4194304,4194304] 0 2024-09-20T20:31:39.502 INFO:tasks.workunit.client.0.smithi070.stdout:9/110: dwrite d1/f7 [0,4194304] 0 2024-09-20T20:31:39.504 INFO:tasks.workunit.client.0.smithi070.stdout:9/111: rename d1/f23 to d1/f26 0 2024-09-20T20:31:39.504 INFO:tasks.workunit.client.0.smithi070.stdout:2/141: dwrite d3/d5/d9/d1c/d1f/f3c [0,4194304] 0 2024-09-20T20:31:39.504 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:39.504 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:39.505 INFO:tasks.workunit.client.0.smithi070.stdout:2/142: stat f2 0 2024-09-20T20:31:39.506 INFO:tasks.workunit.client.0.smithi070.stdout:1/192: rename d4/d32/l49 to d4/d6/d11/d2c/l50 0 2024-09-20T20:31:39.506 INFO:tasks.workunit.client.0.smithi070.stdout:2/143: mkdir d3/d5/d9/d1c/d1f/d3e 0 2024-09-20T20:31:39.506 INFO:tasks.workunit.client.0.smithi070.stdout:9/112: write d1/fe [4285283,118057] 0 2024-09-20T20:31:39.507 INFO:tasks.workunit.client.0.smithi070.stdout:1/193: creat d4/d1f/f51 x:0 0 0 2024-09-20T20:31:39.508 INFO:tasks.workunit.client.0.smithi070.stdout:7/135: dwrite d2/f10 [0,4194304] 0 2024-09-20T20:31:39.509 INFO:tasks.workunit.client.0.smithi070.stdout:1/194: read - d4/d6/f7 zero size 2024-09-20T20:31:39.509 INFO:tasks.workunit.client.0.smithi070.stdout:7/136: readlink d2/d19/l21 0 2024-09-20T20:31:39.510 INFO:tasks.workunit.client.0.smithi070.stdout:5/97: dwrite f0 [8388608,4194304] 0 2024-09-20T20:31:39.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/195: creat d4/d6/f52 x:0 0 0 2024-09-20T20:31:39.511 INFO:tasks.workunit.client.0.smithi070.stdout:7/137: symlink d2/d8/l2c 0 2024-09-20T20:31:39.512 INFO:tasks.workunit.client.0.smithi070.stdout:8/230: sync 2024-09-20T20:31:39.512 INFO:tasks.workunit.client.0.smithi070.stdout:4/186: sync 2024-09-20T20:31:39.512 INFO:tasks.workunit.client.0.smithi070.stdout:9/113: symlink d1/df/d18/l27 0 2024-09-20T20:31:39.512 INFO:tasks.workunit.client.0.smithi070.stdout:0/159: sync 2024-09-20T20:31:39.512 INFO:tasks.workunit.client.0.smithi070.stdout:3/118: sync 2024-09-20T20:31:39.512 INFO:tasks.workunit.client.0.smithi070.stdout:6/114: sync 2024-09-20T20:31:39.512 INFO:tasks.workunit.client.0.smithi070.stdout:1/196: symlink d4/l53 0 2024-09-20T20:31:39.513 INFO:tasks.workunit.client.0.smithi070.stdout:7/138: mknod d2/d8/c2d 0 2024-09-20T20:31:39.513 INFO:tasks.workunit.client.0.smithi070.stdout:0/160: chown d4/d8/fc 905 1 2024-09-20T20:31:39.513 INFO:tasks.workunit.client.0.smithi070.stdout:2/144: dread d3/d5/f14 [0,4194304] 0 2024-09-20T20:31:39.513 INFO:tasks.workunit.client.0.smithi070.stdout:1/197: write d4/d6/f7 [282992,71308] 0 2024-09-20T20:31:39.514 INFO:tasks.workunit.client.0.smithi070.stdout:0/161: write d4/d8/d12/d23/d26/f1e [4341189,95944] 0 2024-09-20T20:31:39.515 INFO:tasks.workunit.client.0.smithi070.stdout:9/114: dread - d1/df/f22 zero size 2024-09-20T20:31:39.515 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:39.513+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:39.516 INFO:tasks.workunit.client.0.smithi070.stdout:3/119: mknod d7/d8/d13/d1d/c22 0 2024-09-20T20:31:39.516 INFO:tasks.workunit.client.0.smithi070.stdout:5/98: getdents d2/d7 0 2024-09-20T20:31:39.516 INFO:tasks.workunit.client.0.smithi070.stdout:3/120: sync 2024-09-20T20:31:39.516 INFO:tasks.workunit.client.0.smithi070.stdout:2/145: creat d3/de/d12/d1a/f3f x:0 0 0 2024-09-20T20:31:39.516 INFO:tasks.workunit.client.0.smithi070.stdout:6/115: creat d4/d8/f25 x:0 0 0 2024-09-20T20:31:39.517 INFO:tasks.workunit.client.0.smithi070.stdout:5/99: symlink d2/l1f 0 2024-09-20T20:31:39.519 INFO:tasks.workunit.client.0.smithi070.stdout:0/162: getdents d4/d8/d12/d23/d26/d1d 0 2024-09-20T20:31:39.519 INFO:tasks.workunit.client.0.smithi070.stdout:9/115: write d1/df/f22 [717581,62917] 0 2024-09-20T20:31:39.521 INFO:tasks.workunit.client.0.smithi070.stdout:6/116: creat d4/d8/d1e/f26 x:0 0 0 2024-09-20T20:31:39.521 INFO:tasks.workunit.client.0.smithi070.stdout:5/100: dread d2/d7/f11 [0,4194304] 0 2024-09-20T20:31:39.522 INFO:tasks.workunit.client.0.smithi070.stdout:2/146: mknod d3/d5/d9/d1c/d1f/d3e/c40 0 2024-09-20T20:31:39.522 INFO:tasks.workunit.client.0.smithi070.stdout:7/139: dread d2/d19/f24 [0,4194304] 0 2024-09-20T20:31:39.523 INFO:tasks.workunit.client.0.smithi070.stdout:8/231: dwrite d4/d27/d2a/d43/f45 [0,4194304] 0 2024-09-20T20:31:39.523 INFO:tasks.workunit.client.0.smithi070.stdout:6/117: fdatasync d4/f11 0 2024-09-20T20:31:39.523 INFO:tasks.workunit.client.0.smithi070.stdout:9/116: creat d1/df/f28 x:0 0 0 2024-09-20T20:31:39.524 INFO:tasks.workunit.client.0.smithi070.stdout:5/101: symlink d2/d4/de/l20 0 2024-09-20T20:31:39.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/187: dwrite d6/d7/f3b [0,4194304] 0 2024-09-20T20:31:39.524 INFO:tasks.workunit.client.0.smithi070.stdout:2/147: mknod d3/de/d12/d1a/c41 0 2024-09-20T20:31:39.525 INFO:tasks.workunit.client.0.smithi070.stdout:0/163: readlink d4/d8/d12/d23/d26/d1f/l22 0 2024-09-20T20:31:39.525 INFO:tasks.workunit.client.0.smithi070.stdout:1/198: dwrite d4/d1f/f51 [0,4194304] 0 2024-09-20T20:31:39.526 INFO:tasks.workunit.client.0.smithi070.stdout:4/188: dread - d6/d7/dc/d20/f38 zero size 2024-09-20T20:31:39.526 INFO:tasks.workunit.client.0.smithi070.stdout:7/140: mkdir d2/d19/d2e 0 2024-09-20T20:31:39.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:39.528 INFO:tasks.workunit.client.0.smithi070.stdout:4/189: readlink d6/d7/dc/d12/l31 0 2024-09-20T20:31:39.528 INFO:tasks.workunit.client.0.smithi070.stdout:1/199: dread - d4/d6/d11/d2c/f46 zero size 2024-09-20T20:31:39.528 INFO:tasks.workunit.client.0.smithi070.stdout:6/118: symlink d4/d8/d1e/l27 0 2024-09-20T20:31:39.528 INFO:tasks.workunit.client.0.smithi070.stdout:2/148: mkdir d3/d5/d9/d42 0 2024-09-20T20:31:39.528 INFO:tasks.workunit.client.0.smithi070.stdout:0/164: truncate d4/d8/d12/d23/d26/f2a 8632315 0 2024-09-20T20:31:39.528 INFO:tasks.workunit.client.0.smithi070.stdout:9/117: mknod d1/df/d25/c29 0 2024-09-20T20:31:39.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/200: fsync d4/d6/d11/d2c/d3b/f3e 0 2024-09-20T20:31:39.529 INFO:tasks.workunit.client.0.smithi070.stdout:6/119: fdatasync d4/f7 0 2024-09-20T20:31:39.529 INFO:tasks.workunit.client.0.smithi070.stdout:7/141: symlink d2/d19/d25/d2a/l2f 0 2024-09-20T20:31:39.530 INFO:tasks.workunit.client.0.smithi070.stdout:4/190: mkdir d6/d26/d34/d40 0 2024-09-20T20:31:39.530 INFO:tasks.workunit.client.0.smithi070.stdout:1/201: fdatasync d4/d6/d11/d2c/f46 0 2024-09-20T20:31:39.531 INFO:tasks.workunit.client.0.smithi070.stdout:3/121: dwrite d7/fb [0,4194304] 0 2024-09-20T20:31:39.531 INFO:tasks.workunit.client.0.smithi070.stdout:1/202: write d4/d1f/f51 [1247238,46213] 0 2024-09-20T20:31:39.532 INFO:tasks.workunit.client.0.smithi070.stdout:3/122: sync 2024-09-20T20:31:39.532 INFO:tasks.workunit.client.0.smithi070.stdout:5/102: creat d2/df/f21 x:0 0 0 2024-09-20T20:31:39.534 INFO:tasks.workunit.client.0.smithi070.stdout:1/203: chown d4/d32/d34/d44/d48 204471 1 2024-09-20T20:31:39.535 INFO:tasks.workunit.client.0.smithi070.stdout:0/165: symlink d4/d8/d12/d23/d26/d1d/l31 0 2024-09-20T20:31:39.535 INFO:tasks.workunit.client.0.smithi070.stdout:3/123: mkdir d7/d15/d23 0 2024-09-20T20:31:39.536 INFO:tasks.workunit.client.0.smithi070.stdout:8/232: truncate f0 7956510 0 2024-09-20T20:31:39.536 INFO:tasks.workunit.client.0.smithi070.stdout:7/142: mkdir d2/d30 0 2024-09-20T20:31:39.536 INFO:tasks.workunit.client.0.smithi070.stdout:4/191: symlink d6/d7/l41 0 2024-09-20T20:31:39.537 INFO:tasks.workunit.client.0.smithi070.stdout:6/120: creat d4/d8/f28 x:0 0 0 2024-09-20T20:31:39.537 INFO:tasks.workunit.client.0.smithi070.stdout:1/204: rmdir d4/d32/d4c 0 2024-09-20T20:31:39.537 INFO:tasks.workunit.client.0.smithi070.stdout:9/118: dwrite f0 [0,4194304] 0 2024-09-20T20:31:39.538 INFO:tasks.workunit.client.0.smithi070.stdout:0/166: chown d4/d8/d12/l1a 5885524 1 2024-09-20T20:31:39.538 INFO:tasks.workunit.client.0.smithi070.stdout:8/233: rmdir d4/d27/d2a/d3e/d39 39 2024-09-20T20:31:39.539 INFO:tasks.workunit.client.0.smithi070.stdout:4/192: mknod d6/d7/dc/d12/c42 0 2024-09-20T20:31:39.539 INFO:tasks.workunit.client.0.smithi070.stdout:6/121: symlink d4/d8/d1e/l29 0 2024-09-20T20:31:39.539 INFO:tasks.workunit.client.0.smithi070.stdout:1/205: write d4/d6/d11/d2c/d3b/f3d [615710,104289] 0 2024-09-20T20:31:39.540 INFO:tasks.workunit.client.0.smithi070.stdout:2/149: dwrite d3/d5/d9/f31 [0,4194304] 0 2024-09-20T20:31:39.540 INFO:tasks.workunit.client.0.smithi070.stdout:3/124: dread d7/d8/d13/f17 [0,4194304] 0 2024-09-20T20:31:39.540 INFO:tasks.workunit.client.0.smithi070.stdout:6/122: readlink d4/d8/d1e/l29 0 2024-09-20T20:31:39.541 INFO:tasks.workunit.client.0.smithi070.stdout:9/119: write d1/f24 [129408,115260] 0 2024-09-20T20:31:39.542 INFO:tasks.workunit.client.0.smithi070.stdout:6/123: chown d4/f6 30962 1 2024-09-20T20:31:39.542 INFO:tasks.workunit.client.0.smithi070.stdout:3/125: creat d7/d8/f24 x:0 0 0 2024-09-20T20:31:39.542 INFO:tasks.workunit.client.0.smithi070.stdout:0/167: symlink d4/d8/d12/d23/d26/d1f/l32 0 2024-09-20T20:31:39.542 INFO:tasks.workunit.client.0.smithi070.stdout:1/206: readlink d4/l16 0 2024-09-20T20:31:39.542 INFO:tasks.workunit.client.0.smithi070.stdout:2/150: chown d3/de/l20 478696 1 2024-09-20T20:31:39.542 INFO:tasks.workunit.client.0.smithi070.stdout:5/103: truncate d2/f13 71643 0 2024-09-20T20:31:39.543 INFO:tasks.workunit.client.0.smithi070.stdout:8/234: getdents d4/d27/d42 0 2024-09-20T20:31:39.543 INFO:tasks.workunit.client.0.smithi070.stdout:4/193: rename d6/d7/dc/d12/d17/d3d to d6/d43 0 2024-09-20T20:31:39.543 INFO:tasks.workunit.client.0.smithi070.stdout:3/126: mknod d7/d15/d23/c25 0 2024-09-20T20:31:39.544 INFO:tasks.workunit.client.0.smithi070.stdout:6/124: read d4/d8/f1f [657366,35133] 0 2024-09-20T20:31:39.544 INFO:tasks.workunit.client.0.smithi070.stdout:0/168: creat d4/d8/d12/d23/d26/f33 x:0 0 0 2024-09-20T20:31:39.544 INFO:tasks.workunit.client.0.smithi070.stdout:9/120: truncate d1/fe 5382869 0 2024-09-20T20:31:39.544 INFO:tasks.workunit.client.0.smithi070.stdout:0/169: readlink d4/l6 0 2024-09-20T20:31:39.545 INFO:tasks.workunit.client.0.smithi070.stdout:8/235: write d4/d27/d42/f44 [804727,29685] 0 2024-09-20T20:31:39.545 INFO:tasks.workunit.client.0.smithi070.stdout:3/127: creat d7/d8/d13/f26 x:0 0 0 2024-09-20T20:31:39.545 INFO:tasks.workunit.client.0.smithi070.stdout:9/121: creat d1/f2a x:0 0 0 2024-09-20T20:31:39.546 INFO:tasks.workunit.client.0.smithi070.stdout:3/128: chown d7/d8/f24 599101 1 2024-09-20T20:31:39.546 INFO:tasks.workunit.client.0.smithi070.stdout:9/122: mknod d1/df/c2b 0 2024-09-20T20:31:39.547 INFO:tasks.workunit.client.0.smithi070.stdout:6/125: link d4/d8/d10/f15 d4/f2a 0 2024-09-20T20:31:39.547 INFO:tasks.workunit.client.0.smithi070.stdout:0/170: write d4/fd [443385,51088] 0 2024-09-20T20:31:39.547 INFO:tasks.workunit.client.0.smithi070.stdout:9/123: chown d1/f14 29090954 1 2024-09-20T20:31:39.547 INFO:tasks.workunit.client.0.smithi070.stdout:8/236: creat d4/d27/d2a/d3e/f55 x:0 0 0 2024-09-20T20:31:39.548 INFO:tasks.workunit.client.0.smithi070.stdout:3/129: link d7/d8/f19 d7/d15/d23/f27 0 2024-09-20T20:31:39.548 INFO:tasks.workunit.client.0.smithi070.stdout:9/124: read - d1/f2a zero size 2024-09-20T20:31:39.549 INFO:tasks.workunit.client.0.smithi070.stdout:6/126: truncate d4/d8/d17/f24 325965 0 2024-09-20T20:31:39.549 INFO:tasks.workunit.client.0.smithi070.stdout:2/151: dread d3/de/f18 [0,4194304] 0 2024-09-20T20:31:39.549 INFO:tasks.workunit.client.0.smithi070.stdout:3/130: chown d7/d8/fc 940837 1 2024-09-20T20:31:39.549 INFO:tasks.workunit.client.0.smithi070.stdout:7/143: dwrite d2/d19/f27 [0,4194304] 0 2024-09-20T20:31:39.550 INFO:tasks.workunit.client.0.smithi070.stdout:3/131: chown d7/d15/d1a 11333 1 2024-09-20T20:31:39.550 INFO:tasks.workunit.client.0.smithi070.stdout:6/127: creat d4/d8/d10/f2b x:0 0 0 2024-09-20T20:31:39.550 INFO:tasks.workunit.client.0.smithi070.stdout:2/152: unlink d3/d5/d9/f28 0 2024-09-20T20:31:39.551 INFO:tasks.workunit.client.0.smithi070.stdout:8/237: creat d4/d27/d2a/d3e/f56 x:0 0 0 2024-09-20T20:31:39.551 INFO:tasks.workunit.client.0.smithi070.stdout:0/171: getdents d4/d8/d12/d23 0 2024-09-20T20:31:39.551 INFO:tasks.workunit.client.0.smithi070.stdout:7/144: mkdir d2/d8/d31 0 2024-09-20T20:31:39.551 INFO:tasks.workunit.client.0.smithi070.stdout:2/153: symlink d3/d5/dd/l43 0 2024-09-20T20:31:39.551 INFO:tasks.workunit.client.0.smithi070.stdout:0/172: symlink d4/d13/l34 0 2024-09-20T20:31:39.552 INFO:tasks.workunit.client.0.smithi070.stdout:8/238: symlink d4/d27/d2a/l57 0 2024-09-20T20:31:39.552 INFO:tasks.workunit.client.0.smithi070.stdout:0/173: chown f2 6376 1 2024-09-20T20:31:39.552 INFO:tasks.workunit.client.0.smithi070.stdout:8/239: symlink d4/d27/l58 0 2024-09-20T20:31:39.553 INFO:tasks.workunit.client.0.smithi070.stdout:7/145: getdents d2/d19 0 2024-09-20T20:31:39.553 INFO:tasks.workunit.client.0.smithi070.stdout:0/174: unlink d4/f28 0 2024-09-20T20:31:39.556 INFO:tasks.workunit.client.0.smithi070.stdout:2/154: rename d3/d5/d9/d1c/d1f/l3a to d3/d5/l44 0 2024-09-20T20:31:39.557 INFO:tasks.workunit.client.0.smithi070.stdout:5/104: truncate f0 12446551 0 2024-09-20T20:31:39.558 INFO:tasks.workunit.client.0.smithi070.stdout:8/240: link d4/f28 d4/d27/d2a/d43/f59 0 2024-09-20T20:31:39.558 INFO:tasks.workunit.client.0.smithi070.stdout:0/175: symlink d4/d8/d12/d23/d26/d1f/d2e/l35 0 2024-09-20T20:31:39.558 INFO:tasks.workunit.client.0.smithi070.stdout:9/125: dread d1/fe [0,4194304] 0 2024-09-20T20:31:39.559 INFO:tasks.workunit.client.0.smithi070.stdout:2/155: chown d3/d5/d9/f29 38714653 1 2024-09-20T20:31:39.559 INFO:tasks.workunit.client.0.smithi070.stdout:5/105: read d2/d4/fa [906114,69074] 0 2024-09-20T20:31:39.560 INFO:tasks.workunit.client.0.smithi070.stdout:6/128: dwrite d4/fe [0,4194304] 0 2024-09-20T20:31:39.560 INFO:tasks.workunit.client.0.smithi070.stdout:0/176: rmdir d4/d13 39 2024-09-20T20:31:39.561 INFO:tasks.workunit.client.0.smithi070.stdout:3/132: dwrite d7/d8/d13/d1d/f20 [0,4194304] 0 2024-09-20T20:31:39.561 INFO:tasks.workunit.client.0.smithi070.stdout:5/106: read - d2/d4/f1e zero size 2024-09-20T20:31:39.561 INFO:tasks.workunit.client.0.smithi070.stdout:8/241: symlink d4/d27/d2a/d43/l5a 0 2024-09-20T20:31:39.561 INFO:tasks.workunit.client.0.smithi070.stdout:6/129: dread - d4/d8/d10/f2b zero size 2024-09-20T20:31:39.562 INFO:tasks.workunit.client.0.smithi070.stdout:3/133: readlink l1 0 2024-09-20T20:31:39.563 INFO:tasks.workunit.client.0.smithi070.stdout:7/146: dwrite d2/d19/f1a [0,4194304] 0 2024-09-20T20:31:39.563 INFO:tasks.workunit.client.0.smithi070.stdout:8/242: mkdir d4/d27/d2a/d5b 0 2024-09-20T20:31:39.564 INFO:tasks.workunit.client.0.smithi070.stdout:2/156: rename d3/d5/l3b to d3/d5/d9/d1c/d1f/d3e/l45 0 2024-09-20T20:31:39.564 INFO:tasks.workunit.client.0.smithi070.stdout:6/130: mknod d4/d8/c2c 0 2024-09-20T20:31:39.564 INFO:tasks.workunit.client.0.smithi070.stdout:7/147: symlink d2/d19/l32 0 2024-09-20T20:31:39.565 INFO:tasks.workunit.client.0.smithi070.stdout:3/134: getdents d7 0 2024-09-20T20:31:39.565 INFO:tasks.workunit.client.0.smithi070.stdout:7/148: chown d2/d8 1686085102 1 2024-09-20T20:31:39.565 INFO:tasks.workunit.client.0.smithi070.stdout:2/157: creat d3/de/d12/d1a/f46 x:0 0 0 2024-09-20T20:31:39.566 INFO:tasks.workunit.client.0.smithi070.stdout:7/149: write d2/d19/f27 [4848189,76905] 0 2024-09-20T20:31:39.566 INFO:tasks.workunit.client.0.smithi070.stdout:3/135: symlink d7/d15/d1e/l28 0 2024-09-20T20:31:39.567 INFO:tasks.workunit.client.0.smithi070.stdout:9/126: dread d1/f24 [0,4194304] 0 2024-09-20T20:31:39.567 INFO:tasks.workunit.client.0.smithi070.stdout:2/158: rmdir d3/de/d12 39 2024-09-20T20:31:39.567 INFO:tasks.workunit.client.0.smithi070.stdout:2/159: truncate f2 9360251 0 2024-09-20T20:31:39.567 INFO:tasks.workunit.client.0.smithi070.stdout:7/150: creat d2/d8/f33 x:0 0 0 2024-09-20T20:31:39.573 INFO:tasks.workunit.client.0.smithi070.stdout:0/177: read d4/f5 [3178448,7917] 0 2024-09-20T20:31:39.574 INFO:tasks.workunit.client.0.smithi070.stdout:6/131: dwrite d4/d8/d10/f2b [0,4194304] 0 2024-09-20T20:31:39.575 INFO:tasks.workunit.client.0.smithi070.stdout:3/136: dwrite f2 [0,4194304] 0 2024-09-20T20:31:39.575 INFO:tasks.workunit.client.0.smithi070.stdout:0/178: write d4/f11 [3504150,56595] 0 2024-09-20T20:31:39.580 INFO:tasks.workunit.client.0.smithi070.stdout:9/127: dwrite d1/df/f1b [0,4194304] 0 2024-09-20T20:31:39.580 INFO:tasks.workunit.client.0.smithi070.stdout:2/160: dwrite d3/d5/dd/f15 [4194304,4194304] 0 2024-09-20T20:31:39.580 INFO:tasks.workunit.client.0.smithi070.stdout:0/179: rename d4/d8/d12 to d4/d8/d12/d36 22 2024-09-20T20:31:39.580 INFO:tasks.workunit.client.0.smithi070.stdout:9/128: fsync d1/f7 0 2024-09-20T20:31:39.580 INFO:tasks.workunit.client.0.smithi070.stdout:0/180: write d4/f9 [5221144,44630] 0 2024-09-20T20:31:39.580 INFO:tasks.workunit.client.0.smithi070.stdout:3/137: symlink d7/d8/d13/d1d/l29 0 2024-09-20T20:31:39.581 INFO:tasks.workunit.client.0.smithi070.stdout:6/132: creat d4/d8/d10/f2d x:0 0 0 2024-09-20T20:31:39.581 INFO:tasks.workunit.client.0.smithi070.stdout:3/138: write f3 [373676,102674] 0 2024-09-20T20:31:39.582 INFO:tasks.workunit.client.0.smithi070.stdout:3/139: rmdir d7/d8/d13 39 2024-09-20T20:31:39.583 INFO:tasks.workunit.client.0.smithi070.stdout:6/133: symlink d4/l2e 0 2024-09-20T20:31:39.587 INFO:tasks.workunit.client.0.smithi070.stdout:5/107: dwrite f0 [0,4194304] 0 2024-09-20T20:31:39.588 INFO:tasks.workunit.client.0.smithi070.stdout:0/181: dwrite d4/fd [0,4194304] 0 2024-09-20T20:31:39.588 INFO:tasks.workunit.client.0.smithi070.stdout:2/161: dread d3/de/f1b [0,4194304] 0 2024-09-20T20:31:39.588 INFO:tasks.workunit.client.0.smithi070.stdout:9/129: dwrite d1/f5 [0,4194304] 0 2024-09-20T20:31:39.588 INFO:tasks.workunit.client.0.smithi070.stdout:5/108: chown d2/l1f 66321 1 2024-09-20T20:31:39.589 INFO:tasks.workunit.client.0.smithi070.stdout:9/130: symlink d1/df/l2c 0 2024-09-20T20:31:39.589 INFO:tasks.workunit.client.0.smithi070.stdout:2/162: mkdir d3/d5/d9/d1c/d47 0 2024-09-20T20:31:39.590 INFO:tasks.workunit.client.0.smithi070.stdout:5/109: creat d2/df/f22 x:0 0 0 2024-09-20T20:31:39.590 INFO:tasks.workunit.client.0.smithi070.stdout:9/131: mkdir d1/df/d2d 0 2024-09-20T20:31:39.590 INFO:tasks.workunit.client.0.smithi070.stdout:5/110: mknod d2/df/d15/c23 0 2024-09-20T20:31:39.590 INFO:tasks.workunit.client.0.smithi070.stdout:9/132: fsync d1/df/d18/f20 0 2024-09-20T20:31:39.591 INFO:tasks.workunit.client.0.smithi070.stdout:2/163: write d3/de/d12/d1a/f21 [2784854,79355] 0 2024-09-20T20:31:39.591 INFO:tasks.workunit.client.0.smithi070.stdout:9/133: chown d1/df/d18/l21 480 1 2024-09-20T20:31:39.591 INFO:tasks.workunit.client.0.smithi070.stdout:2/164: chown d3/d5/d9/f31 5684 1 2024-09-20T20:31:39.593 INFO:tasks.workunit.client.0.smithi070.stdout:9/134: creat d1/df/d25/f2e x:0 0 0 2024-09-20T20:31:39.593 INFO:tasks.workunit.client.0.smithi070.stdout:2/165: creat d3/d5/d9/f48 x:0 0 0 2024-09-20T20:31:39.598 INFO:tasks.workunit.client.0.smithi070.stdout:0/182: truncate d4/fd 3183148 0 2024-09-20T20:31:39.600 INFO:tasks.workunit.client.0.smithi070.stdout:9/135: truncate d1/df/f1b 1217101 0 2024-09-20T20:31:39.601 INFO:tasks.workunit.client.0.smithi070.stdout:2/166: dwrite d3/f38 [0,4194304] 0 2024-09-20T20:31:39.601 INFO:tasks.workunit.client.0.smithi070.stdout:5/111: write d2/f13 [391205,25864] 0 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:oload 1000 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 0.05 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0011 2024-09-20T20:31:39.602 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0108 2024-09-20T20:31:39.603 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:31:39.603 INFO:tasks.workunit.client.0.smithi070.stdout:9/136: creat d1/df/d18/f2f x:0 0 0 2024-09-20T20:31:39.603 INFO:tasks.workunit.client.0.smithi070.stdout:5/112: symlink d2/d4/de/l24 0 2024-09-20T20:31:39.604 INFO:tasks.workunit.client.0.smithi070.stdout:9/137: write d1/df/d18/f20 [751773,52015] 0 2024-09-20T20:31:39.605 INFO:tasks.workunit.client.0.smithi070.stdout:5/113: rename d2/c1c to d2/d4/c25 0 2024-09-20T20:31:39.605 INFO:tasks.workunit.client.0.smithi070.stdout:0/183: dwrite d4/d8/d12/d23/d26/f1e [0,4194304] 0 2024-09-20T20:31:39.605 INFO:tasks.workunit.client.0.smithi070.stdout:5/114: chown d2/df/f22 8115277 1 2024-09-20T20:31:39.606 INFO:tasks.workunit.client.0.smithi070.stdout:9/138: dread d1/fe [4194304,4194304] 0 2024-09-20T20:31:39.607 INFO:tasks.workunit.client.0.smithi070.stdout:5/115: write d2/df/f21 [76498,3012] 0 2024-09-20T20:31:39.607 INFO:tasks.workunit.client.0.smithi070.stdout:0/184: write d4/d8/f10 [975878,72224] 0 2024-09-20T20:31:39.607 INFO:tasks.workunit.client.0.smithi070.stdout:9/139: mknod d1/df/c30 0 2024-09-20T20:31:39.608 INFO:tasks.workunit.client.0.smithi070.stdout:5/116: unlink d2/df/f21 0 2024-09-20T20:31:39.608 INFO:tasks.workunit.client.0.smithi070.stdout:5/117: chown d2/df/d15/l1d 10825615 1 2024-09-20T20:31:39.609 INFO:tasks.workunit.client.0.smithi070.stdout:0/185: truncate d4/d8/f30 190133 0 2024-09-20T20:31:39.609 INFO:tasks.workunit.client.0.smithi070.stdout:9/140: symlink d1/df/d2d/l31 0 2024-09-20T20:31:39.609 INFO:tasks.workunit.client.0.smithi070.stdout:5/118: rmdir d2/d7 39 2024-09-20T20:31:39.610 INFO:tasks.workunit.client.0.smithi070.stdout:0/186: chown d4/d8/d12/c15 43124431 1 2024-09-20T20:31:39.610 INFO:tasks.workunit.client.0.smithi070.stdout:5/119: read - d2/d4/f1e zero size 2024-09-20T20:31:39.611 INFO:tasks.workunit.client.0.smithi070.stdout:5/120: creat d2/df/d15/f26 x:0 0 0 2024-09-20T20:31:39.612 INFO:tasks.workunit.client.0.smithi070.stdout:0/187: mkdir d4/d8/d12/d23/d26/d1d/d37 0 2024-09-20T20:31:39.612 INFO:tasks.workunit.client.0.smithi070.stdout:5/121: readlink d2/l16 0 2024-09-20T20:31:39.613 INFO:tasks.workunit.client.0.smithi070.stdout:9/141: dread d1/f14 [0,4194304] 0 2024-09-20T20:31:39.614 INFO:tasks.workunit.client.0.smithi070.stdout:0/188: getdents d4 0 2024-09-20T20:31:39.614 INFO:tasks.workunit.client.0.smithi070.stdout:9/142: rename d1/lc to d1/df/l32 0 2024-09-20T20:31:39.615 INFO:tasks.workunit.client.0.smithi070.stdout:0/189: mkdir d4/d8/d12/d23/d26/d1d/d37/d38 0 2024-09-20T20:31:39.615 INFO:tasks.workunit.client.0.smithi070.stdout:9/143: symlink d1/df/d25/l33 0 2024-09-20T20:31:39.616 INFO:tasks.workunit.client.0.smithi070.stdout:0/190: link d4/d8/ce d4/d8/d12/d23/d26/d1d/c39 0 2024-09-20T20:31:39.617 INFO:tasks.workunit.client.0.smithi070.stdout:4/194: dread d6/d7/f9 [0,4194304] 0 2024-09-20T20:31:39.617 INFO:tasks.workunit.client.0.smithi070.stdout:0/191: chown d4/d8/d12/d23/d26/c2f 284997 1 2024-09-20T20:31:39.617 INFO:tasks.workunit.client.0.smithi070.stdout:4/195: mknod d6/c44 0 2024-09-20T20:31:39.618 INFO:tasks.workunit.client.0.smithi070.stdout:0/192: write d4/f5 [643757,10429] 0 2024-09-20T20:31:39.618 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:39.612+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:39.619 INFO:tasks.workunit.client.0.smithi070.stdout:2/167: fdatasync d3/de/d12/d1a/f21 0 2024-09-20T20:31:39.619 INFO:tasks.workunit.client.0.smithi070.stdout:0/193: symlink d4/d8/d12/d23/l3a 0 2024-09-20T20:31:39.619 INFO:tasks.workunit.client.0.smithi070.stdout:4/196: creat d6/d7/f45 x:0 0 0 2024-09-20T20:31:39.620 INFO:tasks.workunit.client.0.smithi070.stdout:2/168: stat d3/d5/f14 0 2024-09-20T20:31:39.620 INFO:tasks.workunit.client.0.smithi070.stdout:0/194: mkdir d4/d8/d27/d3b 0 2024-09-20T20:31:39.621 INFO:tasks.workunit.client.0.smithi070.stdout:2/169: fdatasync d3/d5/dd/ff 0 2024-09-20T20:31:39.621 INFO:tasks.workunit.client.0.smithi070.stdout:4/197: creat d6/d7/dc/f46 x:0 0 0 2024-09-20T20:31:39.621 INFO:tasks.workunit.client.0.smithi070.stdout:9/144: truncate d1/f5 3662008 0 2024-09-20T20:31:39.622 INFO:tasks.workunit.client.0.smithi070.stdout:5/122: chown d2/d4/de/d19/l1a 17 1 2024-09-20T20:31:39.622 INFO:tasks.workunit.client.0.smithi070.stdout:9/145: mknod d1/df/c34 0 2024-09-20T20:31:39.623 INFO:tasks.workunit.client.0.smithi070.stdout:5/123: mknod d2/df/d15/c27 0 2024-09-20T20:31:39.623 INFO:tasks.workunit.client.0.smithi070.stdout:6/134: dread d4/d8/f1f [0,4194304] 0 2024-09-20T20:31:39.623 INFO:tasks.workunit.client.0.smithi070.stdout:4/198: dread d6/d7/f9 [0,4194304] 0 2024-09-20T20:31:39.623 INFO:tasks.workunit.client.0.smithi070.stdout:9/146: write d1/df/f28 [505123,124668] 0 2024-09-20T20:31:39.625 INFO:tasks.workunit.client.0.smithi070.stdout:5/124: mkdir d2/d7/d28 0 2024-09-20T20:31:39.625 INFO:tasks.workunit.client.0.smithi070.stdout:9/147: mknod d1/c35 0 2024-09-20T20:31:39.626 INFO:tasks.workunit.client.0.smithi070.stdout:4/199: write d6/d7/dc/d12/f25 [3105412,6438] 0 2024-09-20T20:31:39.626 INFO:tasks.workunit.client.0.smithi070.stdout:6/135: rename d4/d8/f20 to d4/d8/f2f 0 2024-09-20T20:31:39.627 INFO:tasks.workunit.client.0.smithi070.stdout:1/207: dread d4/d6/d26/f39 [0,4194304] 0 2024-09-20T20:31:39.627 INFO:tasks.workunit.client.0.smithi070.stdout:0/195: stat d4/d8/d12/d23/d26/d1d/d37 0 2024-09-20T20:31:39.629 INFO:tasks.workunit.client.0.smithi070.stdout:0/196: write d4/f7 [4726073,54019] 0 2024-09-20T20:31:39.629 INFO:tasks.workunit.client.0.smithi070.stdout:6/136: read f0 [2197190,119112] 0 2024-09-20T20:31:39.632 INFO:tasks.workunit.client.0.smithi070.stdout:6/137: stat d4/fe 0 2024-09-20T20:31:39.632 INFO:tasks.workunit.client.0.smithi070.stdout:7/151: dread d2/d8/f6 [0,4194304] 0 2024-09-20T20:31:39.632 INFO:tasks.workunit.client.0.smithi070.stdout:9/148: dread d1/f1f [0,4194304] 0 2024-09-20T20:31:39.632 INFO:tasks.workunit.client.0.smithi070.stdout:2/170: dwrite d3/d5/d9/f48 [0,4194304] 0 2024-09-20T20:31:39.632 INFO:tasks.workunit.client.0.smithi070.stdout:4/200: rename d6/d7/dc/d12/f32 to d6/d43/f47 0 2024-09-20T20:31:39.632 INFO:tasks.workunit.client.0.smithi070.stdout:1/208: creat d4/d32/d34/d44/d48/f54 x:0 0 0 2024-09-20T20:31:39.632 INFO:tasks.workunit.client.0.smithi070.stdout:2/171: dread - d3/d5/d9/f29 zero size 2024-09-20T20:31:39.632 INFO:tasks.workunit.client.0.smithi070.stdout:5/125: truncate f1 2581350 0 2024-09-20T20:31:39.633 INFO:tasks.workunit.client.0.smithi070.stdout:1/209: stat d4/d6/f52 0 2024-09-20T20:31:39.633 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-20T20:31:39.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-20T20:31:39.635 INFO:tasks.workunit.client.0.smithi070.stdout:6/138: symlink d4/l30 0 2024-09-20T20:31:39.635 INFO:tasks.workunit.client.0.smithi070.stdout:7/152: mknod d2/d19/d2e/c34 0 2024-09-20T20:31:39.635 INFO:tasks.workunit.client.0.smithi070.stdout:8/243: dread d4/d27/d42/f54 [0,4194304] 0 2024-09-20T20:31:39.635 INFO:tasks.workunit.client.0.smithi070.stdout:9/149: symlink d1/df/d18/l36 0 2024-09-20T20:31:39.635 INFO:tasks.workunit.client.0.smithi070.stdout:4/201: symlink d6/d7/dc/d23/l48 0 2024-09-20T20:31:39.636 INFO:tasks.workunit.client.0.smithi070.stdout:1/210: creat d4/d32/d34/d44/f55 x:0 0 0 2024-09-20T20:31:39.636 INFO:tasks.workunit.client.0.smithi070.stdout:2/172: symlink d3/d37/l49 0 2024-09-20T20:31:39.636 INFO:tasks.workunit.client.0.smithi070.stdout:6/139: readlink d4/l30 0 2024-09-20T20:31:39.636 INFO:tasks.workunit.client.0.smithi070.stdout:9/150: symlink d1/l37 0 2024-09-20T20:31:39.636 INFO:tasks.workunit.client.0.smithi070.stdout:5/126: creat d2/d4/de/f29 x:0 0 0 2024-09-20T20:31:39.636 INFO:tasks.workunit.client.0.smithi070.stdout:4/202: fsync d6/d7/dc/d23/f2c 0 2024-09-20T20:31:39.636 INFO:tasks.workunit.client.0.smithi070.stdout:6/140: dread - d4/d8/f2f zero size 2024-09-20T20:31:39.637 INFO:tasks.workunit.client.0.smithi070.stdout:5/127: chown d2/d4/de/l20 1352495 1 2024-09-20T20:31:39.637 INFO:tasks.workunit.client.0.smithi070.stdout:9/151: mkdir d1/df/d38 0 2024-09-20T20:31:39.637 INFO:tasks.workunit.client.0.smithi070.stdout:4/203: fdatasync d6/d7/dc/d20/f38 0 2024-09-20T20:31:39.637 INFO:tasks.workunit.client.0.smithi070.stdout:5/128: write f0 [6409258,126099] 0 2024-09-20T20:31:39.638 INFO:tasks.workunit.client.0.smithi070.stdout:0/197: dwrite d4/f11 [0,4194304] 0 2024-09-20T20:31:39.638 INFO:tasks.workunit.client.0.smithi070.stdout:2/173: rename d3/de/d12/d1a/f3d to d3/f4a 0 2024-09-20T20:31:39.638 INFO:tasks.workunit.client.0.smithi070.stdout:1/211: getdents d4/d6 0 2024-09-20T20:31:39.638 INFO:tasks.workunit.client.0.smithi070.stdout:4/204: truncate d6/d7/f29 187391 0 2024-09-20T20:31:39.639 INFO:tasks.workunit.client.0.smithi070.stdout:6/141: link d4/f13 d4/d8/d17/f31 0 2024-09-20T20:31:39.639 INFO:tasks.workunit.client.0.smithi070.stdout:5/129: write d2/d4/f1e [517595,16248] 0 2024-09-20T20:31:39.639 INFO:tasks.workunit.client.0.smithi070.stdout:5/130: readlink d2/l1f 0 2024-09-20T20:31:39.639 INFO:tasks.workunit.client.0.smithi070.stdout:6/142: stat d4/d8/d10/f2d 0 2024-09-20T20:31:39.641 INFO:tasks.workunit.client.0.smithi070.stdout:5/131: unlink d2/df/d15/l1d 0 2024-09-20T20:31:39.641 INFO:tasks.workunit.client.0.smithi070.stdout:6/143: creat d4/d8/d1e/f32 x:0 0 0 2024-09-20T20:31:39.641 INFO:tasks.workunit.client.0.smithi070.stdout:9/152: write d1/fe [6192611,57038] 0 2024-09-20T20:31:39.642 INFO:tasks.workunit.client.0.smithi070.stdout:6/144: mkdir d4/d8/d17/d33 0 2024-09-20T20:31:39.642 INFO:tasks.workunit.client.0.smithi070.stdout:5/132: dread d2/d7/f11 [0,4194304] 0 2024-09-20T20:31:39.642 INFO:tasks.workunit.client.0.smithi070.stdout:9/153: mkdir d1/d39 0 2024-09-20T20:31:39.642 INFO:tasks.workunit.client.0.smithi070.stdout:6/145: rmdir d4 39 2024-09-20T20:31:39.644 INFO:tasks.workunit.client.0.smithi070.stdout:5/133: symlink d2/df/l2a 0 2024-09-20T20:31:39.644 INFO:tasks.workunit.client.0.smithi070.stdout:6/146: creat d4/d8/d17/f34 x:0 0 0 2024-09-20T20:31:39.644 INFO:tasks.workunit.client.0.smithi070.stdout:9/154: creat d1/df/d18/f3a x:0 0 0 2024-09-20T20:31:39.645 INFO:tasks.workunit.client.0.smithi070.stdout:0/198: dwrite d4/f9 [0,4194304] 0 2024-09-20T20:31:39.647 INFO:tasks.workunit.client.0.smithi070.stdout:2/174: dwrite d3/de/d12/d1a/f30 [0,4194304] 0 2024-09-20T20:31:39.648 INFO:tasks.workunit.client.0.smithi070.stdout:9/155: unlink d1/df/d18/f3a 0 2024-09-20T20:31:39.648 INFO:tasks.workunit.client.0.smithi070.stdout:1/212: truncate d4/d6/d11/f10 3563367 0 2024-09-20T20:31:39.649 INFO:tasks.workunit.client.0.smithi070.stdout:0/199: mknod d4/d8/d12/d23/d26/d1d/c3c 0 2024-09-20T20:31:39.649 INFO:tasks.workunit.client.0.smithi070.stdout:5/134: rename d2/d4/de/d19/l1a to d2/l2b 0 2024-09-20T20:31:39.650 INFO:tasks.workunit.client.0.smithi070.stdout:2/175: mkdir d3/d5/d9/d1c/d47/d4b 0 2024-09-20T20:31:39.650 INFO:tasks.workunit.client.0.smithi070.stdout:5/135: symlink d2/df/d15/l2c 0 2024-09-20T20:31:39.650 INFO:tasks.workunit.client.0.smithi070.stdout:3/140: dread f5 [0,4194304] 0 2024-09-20T20:31:39.651 INFO:tasks.workunit.client.0.smithi070.stdout:1/213: getdents d4/d32/d34/d44/d48 0 2024-09-20T20:31:39.651 INFO:tasks.workunit.client.0.smithi070.stdout:3/141: fdatasync d7/d15/f18 0 2024-09-20T20:31:39.652 INFO:tasks.workunit.client.0.smithi070.stdout:5/136: rename d2/l16 to d2/l2d 0 2024-09-20T20:31:39.652 INFO:tasks.workunit.client.0.smithi070.stdout:3/142: dread - d7/d8/f19 zero size 2024-09-20T20:31:39.653 INFO:tasks.workunit.client.0.smithi070.stdout:5/137: read d2/fb [160880,22143] 0 2024-09-20T20:31:39.653 INFO:tasks.workunit.client.0.smithi070.stdout:3/143: unlink d7/f12 0 2024-09-20T20:31:39.654 INFO:tasks.workunit.client.0.smithi070.stdout:3/144: chown d7/d15/d1e 24639 1 2024-09-20T20:31:39.655 INFO:tasks.workunit.client.0.smithi070.stdout:5/138: mknod d2/df/d15/c2e 0 2024-09-20T20:31:39.656 INFO:tasks.workunit.client.0.smithi070.stdout:3/145: fsync d7/d8/fc 0 2024-09-20T20:31:39.656 INFO:tasks.workunit.client.0.smithi070.stdout:5/139: rmdir d2/df 39 2024-09-20T20:31:39.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/140: chown d2/df/l2a 1 1 2024-09-20T20:31:39.658 INFO:tasks.workunit.client.0.smithi070.stdout:2/176: dwrite d3/f38 [4194304,4194304] 0 2024-09-20T20:31:39.659 INFO:tasks.workunit.client.0.smithi070.stdout:3/146: rename d7/d8/d13/d1d/l29 to d7/d8/d13/d1d/l2a 0 2024-09-20T20:31:39.659 INFO:tasks.workunit.client.0.smithi070.stdout:2/177: rmdir d3/d5/d9/d1c 39 2024-09-20T20:31:39.660 INFO:tasks.workunit.client.0.smithi070.stdout:1/214: dwrite d4/d6/d11/d2c/f36 [0,4194304] 0 2024-09-20T20:31:39.660 INFO:tasks.workunit.client.0.smithi070.stdout:3/147: symlink d7/d8/d13/d1d/l2b 0 2024-09-20T20:31:39.661 INFO:tasks.workunit.client.0.smithi070.stdout:2/178: truncate d3/d5/d9/d10/f11 4663745 0 2024-09-20T20:31:39.664 INFO:tasks.workunit.client.0.smithi070.stdout:1/215: getdents d4/d6/d11/d2c/d3a 0 2024-09-20T20:31:39.665 INFO:tasks.workunit.client.0.smithi070.stdout:2/179: getdents d3/d5/d9/d1c/d1f 0 2024-09-20T20:31:39.666 INFO:tasks.workunit.client.0.smithi070.stdout:2/180: mkdir d3/d4c 0 2024-09-20T20:31:39.667 INFO:tasks.workunit.client.0.smithi070.stdout:2/181: stat d3/f4a 0 2024-09-20T20:31:39.667 INFO:tasks.workunit.client.0.smithi070.stdout:2/182: readlink d3/de/d12/l27 0 2024-09-20T20:31:39.667 INFO:tasks.workunit.client.0.smithi070.stdout:2/183: readlink d3/l2a 0 2024-09-20T20:31:39.668 INFO:tasks.workunit.client.0.smithi070.stdout:2/184: readlink d3/l2f 0 2024-09-20T20:31:39.668 INFO:tasks.workunit.client.0.smithi070.stdout:8/244: dread d4/f28 [0,4194304] 0 2024-09-20T20:31:39.669 INFO:tasks.workunit.client.0.smithi070.stdout:2/185: chown d3/d5/f14 3101 1 2024-09-20T20:31:39.669 INFO:tasks.workunit.client.0.smithi070.stdout:8/245: fsync d4/d27/f53 0 2024-09-20T20:31:39.670 INFO:tasks.workunit.client.0.smithi070.stdout:5/141: getdents d2 0 2024-09-20T20:31:39.670 INFO:tasks.workunit.client.0.smithi070.stdout:2/186: creat d3/d5/d9/d1c/f4d x:0 0 0 2024-09-20T20:31:39.671 INFO:tasks.workunit.client.0.smithi070.stdout:5/142: rmdir d2/df 39 2024-09-20T20:31:39.671 INFO:tasks.workunit.client.0.smithi070.stdout:8/246: write d4/f7 [2212825,62847] 0 2024-09-20T20:31:39.672 INFO:tasks.workunit.client.0.smithi070.stdout:8/247: stat d4/c1f 0 2024-09-20T20:31:39.672 INFO:tasks.workunit.client.0.smithi070.stdout:2/187: rmdir d3/d5/d9/d1c/d1f 39 2024-09-20T20:31:39.672 INFO:tasks.workunit.client.0.smithi070.stdout:1/216: dwrite d4/d6/d2f/f31 [0,4194304] 0 2024-09-20T20:31:39.672 INFO:tasks.workunit.client.0.smithi070.stdout:2/188: stat d3/d5/d9/d1c/l35 0 2024-09-20T20:31:39.673 INFO:tasks.workunit.client.0.smithi070.stdout:5/143: dread d2/d7/f11 [0,4194304] 0 2024-09-20T20:31:39.675 INFO:tasks.workunit.client.0.smithi070.stdout:2/189: mkdir d3/d5/d9/d1c/d4e 0 2024-09-20T20:31:39.675 INFO:tasks.workunit.client.0.smithi070.stdout:5/144: truncate f1 2931342 0 2024-09-20T20:31:39.677 INFO:tasks.workunit.client.0.smithi070.stdout:0/200: dread f2 [4194304,4194304] 0 2024-09-20T20:31:39.677 INFO:tasks.workunit.client.0.smithi070.stdout:1/217: dread d4/d6/d2f/f31 [0,4194304] 0 2024-09-20T20:31:39.677 INFO:tasks.workunit.client.0.smithi070.stdout:6/147: dread d4/f9 [4194304,4194304] 0 2024-09-20T20:31:39.677 INFO:tasks.workunit.client.0.smithi070.stdout:0/201: stat d4/d8/fc 0 2024-09-20T20:31:39.677 INFO:tasks.workunit.client.0.smithi070.stdout:5/145: rename d2/df/d15/c23 to d2/d7/c2f 0 2024-09-20T20:31:39.677 INFO:tasks.workunit.client.0.smithi070.stdout:6/148: dread - d4/d8/d10/f2d zero size 2024-09-20T20:31:39.678 INFO:tasks.workunit.client.0.smithi070.stdout:5/146: truncate d2/fb 116548 0 2024-09-20T20:31:39.679 INFO:tasks.workunit.client.0.smithi070.stdout:3/148: write f4 [3550704,97402] 0 2024-09-20T20:31:39.679 INFO:tasks.workunit.client.0.smithi070.stdout:6/149: getdents d4 0 2024-09-20T20:31:39.680 INFO:tasks.workunit.client.0.smithi070.stdout:3/149: truncate d7/f1b 4909922 0 2024-09-20T20:31:39.680 INFO:tasks.workunit.client.0.smithi070.stdout:5/147: truncate d2/d4/de/f29 488523 0 2024-09-20T20:31:39.680 INFO:tasks.workunit.client.0.smithi070.stdout:6/150: symlink d4/d8/d17/l35 0 2024-09-20T20:31:39.681 INFO:tasks.workunit.client.0.smithi070.stdout:3/150: chown d7/d8/d13/d1d/c22 255085 1 2024-09-20T20:31:39.683 INFO:tasks.workunit.client.0.smithi070.stdout:6/151: dread d4/d8/f1f [0,4194304] 0 2024-09-20T20:31:39.683 INFO:tasks.workunit.client.0.smithi070.stdout:2/190: dwrite f2 [8388608,4194304] 0 2024-09-20T20:31:39.685 INFO:tasks.workunit.client.0.smithi070.stdout:0/202: dwrite d4/d8/d12/f14 [0,4194304] 0 2024-09-20T20:31:39.685 INFO:tasks.workunit.client.0.smithi070.stdout:2/191: fdatasync d3/d5/dd/f15 0 2024-09-20T20:31:39.685 INFO:tasks.workunit.client.0.smithi070.stdout:2/192: dread - d3/f4a zero size 2024-09-20T20:31:39.686 INFO:tasks.workunit.client.0.smithi070.stdout:0/203: unlink d4/d13/f18 0 2024-09-20T20:31:39.687 INFO:tasks.workunit.client.0.smithi070.stdout:2/193: dread - d3/d5/f1e zero size 2024-09-20T20:31:39.687 INFO:tasks.workunit.client.0.smithi070.stdout:3/151: dread d7/fb [0,4194304] 0 2024-09-20T20:31:39.688 INFO:tasks.workunit.client.0.smithi070.stdout:0/204: creat d4/d1b/f3d x:0 0 0 2024-09-20T20:31:39.688 INFO:tasks.workunit.client.0.smithi070.stdout:0/205: chown d4/d8/d12/c15 0 1 2024-09-20T20:31:39.689 INFO:tasks.workunit.client.0.smithi070.stdout:5/148: dwrite d2/df/f22 [0,4194304] 0 2024-09-20T20:31:39.690 INFO:tasks.workunit.client.0.smithi070.stdout:0/206: write d4/d8/fb [1335203,40395] 0 2024-09-20T20:31:39.690 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:39.690 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:39.691 INFO:tasks.workunit.client.0.smithi070.stdout:0/207: write d4/d19/f29 [4356151,89770] 0 2024-09-20T20:31:39.691 INFO:tasks.workunit.client.0.smithi070.stdout:5/149: getdents d2/d7 0 2024-09-20T20:31:39.693 INFO:tasks.workunit.client.0.smithi070.stdout:5/150: write d2/df/f22 [55852,26725] 0 2024-09-20T20:31:39.694 INFO:tasks.workunit.client.0.smithi070.stdout:5/151: chown d2/d7/c12 31076 1 2024-09-20T20:31:39.695 INFO:tasks.workunit.client.0.smithi070.stdout:3/152: dwrite d7/f9 [0,4194304] 0 2024-09-20T20:31:39.695 INFO:tasks.workunit.client.0.smithi070.stdout:6/152: write d4/d8/f1f [1165159,32497] 0 2024-09-20T20:31:39.695 INFO:tasks.workunit.client.0.smithi070.stdout:2/194: dwrite d3/f38 [0,4194304] 0 2024-09-20T20:31:39.698 INFO:tasks.workunit.client.0.smithi070.stdout:6/153: unlink d4/l30 0 2024-09-20T20:31:39.698 INFO:tasks.workunit.client.0.smithi070.stdout:2/195: mkdir d3/de/d12/d4f 0 2024-09-20T20:31:39.698 INFO:tasks.workunit.client.0.smithi070.stdout:5/152: getdents d2/df/d15 0 2024-09-20T20:31:39.698 INFO:tasks.workunit.client.0.smithi070.stdout:3/153: creat d7/d15/d1a/f2c x:0 0 0 2024-09-20T20:31:39.699 INFO:tasks.workunit.client.0.smithi070.stdout:3/154: readlink d7/lf 0 2024-09-20T20:31:39.699 INFO:tasks.workunit.client.0.smithi070.stdout:2/196: truncate d3/de/f39 381492 0 2024-09-20T20:31:39.700 INFO:tasks.workunit.client.0.smithi070.stdout:2/197: symlink d3/d5/d9/d42/l50 0 2024-09-20T20:31:39.700 INFO:tasks.workunit.client.0.smithi070.stdout:5/153: write d2/f13 [1021211,106318] 0 2024-09-20T20:31:39.701 INFO:tasks.workunit.client.0.smithi070.stdout:5/154: write d2/f13 [1013435,55583] 0 2024-09-20T20:31:39.701 INFO:tasks.workunit.client.0.smithi070.stdout:5/155: write d2/df/d15/f26 [972926,30749] 0 2024-09-20T20:31:39.702 INFO:tasks.workunit.client.0.smithi070.stdout:5/156: truncate d2/d4/de/f29 1055130 0 2024-09-20T20:31:39.703 INFO:tasks.workunit.client.0.smithi070.stdout:5/157: write d2/d4/f1e [1150108,88226] 0 2024-09-20T20:31:39.704 INFO:tasks.workunit.client.0.smithi070.stdout:2/198: dread d3/d5/dd/f15 [0,4194304] 0 2024-09-20T20:31:39.704 INFO:tasks.workunit.client.0.smithi070.stdout:5/158: symlink d2/d7/d28/l30 0 2024-09-20T20:31:39.704 INFO:tasks.workunit.client.0.smithi070.stdout:5/159: chown d2 1 1 2024-09-20T20:31:39.705 INFO:tasks.workunit.client.0.smithi070.stdout:5/160: creat d2/d7/f31 x:0 0 0 2024-09-20T20:31:39.706 INFO:tasks.workunit.client.0.smithi070.stdout:5/161: mknod d2/d4/de/c32 0 2024-09-20T20:31:39.706 INFO:tasks.workunit.client.0.smithi070.stdout:5/162: creat d2/df/d15/f33 x:0 0 0 2024-09-20T20:31:39.707 INFO:tasks.workunit.client.0.smithi070.stdout:5/163: write f0 [208867,49298] 0 2024-09-20T20:31:39.707 INFO:tasks.workunit.client.0.smithi070.stdout:1/218: dread d4/d6/d11/f10 [0,4194304] 0 2024-09-20T20:31:39.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:39.709 INFO:tasks.workunit.client.0.smithi070.stdout:1/219: mknod d4/d6/d2f/c56 0 2024-09-20T20:31:39.709 INFO:tasks.workunit.client.0.smithi070.stdout:1/220: fdatasync d4/d6/f29 0 2024-09-20T20:31:39.709 INFO:tasks.workunit.client.0.smithi070.stdout:0/208: truncate f2 2718342 0 2024-09-20T20:31:39.710 INFO:tasks.workunit.client.0.smithi070.stdout:1/221: unlink d4/d6/f7 0 2024-09-20T20:31:39.710 INFO:tasks.workunit.client.0.smithi070.stdout:2/199: dwrite d3/d5/d9/d10/f11 [0,4194304] 0 2024-09-20T20:31:39.711 INFO:tasks.workunit.client.0.smithi070.stdout:1/222: dread - d4/d6/f35 zero size 2024-09-20T20:31:39.712 INFO:tasks.workunit.client.0.smithi070.stdout:2/200: creat d3/d5/d9/d1c/d1f/d3e/f51 x:0 0 0 2024-09-20T20:31:39.712 INFO:tasks.workunit.client.0.smithi070.stdout:1/223: rename d4/d6/d11/f30 to d4/d6/d11/f57 0 2024-09-20T20:31:39.713 INFO:tasks.workunit.client.0.smithi070.stdout:0/209: chown d4/f16 6132 1 2024-09-20T20:31:39.713 INFO:tasks.workunit.client.0.smithi070.stdout:3/155: read f3 [345610,100228] 0 2024-09-20T20:31:39.714 INFO:tasks.workunit.client.0.smithi070.stdout:2/201: read - d3/d5/d9/d1c/d1f/d3e/f51 zero size 2024-09-20T20:31:39.714 INFO:tasks.workunit.client.0.smithi070.stdout:5/164: dwrite d2/f13 [0,4194304] 0 2024-09-20T20:31:39.715 INFO:tasks.workunit.client.0.smithi070.stdout:1/224: unlink d4/d6/d11/d2c/f36 0 2024-09-20T20:31:39.717 INFO:tasks.workunit.client.0.smithi070.stdout:2/202: creat d3/d5/d9/d10/f52 x:0 0 0 2024-09-20T20:31:39.718 INFO:tasks.workunit.client.0.smithi070.stdout:6/154: dwrite d4/d8/f25 [0,4194304] 0 2024-09-20T20:31:39.719 INFO:tasks.workunit.client.0.smithi070.stdout:6/155: readlink d4/d8/d1e/l27 0 2024-09-20T20:31:39.719 INFO:tasks.workunit.client.0.smithi070.stdout:3/156: creat d7/d15/f2d x:0 0 0 2024-09-20T20:31:39.720 INFO:tasks.workunit.client.0.smithi070.stdout:0/210: dwrite d4/fd [0,4194304] 0 2024-09-20T20:31:39.721 INFO:tasks.workunit.client.0.smithi070.stdout:2/203: mknod d3/d5/c53 0 2024-09-20T20:31:39.721 INFO:tasks.workunit.client.0.smithi070.stdout:3/157: creat d7/d8/d13/f2e x:0 0 0 2024-09-20T20:31:39.721 INFO:tasks.workunit.client.0.smithi070.stdout:0/211: fdatasync d4/d13/f24 0 2024-09-20T20:31:39.721 INFO:tasks.workunit.client.0.smithi070.stdout:6/156: mkdir d4/d8/d17/d33/d36 0 2024-09-20T20:31:39.722 INFO:tasks.workunit.client.0.smithi070.stdout:2/204: mknod d3/de/c54 0 2024-09-20T20:31:39.722 INFO:tasks.workunit.client.0.smithi070.stdout:3/158: chown d7/d8/d13/d1d/f20 77 1 2024-09-20T20:31:39.723 INFO:tasks.workunit.client.0.smithi070.stdout:3/159: readlink d7/d15/d1e/l28 0 2024-09-20T20:31:39.724 INFO:tasks.workunit.client.0.smithi070.stdout:1/225: dwrite d4/d6/d2f/f31 [0,4194304] 0 2024-09-20T20:31:39.725 INFO:tasks.workunit.client.0.smithi070.stdout:5/165: truncate f0 11523603 0 2024-09-20T20:31:39.725 INFO:tasks.workunit.client.0.smithi070.stdout:3/160: fdatasync d7/f14 0 2024-09-20T20:31:39.725 INFO:tasks.workunit.client.0.smithi070.stdout:6/157: creat d4/d8/d17/d33/d36/f37 x:0 0 0 2024-09-20T20:31:39.726 INFO:tasks.workunit.client.0.smithi070.stdout:1/226: creat d4/d32/d34/d44/d48/f58 x:0 0 0 2024-09-20T20:31:39.726 INFO:tasks.workunit.client.0.smithi070.stdout:3/161: write d7/d8/f11 [1643616,72974] 0 2024-09-20T20:31:39.727 INFO:tasks.workunit.client.0.smithi070.stdout:2/205: getdents d3/d37 0 2024-09-20T20:31:39.727 INFO:tasks.workunit.client.0.smithi070.stdout:5/166: creat d2/d4/de/f34 x:0 0 0 2024-09-20T20:31:39.728 INFO:tasks.workunit.client.0.smithi070.stdout:1/227: creat d4/d32/d34/f59 x:0 0 0 2024-09-20T20:31:39.728 INFO:tasks.workunit.client.0.smithi070.stdout:2/206: write d3/d5/dd/ff [6466126,44213] 0 2024-09-20T20:31:39.729 INFO:tasks.workunit.client.0.smithi070.stdout:5/167: unlink d2/d4/de/c32 0 2024-09-20T20:31:39.729 INFO:tasks.workunit.client.0.smithi070.stdout:0/212: dwrite d4/f7 [4194304,4194304] 0 2024-09-20T20:31:39.730 INFO:tasks.workunit.client.0.smithi070.stdout:1/228: getdents d4/d32/d34/d44/d4b 0 2024-09-20T20:31:39.730 INFO:tasks.workunit.client.0.smithi070.stdout:2/207: rename d3/d37 to d3/de/d12/d1a/d55 0 2024-09-20T20:31:39.731 INFO:tasks.workunit.client.0.smithi070.stdout:2/208: write d3/d5/d9/d10/f11 [2223057,6721] 0 2024-09-20T20:31:39.732 INFO:tasks.workunit.client.0.smithi070.stdout:3/162: dread f2 [0,4194304] 0 2024-09-20T20:31:39.735 INFO:tasks.workunit.client.0.smithi070.stdout:2/209: creat d3/d5/d9/d1c/f56 x:0 0 0 2024-09-20T20:31:39.736 INFO:tasks.workunit.client.0.smithi070.stdout:2/210: stat d3/d5/dd/l43 0 2024-09-20T20:31:39.737 INFO:tasks.workunit.client.0.smithi070.stdout:1/229: dwrite d4/d6/d11/f24 [0,4194304] 0 2024-09-20T20:31:39.738 INFO:tasks.workunit.client.0.smithi070.stdout:1/230: dread - d4/d32/d34/d44/d48/f54 zero size 2024-09-20T20:31:39.738 INFO:tasks.workunit.client.0.smithi070.stdout:2/211: link d3/d5/d9/d1c/d1f/d3e/l45 d3/d5/d9/d10/l57 0 2024-09-20T20:31:39.739 INFO:tasks.workunit.client.0.smithi070.stdout:1/231: chown d4/d32/d34/d44/d48/f54 177261 1 2024-09-20T20:31:39.740 INFO:tasks.workunit.client.0.smithi070.stdout:2/212: symlink d3/d5/d9/d1c/d47/d4b/l58 0 2024-09-20T20:31:39.741 INFO:tasks.workunit.client.0.smithi070.stdout:2/213: write d3/f4a [594699,21778] 0 2024-09-20T20:31:39.741 INFO:tasks.workunit.client.0.smithi070.stdout:1/232: read d4/d6/d11/f3f [95635,97719] 0 2024-09-20T20:31:39.741 INFO:tasks.workunit.client.0.smithi070.stdout:3/163: dwrite d7/f14 [0,4194304] 0 2024-09-20T20:31:39.743 INFO:tasks.workunit.client.0.smithi070.stdout:2/214: creat d3/d5/d9/d42/f59 x:0 0 0 2024-09-20T20:31:39.743 INFO:tasks.workunit.client.0.smithi070.stdout:3/164: creat d7/d15/d1e/f2f x:0 0 0 2024-09-20T20:31:39.745 INFO:tasks.workunit.client.0.smithi070.stdout:3/165: symlink d7/d8/d13/d1d/l30 0 2024-09-20T20:31:39.748 INFO:tasks.workunit.client.0.smithi070.stdout:1/233: dwrite d4/d6/d26/f39 [0,4194304] 0 2024-09-20T20:31:39.749 INFO:tasks.workunit.client.0.smithi070.stdout:2/215: rename d3/de/d12/d1a/d55 to d3/d5/dd/d5a 0 2024-09-20T20:31:39.749 INFO:tasks.workunit.client.0.smithi070.stdout:0/213: write d4/d8/f30 [1140861,26555] 0 2024-09-20T20:31:39.749 INFO:tasks.workunit.client.0.smithi070.stdout:1/234: mkdir d4/d32/d34/d44/d5a 0 2024-09-20T20:31:39.750 INFO:tasks.workunit.client.0.smithi070.stdout:2/216: creat d3/de/d12/f5b x:0 0 0 2024-09-20T20:31:39.750 INFO:tasks.workunit.client.0.smithi070.stdout:0/214: unlink d4/d8/fb 0 2024-09-20T20:31:39.751 INFO:tasks.workunit.client.0.smithi070.stdout:2/217: mkdir d3/d4c/d5c 0 2024-09-20T20:31:39.751 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:39.748+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:39.751 INFO:tasks.workunit.client.0.smithi070.stdout:1/235: write d4/d6/d11/f57 [1237740,17238] 0 2024-09-20T20:31:39.753 INFO:tasks.workunit.client.0.smithi070.stdout:1/236: creat d4/d6/d26/f5b x:0 0 0 2024-09-20T20:31:39.753 INFO:tasks.workunit.client.0.smithi070.stdout:2/218: truncate d3/d5/d9/d1c/d1f/f33 334389 0 2024-09-20T20:31:39.753 INFO:tasks.workunit.client.0.smithi070.stdout:5/168: dwrite d2/d7/fc [8388608,4194304] 0 2024-09-20T20:31:39.754 INFO:tasks.workunit.client.0.smithi070.stdout:1/237: chown d4/d6/d11/f57 6923623 1 2024-09-20T20:31:39.754 INFO:tasks.workunit.client.0.smithi070.stdout:3/166: write d7/fd [1060981,108121] 0 2024-09-20T20:31:39.755 INFO:tasks.workunit.client.0.smithi070.stdout:5/169: symlink d2/d7/d28/l35 0 2024-09-20T20:31:39.755 INFO:tasks.workunit.client.0.smithi070.stdout:3/167: dread - d7/d15/d1e/f2f zero size 2024-09-20T20:31:39.756 INFO:tasks.workunit.client.0.smithi070.stdout:2/219: symlink d3/d5/d9/d1c/d4e/l5d 0 2024-09-20T20:31:39.756 INFO:tasks.workunit.client.0.smithi070.stdout:5/170: fdatasync d2/d4/fa 0 2024-09-20T20:31:39.756 INFO:tasks.workunit.client.0.smithi070.stdout:1/238: rename d4/d6/d11/d2c/c2d to d4/d6/d11/d2c/d3b/c5c 0 2024-09-20T20:31:39.756 INFO:tasks.workunit.client.0.smithi070.stdout:3/168: dread - d7/d15/d23/f27 zero size 2024-09-20T20:31:39.757 INFO:tasks.workunit.client.0.smithi070.stdout:2/220: write d3/d5/f1e [992432,26891] 0 2024-09-20T20:31:39.757 INFO:tasks.workunit.client.0.smithi070.stdout:6/158: dread d4/f13 [0,4194304] 0 2024-09-20T20:31:39.758 INFO:tasks.workunit.client.0.smithi070.stdout:0/215: dwrite d4/d8/f30 [0,4194304] 0 2024-09-20T20:31:39.758 INFO:tasks.workunit.client.0.smithi070.stdout:3/169: rename l1 to d7/l31 0 2024-09-20T20:31:39.758 INFO:tasks.workunit.client.0.smithi070.stdout:0/216: dread - d4/d13/f24 zero size 2024-09-20T20:31:39.759 INFO:tasks.workunit.client.0.smithi070.stdout:5/171: read d2/d4/f1e [924802,53767] 0 2024-09-20T20:31:39.762 INFO:tasks.workunit.client.0.smithi070.stdout:2/221: creat d3/d5/d9/d1c/d1f/f5e x:0 0 0 2024-09-20T20:31:39.763 INFO:tasks.workunit.client.0.smithi070.stdout:3/170: rename d7/d8/d13/f17 to d7/d15/d1a/f32 0 2024-09-20T20:31:39.763 INFO:tasks.workunit.client.0.smithi070.stdout:6/159: mkdir d4/d8/d38 0 2024-09-20T20:31:39.764 INFO:tasks.workunit.client.0.smithi070.stdout:5/172: symlink d2/l36 0 2024-09-20T20:31:39.764 INFO:tasks.workunit.client.0.smithi070.stdout:6/160: chown d4/d8/d17 1278941036 1 2024-09-20T20:31:39.764 INFO:tasks.workunit.client.0.smithi070.stdout:3/171: creat d7/d8/f33 x:0 0 0 2024-09-20T20:31:39.764 INFO:tasks.workunit.client.0.smithi070.stdout:2/222: chown d3/d5/d9/d1c/c2b 1 1 2024-09-20T20:31:39.764 INFO:tasks.workunit.client.0.smithi070.stdout:5/173: creat d2/df/d15/f37 x:0 0 0 2024-09-20T20:31:39.765 INFO:tasks.workunit.client.0.smithi070.stdout:5/174: stat d2/d4/de/f34 0 2024-09-20T20:31:39.765 INFO:tasks.workunit.client.0.smithi070.stdout:6/161: mknod d4/d8/d17/d33/d36/c39 0 2024-09-20T20:31:39.765 INFO:tasks.workunit.client.0.smithi070.stdout:2/223: stat d3/d5/d9/d1c/d1f/f5e 0 2024-09-20T20:31:39.766 INFO:tasks.workunit.client.0.smithi070.stdout:3/172: truncate d7/d8/d13/f26 830738 0 2024-09-20T20:31:39.766 INFO:tasks.workunit.client.0.smithi070.stdout:5/175: symlink d2/d4/l38 0 2024-09-20T20:31:39.766 INFO:tasks.workunit.client.0.smithi070.stdout:0/217: dwrite d4/f9 [0,4194304] 0 2024-09-20T20:31:39.766 INFO:tasks.workunit.client.0.smithi070.stdout:6/162: chown d4/d8/d10/f2d 10262752 1 2024-09-20T20:31:39.767 INFO:tasks.workunit.client.0.smithi070.stdout:6/163: chown d4/d8/d17/f31 20627308 1 2024-09-20T20:31:39.768 INFO:tasks.workunit.client.0.smithi070.stdout:2/224: unlink d3/d5/d9/d1c/l35 0 2024-09-20T20:31:39.768 INFO:tasks.workunit.client.0.smithi070.stdout:5/176: creat d2/d4/f39 x:0 0 0 2024-09-20T20:31:39.769 INFO:tasks.workunit.client.0.smithi070.stdout:0/218: mkdir d4/d8/d12/d23/d26/d1d/d37/d3e 0 2024-09-20T20:31:39.769 INFO:tasks.workunit.client.0.smithi070.stdout:5/177: dread - d2/d7/f31 zero size 2024-09-20T20:31:39.770 INFO:tasks.workunit.client.0.smithi070.stdout:5/178: fdatasync d2/d4/de/f34 0 2024-09-20T20:31:39.770 INFO:tasks.workunit.client.0.smithi070.stdout:2/225: rename d3/d5/d9/f31 to d3/d5/dd/d5a/f5f 0 2024-09-20T20:31:39.770 INFO:tasks.workunit.client.0.smithi070.stdout:0/219: read d4/d8/f10 [482443,103923] 0 2024-09-20T20:31:39.771 INFO:tasks.workunit.client.0.smithi070.stdout:5/179: rename d2/df/d15/f33 to d2/d4/de/d19/f3a 0 2024-09-20T20:31:39.771 INFO:tasks.workunit.client.0.smithi070.stdout:5/180: stat d2/d4/de/l20 0 2024-09-20T20:31:39.775 INFO:tasks.workunit.client.0.smithi070.stdout:3/173: fdatasync d7/fd 0 2024-09-20T20:31:39.776 INFO:tasks.workunit.client.0.smithi070.stdout:3/174: write d7/d15/f2d [866283,123675] 0 2024-09-20T20:31:39.777 INFO:tasks.workunit.client.0.smithi070.stdout:3/175: chown d7/d15/d1a 9773578 1 2024-09-20T20:31:39.777 INFO:tasks.workunit.client.0.smithi070.stdout:1/239: dread d4/d6/f14 [0,4194304] 0 2024-09-20T20:31:39.777 INFO:tasks.workunit.client.0.smithi070.stdout:3/176: creat d7/d8/d13/d1d/f34 x:0 0 0 2024-09-20T20:31:39.778 INFO:tasks.workunit.client.0.smithi070.stdout:1/240: mknod d4/d6/d2f/c5d 0 2024-09-20T20:31:39.778 INFO:tasks.workunit.client.0.smithi070.stdout:1/241: stat d4/d6/d11/f42 0 2024-09-20T20:31:39.779 INFO:tasks.workunit.client.0.smithi070.stdout:1/242: dread - d4/d32/d34/d44/f55 zero size 2024-09-20T20:31:39.780 INFO:tasks.workunit.client.0.smithi070.stdout:6/164: truncate d4/d8/d17/f24 12249 0 2024-09-20T20:31:39.780 INFO:tasks.workunit.client.0.smithi070.stdout:2/226: getdents d3/d5/d9 0 2024-09-20T20:31:39.780 INFO:tasks.workunit.client.0.smithi070.stdout:0/220: truncate d4/d8/fc 2832301 0 2024-09-20T20:31:39.780 INFO:tasks.workunit.client.0.smithi070.stdout:6/165: chown d4/d8/d10 12853882 1 2024-09-20T20:31:39.781 INFO:tasks.workunit.client.0.smithi070.stdout:0/221: dread - d4/d8/d12/f25 zero size 2024-09-20T20:31:39.781 INFO:tasks.workunit.client.0.smithi070.stdout:2/227: dread - d3/d5/d9/d1c/f56 zero size 2024-09-20T20:31:39.781 INFO:tasks.workunit.client.0.smithi070.stdout:6/166: unlink d4/d8/d1e/l27 0 2024-09-20T20:31:39.781 INFO:tasks.workunit.client.0.smithi070.stdout:0/222: creat d4/d19/f3f x:0 0 0 2024-09-20T20:31:39.781 INFO:tasks.workunit.client.0.smithi070.stdout:2/228: chown d3/d5/d9/d1c/f4d 0 1 2024-09-20T20:31:39.782 INFO:tasks.workunit.client.0.smithi070.stdout:2/229: mknod d3/de/d12/c60 0 2024-09-20T20:31:39.783 INFO:tasks.workunit.client.0.smithi070.stdout:0/223: truncate d4/d8/d12/d23/d26/f33 500272 0 2024-09-20T20:31:39.784 INFO:tasks.workunit.client.0.smithi070.stdout:2/230: mkdir d3/d5/d9/d1c/d1f/d3e/d61 0 2024-09-20T20:31:39.785 INFO:tasks.workunit.client.0.smithi070.stdout:0/224: write d4/d8/d12/f25 [102657,120237] 0 2024-09-20T20:31:39.785 INFO:tasks.workunit.client.0.smithi070.stdout:2/231: rmdir d3/d5 39 2024-09-20T20:31:39.785 INFO:tasks.workunit.client.0.smithi070.stdout:0/225: read - d4/d13/f24 zero size 2024-09-20T20:31:39.786 INFO:tasks.workunit.client.0.smithi070.stdout:2/232: stat d3/de/f39 0 2024-09-20T20:31:39.786 INFO:tasks.workunit.client.0.smithi070.stdout:1/243: dwrite d4/d6/d26/f39 [4194304,4194304] 0 2024-09-20T20:31:39.786 INFO:tasks.workunit.client.0.smithi070.stdout:4/205: sync 2024-09-20T20:31:39.787 INFO:tasks.workunit.client.0.smithi070.stdout:7/153: sync 2024-09-20T20:31:39.787 INFO:tasks.workunit.client.0.smithi070.stdout:1/244: truncate d4/d6/f21 312755 0 2024-09-20T20:31:39.788 INFO:tasks.workunit.client.0.smithi070.stdout:6/167: dwrite d4/d8/f28 [0,4194304] 0 2024-09-20T20:31:39.788 INFO:tasks.workunit.client.0.smithi070.stdout:4/206: rmdir d6/d7 39 2024-09-20T20:31:39.789 INFO:tasks.workunit.client.0.smithi070.stdout:1/245: creat d4/d32/d34/d44/d48/f5e x:0 0 0 2024-09-20T20:31:39.789 INFO:tasks.workunit.client.0.smithi070.stdout:7/154: write d2/f1e [320020,73633] 0 2024-09-20T20:31:39.790 INFO:tasks.workunit.client.0.smithi070.stdout:2/233: link d3/d5/d9/d1c/d1f/f5e d3/d5/d9/d1c/d1f/f62 0 2024-09-20T20:31:39.790 INFO:tasks.workunit.client.0.smithi070.stdout:6/168: chown f0 1 1 2024-09-20T20:31:39.790 INFO:tasks.workunit.client.0.smithi070.stdout:1/246: chown d4/d6/f17 181119637 1 2024-09-20T20:31:39.791 INFO:tasks.workunit.client.0.smithi070.stdout:6/169: mkdir d4/d8/d3a 0 2024-09-20T20:31:39.791 INFO:tasks.workunit.client.0.smithi070.stdout:4/207: rename d6/d7/l1d to d6/d7/l49 0 2024-09-20T20:31:39.792 INFO:tasks.workunit.client.0.smithi070.stdout:4/208: readlink d6/d7/dc/d12/l31 0 2024-09-20T20:31:39.792 INFO:tasks.workunit.client.0.smithi070.stdout:1/247: rename d4/f40 to d4/d6/d2f/f5f 0 2024-09-20T20:31:39.793 INFO:tasks.workunit.client.0.smithi070.stdout:1/248: mkdir d4/d32/d60 0 2024-09-20T20:31:39.793 INFO:tasks.workunit.client.0.smithi070.stdout:1/249: symlink d4/l61 0 2024-09-20T20:31:39.794 INFO:tasks.workunit.client.0.smithi070.stdout:1/250: rmdir d4/d6/d11 39 2024-09-20T20:31:39.794 INFO:tasks.workunit.client.0.smithi070.stdout:1/251: chown d4/d32/d34/d44/d48/f5e 116 1 2024-09-20T20:31:39.795 INFO:tasks.workunit.client.0.smithi070.stdout:1/252: chown d4/d6/d11/f38 49059 1 2024-09-20T20:31:39.796 INFO:tasks.workunit.client.0.smithi070.stdout:1/253: rename d4/d6/d11/f57 to d4/f62 0 2024-09-20T20:31:39.796 INFO:tasks.workunit.client.0.smithi070.stdout:1/254: mkdir d4/d6/d11/d63 0 2024-09-20T20:31:39.796 INFO:tasks.workunit.client.0.smithi070.stdout:2/234: truncate d3/f38 3400502 0 2024-09-20T20:31:39.797 INFO:tasks.workunit.client.0.smithi070.stdout:2/235: creat d3/d5/dd/f63 x:0 0 0 2024-09-20T20:31:39.797 INFO:tasks.workunit.client.0.smithi070.stdout:1/255: mknod d4/d6/d11/d63/c64 0 2024-09-20T20:31:39.798 INFO:tasks.workunit.client.0.smithi070.stdout:1/256: mknod d4/d1f/c65 0 2024-09-20T20:31:39.798 INFO:tasks.workunit.client.0.smithi070.stdout:1/257: creat d4/d32/d34/d44/d5a/f66 x:0 0 0 2024-09-20T20:31:39.799 INFO:tasks.workunit.client.0.smithi070.stdout:1/258: chown d4/c2b 2598 1 2024-09-20T20:31:39.801 INFO:tasks.workunit.client.0.smithi070.stdout:4/209: fsync f2 0 2024-09-20T20:31:39.801 INFO:tasks.workunit.client.0.smithi070.stdout:4/210: rmdir d6/d7/dc 39 2024-09-20T20:31:39.802 INFO:tasks.workunit.client.0.smithi070.stdout:4/211: truncate d6/d26/d34/f18 2718894 0 2024-09-20T20:31:39.803 INFO:tasks.workunit.client.0.smithi070.stdout:4/212: mkdir d6/d7/dc/d4a 0 2024-09-20T20:31:39.804 INFO:tasks.workunit.client.0.smithi070.stdout:4/213: creat d6/d7/dc/f4b x:0 0 0 2024-09-20T20:31:39.804 INFO:tasks.workunit.client.0.smithi070.stdout:6/170: write d4/d8/d17/f24 [317880,92110] 0 2024-09-20T20:31:39.804 INFO:tasks.workunit.client.0.smithi070.stdout:4/214: readlink d6/d26/d34/l36 0 2024-09-20T20:31:39.804 INFO:tasks.workunit.client.0.smithi070.stdout:6/171: symlink d4/d8/d3a/l3b 0 2024-09-20T20:31:39.805 INFO:tasks.workunit.client.0.smithi070.stdout:6/172: readlink d4/d8/l18 0 2024-09-20T20:31:39.805 INFO:tasks.workunit.client.0.smithi070.stdout:4/215: getdents d6/d26 0 2024-09-20T20:31:39.806 INFO:tasks.workunit.client.0.smithi070.stdout:4/216: fdatasync d6/d26/d34/f2d 0 2024-09-20T20:31:39.807 INFO:tasks.workunit.client.0.smithi070.stdout:4/217: mkdir d6/d7/dc/d12/d17/d4c 0 2024-09-20T20:31:39.807 INFO:tasks.workunit.client.0.smithi070.stdout:4/218: write d6/d26/d34/f2d [87313,89936] 0 2024-09-20T20:31:39.808 INFO:tasks.workunit.client.0.smithi070.stdout:4/219: creat d6/d7/dc/f4d x:0 0 0 2024-09-20T20:31:39.808 INFO:tasks.workunit.client.0.smithi070.stdout:4/220: chown d6/d7/l49 6 1 2024-09-20T20:31:39.809 INFO:tasks.workunit.client.0.smithi070.stdout:4/221: creat d6/f4e x:0 0 0 2024-09-20T20:31:39.810 INFO:tasks.workunit.client.0.smithi070.stdout:4/222: creat d6/d7/dc/d23/f4f x:0 0 0 2024-09-20T20:31:39.811 INFO:tasks.workunit.client.0.smithi070.stdout:4/223: mkdir d6/d7/dc/d12/d17/d4c/d50 0 2024-09-20T20:31:39.812 INFO:tasks.workunit.client.0.smithi070.stdout:0/226: dread d4/d8/fc [0,4194304] 0 2024-09-20T20:31:39.812 INFO:tasks.workunit.client.0.smithi070.stdout:0/227: chown d4/d13/f24 19 1 2024-09-20T20:31:39.812 INFO:tasks.workunit.client.0.smithi070.stdout:4/224: truncate d6/d7/dc/f4d 41372 0 2024-09-20T20:31:39.817 INFO:tasks.workunit.client.0.smithi070.stdout:4/225: dwrite f2 [0,4194304] 0 2024-09-20T20:31:39.818 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:39.812+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:39.819 INFO:tasks.workunit.client.0.smithi070.stdout:4/226: mkdir d6/d7/dc/d12/d51 0 2024-09-20T20:31:39.878 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:39.878 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:39.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:31:39.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:39.909 INFO:tasks.workunit.client.0.smithi070.stdout:5/181: sync 2024-09-20T20:31:39.909 INFO:tasks.workunit.client.0.smithi070.stdout:8/248: sync 2024-09-20T20:31:39.909 INFO:tasks.workunit.client.0.smithi070.stdout:9/156: sync 2024-09-20T20:31:39.909 INFO:tasks.workunit.client.0.smithi070.stdout:3/177: sync 2024-09-20T20:31:39.913 INFO:tasks.workunit.client.0.smithi070.stdout:9/157: fsync d1/f7 0 2024-09-20T20:31:39.913 INFO:tasks.workunit.client.0.smithi070.stdout:9/158: write d1/df/d18/f2f [129341,105803] 0 2024-09-20T20:31:39.913 INFO:tasks.workunit.client.0.smithi070.stdout:5/182: read d2/d4/de/f29 [899927,124443] 0 2024-09-20T20:31:39.914 INFO:tasks.workunit.client.0.smithi070.stdout:9/159: fsync d1/f2a 0 2024-09-20T20:31:39.914 INFO:tasks.workunit.client.0.smithi070.stdout:5/183: write d2/d4/de/f29 [1667050,106682] 0 2024-09-20T20:31:39.919 INFO:tasks.workunit.client.0.smithi070.stdout:3/178: dwrite d7/d8/fc [0,4194304] 0 2024-09-20T20:31:39.919 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:39.915+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:39.919 INFO:tasks.workunit.client.0.smithi070.stdout:8/249: dwrite d4/db/f16 [4194304,4194304] 0 2024-09-20T20:31:39.920 INFO:tasks.workunit.client.0.smithi070.stdout:3/179: stat d7/d15/d23/f27 0 2024-09-20T20:31:39.921 INFO:tasks.workunit.client.0.smithi070.stdout:3/180: chown d7/d8/d13/d1d/c21 15920 1 2024-09-20T20:31:39.922 INFO:tasks.workunit.client.0.smithi070.stdout:5/184: dwrite d2/df/f22 [0,4194304] 0 2024-09-20T20:31:39.926 INFO:tasks.workunit.client.0.smithi070.stdout:5/185: dread - d2/d4/de/d19/f3a zero size 2024-09-20T20:31:39.926 INFO:tasks.workunit.client.0.smithi070.stdout:5/186: chown d2/d4/de/l20 1 1 2024-09-20T20:31:39.932 INFO:tasks.workunit.client.0.smithi070.stdout:9/160: rename d1/f24 to d1/df/d38/f3b 0 2024-09-20T20:31:39.932 INFO:tasks.workunit.client.0.smithi070.stdout:3/181: symlink d7/d8/d13/d1d/l35 0 2024-09-20T20:31:39.933 INFO:tasks.workunit.client.0.smithi070.stdout:5/187: symlink d2/d4/l3b 0 2024-09-20T20:31:39.933 INFO:tasks.workunit.client.0.smithi070.stdout:9/161: chown d1/l37 29876 1 2024-09-20T20:31:39.933 INFO:tasks.workunit.client.0.smithi070.stdout:3/182: rmdir d7 39 2024-09-20T20:31:39.933 INFO:tasks.workunit.client.0.smithi070.stdout:9/162: truncate d1/f1a 946703 0 2024-09-20T20:31:39.934 INFO:tasks.workunit.client.0.smithi070.stdout:3/183: mknod d7/d15/d23/c36 0 2024-09-20T20:31:39.935 INFO:tasks.workunit.client.0.smithi070.stdout:0/228: sync 2024-09-20T20:31:39.935 INFO:tasks.workunit.client.0.smithi070.stdout:6/173: sync 2024-09-20T20:31:39.935 INFO:tasks.workunit.client.0.smithi070.stdout:2/236: sync 2024-09-20T20:31:39.935 INFO:tasks.workunit.client.0.smithi070.stdout:7/155: sync 2024-09-20T20:31:39.936 INFO:tasks.workunit.client.0.smithi070.stdout:1/259: sync 2024-09-20T20:31:39.936 INFO:tasks.workunit.client.0.smithi070.stdout:0/229: readlink d4/l6 0 2024-09-20T20:31:39.936 INFO:tasks.workunit.client.0.smithi070.stdout:6/174: fsync d4/d8/d17/f24 0 2024-09-20T20:31:39.938 INFO:tasks.workunit.client.0.smithi070.stdout:0/230: mknod d4/d13/c40 0 2024-09-20T20:31:39.938 INFO:tasks.workunit.client.0.smithi070.stdout:5/188: getdents d2/d4/de/d19 0 2024-09-20T20:31:39.938 INFO:tasks.workunit.client.0.smithi070.stdout:7/156: rename d2/d19/f1f to d2/f35 0 2024-09-20T20:31:39.938 INFO:tasks.workunit.client.0.smithi070.stdout:6/175: chown d4/c5 1383 1 2024-09-20T20:31:39.938 INFO:tasks.workunit.client.0.smithi070.stdout:0/231: chown f2 1849815 1 2024-09-20T20:31:39.938 INFO:tasks.workunit.client.0.smithi070.stdout:5/189: write d2/d4/f1e [1278730,83862] 0 2024-09-20T20:31:39.939 INFO:tasks.workunit.client.0.smithi070.stdout:6/176: mkdir d4/d8/d10/d3c 0 2024-09-20T20:31:39.942 INFO:tasks.workunit.client.0.smithi070.stdout:5/190: fdatasync d2/d4/fa 0 2024-09-20T20:31:39.942 INFO:tasks.workunit.client.0.smithi070.stdout:3/184: dread d7/f9 [0,4194304] 0 2024-09-20T20:31:39.943 INFO:tasks.workunit.client.0.smithi070.stdout:0/232: mkdir d4/d8/d12/d23/d26/d1d/d41 0 2024-09-20T20:31:39.943 INFO:tasks.workunit.client.0.smithi070.stdout:5/191: mknod d2/c3c 0 2024-09-20T20:31:39.943 INFO:tasks.workunit.client.0.smithi070.stdout:0/233: mknod d4/d8/d12/d23/d26/d1f/c42 0 2024-09-20T20:31:39.943 INFO:tasks.workunit.client.0.smithi070.stdout:3/185: rename d7/d8/d13/d1d/f20 to d7/d8/d13/d1d/f37 0 2024-09-20T20:31:39.943 INFO:tasks.workunit.client.0.smithi070.stdout:0/234: fdatasync d4/d1b/f3d 0 2024-09-20T20:31:39.943 INFO:tasks.workunit.client.0.smithi070.stdout:5/192: symlink d2/d4/de/l3d 0 2024-09-20T20:31:39.943 INFO:tasks.workunit.client.0.smithi070.stdout:3/186: fsync d7/d15/d1a/f32 0 2024-09-20T20:31:39.944 INFO:tasks.workunit.client.0.smithi070.stdout:9/163: dread d1/df/f22 [0,4194304] 0 2024-09-20T20:31:39.945 INFO:tasks.workunit.client.0.smithi070.stdout:6/177: dread d4/d8/d17/f24 [0,4194304] 0 2024-09-20T20:31:39.945 INFO:tasks.workunit.client.0.smithi070.stdout:5/193: symlink d2/df/l3e 0 2024-09-20T20:31:39.945 INFO:tasks.workunit.client.0.smithi070.stdout:9/164: chown d1/df/l10 12 1 2024-09-20T20:31:39.946 INFO:tasks.workunit.client.0.smithi070.stdout:6/178: fdatasync d4/d8/d17/d33/d36/f37 0 2024-09-20T20:31:39.947 INFO:tasks.workunit.client.0.smithi070.stdout:0/235: dread d4/f11 [0,4194304] 0 2024-09-20T20:31:39.947 INFO:tasks.workunit.client.0.smithi070.stdout:5/194: creat d2/f3f x:0 0 0 2024-09-20T20:31:39.948 INFO:tasks.workunit.client.0.smithi070.stdout:6/179: truncate d4/d8/d17/f24 710836 0 2024-09-20T20:31:39.949 INFO:tasks.workunit.client.0.smithi070.stdout:3/187: dwrite f4 [0,4194304] 0 2024-09-20T20:31:39.950 INFO:tasks.workunit.client.0.smithi070.stdout:3/188: dread - d7/d15/d23/f27 zero size 2024-09-20T20:31:39.951 INFO:tasks.workunit.client.0.smithi070.stdout:6/180: symlink d4/d8/d1e/l3d 0 2024-09-20T20:31:39.952 INFO:tasks.workunit.client.0.smithi070.stdout:5/195: dread d2/f13 [0,4194304] 0 2024-09-20T20:31:39.954 INFO:tasks.workunit.client.0.smithi070.stdout:3/189: rmdir d7/d15/d23 39 2024-09-20T20:31:39.954 INFO:tasks.workunit.client.0.smithi070.stdout:0/236: dwrite d4/d19/f3f [0,4194304] 0 2024-09-20T20:31:39.954 INFO:tasks.workunit.client.0.smithi070.stdout:6/181: fsync d4/f13 0 2024-09-20T20:31:39.955 INFO:tasks.workunit.client.0.smithi070.stdout:9/165: getdents d1/df/d25 0 2024-09-20T20:31:39.955 INFO:tasks.workunit.client.0.smithi070.stdout:9/166: write d1/f11 [2668127,2746] 0 2024-09-20T20:31:39.956 INFO:tasks.workunit.client.0.smithi070.stdout:8/250: dread d4/d27/f40 [4194304,4194304] 0 2024-09-20T20:31:39.959 INFO:tasks.workunit.client.0.smithi070.stdout:9/167: dread d1/df/d38/f3b [0,4194304] 0 2024-09-20T20:31:39.960 INFO:tasks.workunit.client.0.smithi070.stdout:0/237: write d4/d19/f3f [1743603,120134] 0 2024-09-20T20:31:39.960 INFO:tasks.workunit.client.0.smithi070.stdout:9/168: read d1/f7 [1200123,31309] 0 2024-09-20T20:31:39.965 INFO:tasks.workunit.client.0.smithi070.stdout:3/190: dread f2 [0,4194304] 0 2024-09-20T20:31:39.967 INFO:tasks.workunit.client.0.smithi070.stdout:9/169: dread d1/f14 [0,4194304] 0 2024-09-20T20:31:39.969 INFO:tasks.workunit.client.0.smithi070.stdout:5/196: mkdir d2/df/d40 0 2024-09-20T20:31:39.970 INFO:tasks.workunit.client.0.smithi070.stdout:2/237: dread d3/de/d12/d1a/f21 [0,4194304] 0 2024-09-20T20:31:39.973 INFO:tasks.workunit.client.0.smithi070.stdout:2/238: fdatasync d3/d5/d9/d1c/d1f/f3c 0 2024-09-20T20:31:39.974 INFO:tasks.workunit.client.0.smithi070.stdout:3/191: dwrite d7/d15/d1e/f2f [0,4194304] 0 2024-09-20T20:31:39.976 INFO:tasks.workunit.client.0.smithi070.stdout:4/227: sync 2024-09-20T20:31:39.977 INFO:tasks.workunit.client.0.smithi070.stdout:9/170: creat d1/df/d18/f3c x:0 0 0 2024-09-20T20:31:39.977 INFO:tasks.workunit.client.0.smithi070.stdout:6/182: symlink d4/d8/d10/d3c/l3e 0 2024-09-20T20:31:39.978 INFO:tasks.workunit.client.0.smithi070.stdout:2/239: mknod d3/d5/d9/c64 0 2024-09-20T20:31:39.978 INFO:tasks.workunit.client.0.smithi070.stdout:3/192: creat d7/d8/d13/f38 x:0 0 0 2024-09-20T20:31:39.978 INFO:tasks.workunit.client.0.smithi070.stdout:0/238: unlink d4/l6 0 2024-09-20T20:31:39.978 INFO:tasks.workunit.client.0.smithi070.stdout:8/251: creat d4/d27/d2a/d3e/f5c x:0 0 0 2024-09-20T20:31:39.979 INFO:tasks.workunit.client.0.smithi070.stdout:5/197: write d2/d7/f11 [795211,61894] 0 2024-09-20T20:31:39.979 INFO:tasks.workunit.client.0.smithi070.stdout:4/228: link d6/d26/d34/f2d d6/d7/dc/f52 0 2024-09-20T20:31:39.979 INFO:tasks.workunit.client.0.smithi070.stdout:9/171: write d1/f1f [524160,55329] 0 2024-09-20T20:31:39.979 INFO:tasks.workunit.client.0.smithi070.stdout:3/193: dread - d7/d8/f19 zero size 2024-09-20T20:31:39.980 INFO:tasks.workunit.client.0.smithi070.stdout:2/240: fsync d3/de/f1b 0 2024-09-20T20:31:39.980 INFO:tasks.workunit.client.0.smithi070.stdout:8/252: mknod d4/d27/d2a/c5d 0 2024-09-20T20:31:39.981 INFO:tasks.workunit.client.0.smithi070.stdout:8/253: creat d4/db/f5e x:0 0 0 2024-09-20T20:31:39.981 INFO:tasks.workunit.client.0.smithi070.stdout:2/241: write d3/de/d12/f5b [790534,118307] 0 2024-09-20T20:31:39.982 INFO:tasks.workunit.client.0.smithi070.stdout:8/254: write d4/db/f11 [4894286,9977] 0 2024-09-20T20:31:39.983 INFO:tasks.workunit.client.0.smithi070.stdout:4/229: symlink d6/d7/dc/d12/l53 0 2024-09-20T20:31:39.984 INFO:tasks.workunit.client.0.smithi070.stdout:2/242: creat d3/d5/d9/d1c/f65 x:0 0 0 2024-09-20T20:31:39.985 INFO:tasks.workunit.client.0.smithi070.stdout:4/230: write d6/d7/dc/d20/f38 [978104,128818] 0 2024-09-20T20:31:39.989 INFO:tasks.workunit.client.0.smithi070.stdout:6/183: dwrite d4/d8/d17/d33/d36/f37 [0,4194304] 0 2024-09-20T20:31:39.990 INFO:tasks.workunit.client.0.smithi070.stdout:3/194: dwrite d7/d15/d1e/f2f [0,4194304] 0 2024-09-20T20:31:39.990 INFO:tasks.workunit.client.0.smithi070.stdout:6/184: stat d4/d8/d17/d33/d36/f37 0 2024-09-20T20:31:39.990 INFO:tasks.workunit.client.0.smithi070.stdout:3/195: truncate f5 5190309 0 2024-09-20T20:31:39.990 INFO:tasks.workunit.client.0.smithi070.stdout:6/185: mknod d4/d8/d38/c3f 0 2024-09-20T20:31:39.991 INFO:tasks.workunit.client.0.smithi070.stdout:3/196: chown d7/d15/d1e/f2f 1572304533 1 2024-09-20T20:31:39.991 INFO:tasks.workunit.client.0.smithi070.stdout:6/186: write d4/d8/d10/f14 [1153444,19854] 0 2024-09-20T20:31:39.991 INFO:tasks.workunit.client.0.smithi070.stdout:3/197: creat d7/d8/f39 x:0 0 0 2024-09-20T20:31:39.992 INFO:tasks.workunit.client.0.smithi070.stdout:6/187: mknod d4/d8/d1e/c40 0 2024-09-20T20:31:39.994 INFO:tasks.workunit.client.0.smithi070.stdout:3/198: getdents d7 0 2024-09-20T20:31:39.994 INFO:tasks.workunit.client.0.smithi070.stdout:6/188: creat d4/d8/d3a/f41 x:0 0 0 2024-09-20T20:31:39.994 INFO:tasks.workunit.client.0.smithi070.stdout:3/199: fdatasync d7/d8/d13/f26 0 2024-09-20T20:31:39.994 INFO:tasks.workunit.client.0.smithi070.stdout:0/239: truncate d4/d19/f29 2610156 0 2024-09-20T20:31:39.994 INFO:tasks.workunit.client.0.smithi070.stdout:6/189: fsync d4/d8/d10/f2b 0 2024-09-20T20:31:39.994 INFO:tasks.workunit.client.0.smithi070.stdout:8/255: truncate d4/f25 89573 0 2024-09-20T20:31:39.995 INFO:tasks.workunit.client.0.smithi070.stdout:9/172: truncate d1/f11 1281607 0 2024-09-20T20:31:39.995 INFO:tasks.workunit.client.0.smithi070.stdout:8/256: stat d4/d27/d2a/d3e/d39 0 2024-09-20T20:31:39.996 INFO:tasks.workunit.client.0.smithi070.stdout:9/173: unlink d1/df/c12 0 2024-09-20T20:31:39.996 INFO:tasks.workunit.client.0.smithi070.stdout:4/231: dread d6/d43/f47 [0,4194304] 0 2024-09-20T20:31:39.996 INFO:tasks.workunit.client.0.smithi070.stdout:8/257: mknod d4/db/c5f 0 2024-09-20T20:31:39.997 INFO:tasks.workunit.client.0.smithi070.stdout:9/174: rmdir d1/d39 0 2024-09-20T20:31:39.998 INFO:tasks.workunit.client.0.smithi070.stdout:2/243: dwrite d3/d5/d9/d10/f13 [0,4194304] 0 2024-09-20T20:31:39.998 INFO:tasks.workunit.client.0.smithi070.stdout:9/175: chown d1/df/d2d 789 1 2024-09-20T20:31:39.999 INFO:tasks.workunit.client.0.smithi070.stdout:4/232: write d6/f8 [6110432,56523] 0 2024-09-20T20:31:39.999 INFO:tasks.workunit.client.0.smithi070.stdout:2/244: write d3/f4a [716118,120791] 0 2024-09-20T20:31:40.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/176: rename d1/df/d18/l21 to d1/df/d2d/l3d 0 2024-09-20T20:31:40.001 INFO:tasks.workunit.client.0.smithi070.stdout:3/200: dwrite d7/d8/f24 [0,4194304] 0 2024-09-20T20:31:40.004 INFO:tasks.workunit.client.0.smithi070.stdout:9/177: creat d1/f3e x:0 0 0 2024-09-20T20:31:40.004 INFO:tasks.workunit.client.0.smithi070.stdout:9/178: symlink d1/df/d38/l3f 0 2024-09-20T20:31:40.005 INFO:tasks.workunit.client.0.smithi070.stdout:4/233: dwrite d6/d7/dc/f46 [0,4194304] 0 2024-09-20T20:31:40.006 INFO:tasks.workunit.client.0.smithi070.stdout:4/234: truncate d6/d7/f16 1981228 0 2024-09-20T20:31:40.007 INFO:tasks.workunit.client.0.smithi070.stdout:4/235: mknod d6/d7/dc/d4a/c54 0 2024-09-20T20:31:40.009 INFO:tasks.workunit.client.0.smithi070.stdout:4/236: creat d6/d7/dc/d20/f55 x:0 0 0 2024-09-20T20:31:40.009 INFO:tasks.workunit.client.0.smithi070.stdout:4/237: stat d6/f11 0 2024-09-20T20:31:40.010 INFO:tasks.workunit.client.0.smithi070.stdout:4/238: creat d6/d26/d34/d40/f56 x:0 0 0 2024-09-20T20:31:40.011 INFO:tasks.workunit.client.0.smithi070.stdout:4/239: rename f2 to d6/d43/f57 0 2024-09-20T20:31:40.011 INFO:tasks.workunit.client.0.smithi070.stdout:9/179: dwrite d1/df/f22 [0,4194304] 0 2024-09-20T20:31:40.012 INFO:tasks.workunit.client.0.smithi070.stdout:9/180: chown d1/f11 1675 1 2024-09-20T20:31:40.012 INFO:tasks.workunit.client.0.smithi070.stdout:4/240: rename d6/d7/dc/d23 to d6/d7/dc/d4a/d58 0 2024-09-20T20:31:40.016 INFO:tasks.workunit.client.0.smithi070.stdout:6/190: getdents d4/d8/d1e 0 2024-09-20T20:31:40.016 INFO:tasks.workunit.client.0.smithi070.stdout:8/258: dread d4/f38 [0,4194304] 0 2024-09-20T20:31:40.017 INFO:tasks.workunit.client.0.smithi070.stdout:0/240: write f2 [2570460,100296] 0 2024-09-20T20:31:40.017 INFO:tasks.workunit.client.0.smithi070.stdout:8/259: read - d4/d27/d2a/d3e/f56 zero size 2024-09-20T20:31:40.018 INFO:tasks.workunit.client.0.smithi070.stdout:8/260: chown d4/db/f4a 27 1 2024-09-20T20:31:40.019 INFO:tasks.workunit.client.0.smithi070.stdout:0/241: chown d4/d8/d12/d23/d26/d1f/l22 57169891 1 2024-09-20T20:31:40.019 INFO:tasks.workunit.client.0.smithi070.stdout:4/241: dwrite d6/d7/dc/d4a/d58/f4f [0,4194304] 0 2024-09-20T20:31:40.019 INFO:tasks.workunit.client.0.smithi070.stdout:6/191: getdents d4/d8 0 2024-09-20T20:31:40.020 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:40.015+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:40.021 INFO:tasks.workunit.client.0.smithi070.stdout:0/242: rename d4/d8/d27 to d4/d8/d12/d43 0 2024-09-20T20:31:40.022 INFO:tasks.workunit.client.0.smithi070.stdout:4/242: creat d6/d7/f59 x:0 0 0 2024-09-20T20:31:40.022 INFO:tasks.workunit.client.0.smithi070.stdout:8/261: getdents d4/d27/d2a/d3e 0 2024-09-20T20:31:40.022 INFO:tasks.workunit.client.0.smithi070.stdout:0/243: symlink d4/l44 0 2024-09-20T20:31:40.022 INFO:tasks.workunit.client.0.smithi070.stdout:4/243: chown d6/d7/f9 42992620 1 2024-09-20T20:31:40.023 INFO:tasks.workunit.client.0.smithi070.stdout:2/245: truncate d3/d5/f1e 388773 0 2024-09-20T20:31:40.023 INFO:tasks.workunit.client.0.smithi070.stdout:4/244: mkdir d6/d43/d5a 0 2024-09-20T20:31:40.024 INFO:tasks.workunit.client.0.smithi070.stdout:2/246: write d3/de/f1b [2958829,64398] 0 2024-09-20T20:31:40.025 INFO:tasks.workunit.client.0.smithi070.stdout:4/245: creat d6/d7/dc/d12/d17/f5b x:0 0 0 2024-09-20T20:31:40.025 INFO:tasks.workunit.client.0.smithi070.stdout:2/247: creat d3/d5/dd/d5a/f66 x:0 0 0 2024-09-20T20:31:40.026 INFO:tasks.workunit.client.0.smithi070.stdout:3/201: truncate f5 1709291 0 2024-09-20T20:31:40.026 INFO:tasks.workunit.client.0.smithi070.stdout:4/246: link d6/f4e d6/d43/f5c 0 2024-09-20T20:31:40.027 INFO:tasks.workunit.client.0.smithi070.stdout:2/248: symlink d3/d4c/d5c/l67 0 2024-09-20T20:31:40.027 INFO:tasks.workunit.client.0.smithi070.stdout:3/202: symlink d7/d15/d23/l3a 0 2024-09-20T20:31:40.027 INFO:tasks.workunit.client.0.smithi070.stdout:2/249: fdatasync d3/de/d12/d1a/f46 0 2024-09-20T20:31:40.028 INFO:tasks.workunit.client.0.smithi070.stdout:8/262: dwrite d4/d27/f2f [0,4194304] 0 2024-09-20T20:31:40.029 INFO:tasks.workunit.client.0.smithi070.stdout:2/250: readlink d3/d5/d9/d1c/d4e/l5d 0 2024-09-20T20:31:40.029 INFO:tasks.workunit.client.0.smithi070.stdout:5/198: dread f1 [0,4194304] 0 2024-09-20T20:31:40.029 INFO:tasks.workunit.client.0.smithi070.stdout:5/199: stat d2/df/l10 0 2024-09-20T20:31:40.031 INFO:tasks.workunit.client.0.smithi070.stdout:8/263: rename d4/d27/c49 to d4/d27/d42/c60 0 2024-09-20T20:31:40.031 INFO:tasks.workunit.client.0.smithi070.stdout:5/200: mknod d2/df/d15/c41 0 2024-09-20T20:31:40.031 INFO:tasks.workunit.client.0.smithi070.stdout:2/251: truncate d3/d5/d9/d42/f59 208442 0 2024-09-20T20:31:40.032 INFO:tasks.workunit.client.0.smithi070.stdout:8/264: unlink d4/d27/f53 0 2024-09-20T20:31:40.032 INFO:tasks.workunit.client.0.smithi070.stdout:5/201: unlink d2/d7/c14 0 2024-09-20T20:31:40.032 INFO:tasks.workunit.client.0.smithi070.stdout:9/181: write d1/df/f22 [4412968,58843] 0 2024-09-20T20:31:40.033 INFO:tasks.workunit.client.0.smithi070.stdout:9/182: mknod d1/df/c40 0 2024-09-20T20:31:40.033 INFO:tasks.workunit.client.0.smithi070.stdout:8/265: mkdir d4/d27/d2a/d43/d61 0 2024-09-20T20:31:40.034 INFO:tasks.workunit.client.0.smithi070.stdout:4/247: getdents d6/d7/dc 0 2024-09-20T20:31:40.034 INFO:tasks.workunit.client.0.smithi070.stdout:9/183: chown d1/df/d18/l1d 814753 1 2024-09-20T20:31:40.034 INFO:tasks.workunit.client.0.smithi070.stdout:8/266: creat d4/d27/d2a/d43/d61/f62 x:0 0 0 2024-09-20T20:31:40.035 INFO:tasks.workunit.client.0.smithi070.stdout:9/184: rename d1/df/d2d/l3d to d1/df/d38/l41 0 2024-09-20T20:31:40.035 INFO:tasks.workunit.client.0.smithi070.stdout:8/267: mkdir d4/d27/d2a/d3e/d31/d63 0 2024-09-20T20:31:40.035 INFO:tasks.workunit.client.0.smithi070.stdout:9/185: chown d1/df/d18/l36 379 1 2024-09-20T20:31:40.036 INFO:tasks.workunit.client.0.smithi070.stdout:8/268: read - d4/d27/d2a/d3e/f56 zero size 2024-09-20T20:31:40.036 INFO:tasks.workunit.client.0.smithi070.stdout:8/269: mkdir d4/db/d64 0 2024-09-20T20:31:40.037 INFO:tasks.workunit.client.0.smithi070.stdout:0/244: truncate d4/fd 1564591 0 2024-09-20T20:31:40.038 INFO:tasks.workunit.client.0.smithi070.stdout:8/270: getdents d4/d27/d2a/d3e/d31/d63 0 2024-09-20T20:31:40.038 INFO:tasks.workunit.client.0.smithi070.stdout:0/245: creat d4/d19/f45 x:0 0 0 2024-09-20T20:31:40.039 INFO:tasks.workunit.client.0.smithi070.stdout:0/246: mknod d4/d8/d12/d43/d3b/c46 0 2024-09-20T20:31:40.040 INFO:tasks.workunit.client.0.smithi070.stdout:0/247: readlink d4/d8/d12/d23/d26/d1d/l31 0 2024-09-20T20:31:40.042 INFO:tasks.workunit.client.0.smithi070.stdout:9/186: truncate d1/df/d18/f20 228803 0 2024-09-20T20:31:40.043 INFO:tasks.workunit.client.0.smithi070.stdout:9/187: mknod d1/df/c42 0 2024-09-20T20:31:40.044 INFO:tasks.workunit.client.0.smithi070.stdout:9/188: mknod d1/df/d2d/c43 0 2024-09-20T20:31:40.045 INFO:tasks.workunit.client.0.smithi070.stdout:9/189: readlink d1/df/d18/l36 0 2024-09-20T20:31:40.046 INFO:tasks.workunit.client.0.smithi070.stdout:4/248: dwrite d6/d26/d34/f18 [4194304,4194304] 0 2024-09-20T20:31:40.046 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:31:40.046 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:31:40.046 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:31:40.046 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:31:40.046 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:31:40.046 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:31:40.047 INFO:teuthology.orchestra.run.smithi070.stdout:oload 110 2024-09-20T20:31:40.047 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 1 2024-09-20T20:31:40.047 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:31:40.047 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0011 2024-09-20T20:31:40.047 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0012 2024-09-20T20:31:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:31:40.047 INFO:tasks.workunit.client.0.smithi070.stdout:4/249: readlink d6/d7/l49 0 2024-09-20T20:31:40.048 INFO:tasks.workunit.client.0.smithi070.stdout:4/250: write d6/d7/dc/d4a/d58/f3c [495490,97800] 0 2024-09-20T20:31:40.051 INFO:tasks.workunit.client.0.smithi070.stdout:0/248: truncate d4/d8/d12/f14 1129683 0 2024-09-20T20:31:40.052 INFO:tasks.workunit.client.0.smithi070.stdout:0/249: fsync d4/d1b/f3d 0 2024-09-20T20:31:40.053 INFO:tasks.workunit.client.0.smithi070.stdout:8/271: dread d4/d27/d2a/d3e/d31/f3f [0,4194304] 0 2024-09-20T20:31:40.054 INFO:tasks.workunit.client.0.smithi070.stdout:0/250: chown d4/d8/d12/f14 0 1 2024-09-20T20:31:40.054 INFO:tasks.workunit.client.0.smithi070.stdout:9/190: unlink d1/df/d18/f20 0 2024-09-20T20:31:40.055 INFO:tasks.workunit.client.0.smithi070.stdout:9/191: write d1/f5 [4475956,27022] 0 2024-09-20T20:31:40.055 INFO:tasks.workunit.client.0.smithi070.stdout:4/251: dwrite d6/d26/d34/d40/f56 [0,4194304] 0 2024-09-20T20:31:40.058 INFO:tasks.workunit.client.0.smithi070.stdout:4/252: symlink d6/d7/dc/l5d 0 2024-09-20T20:31:40.058 INFO:tasks.workunit.client.0.smithi070.stdout:4/253: rename d6/d7/dc/d12 to d6/d5e 0 2024-09-20T20:31:40.060 INFO:tasks.workunit.client.0.smithi070.stdout:9/192: fsync d1/f5 0 2024-09-20T20:31:40.063 INFO:tasks.workunit.client.0.smithi070.stdout:9/193: getdents d1/df/d18 0 2024-09-20T20:31:40.064 INFO:tasks.workunit.client.0.smithi070.stdout:4/254: dwrite d6/d7/dc/d4a/d58/f2c [4194304,4194304] 0 2024-09-20T20:31:40.064 INFO:tasks.workunit.client.0.smithi070.stdout:0/251: write d4/d8/fc [1990293,104849] 0 2024-09-20T20:31:40.065 INFO:tasks.workunit.client.0.smithi070.stdout:0/252: fsync d4/d8/d12/d43/f2c 0 2024-09-20T20:31:40.065 INFO:tasks.workunit.client.0.smithi070.stdout:8/272: dwrite d4/d27/f40 [0,4194304] 0 2024-09-20T20:31:40.069 INFO:tasks.workunit.client.0.smithi070.stdout:9/194: mkdir d1/df/d18/d44 0 2024-09-20T20:31:40.069 INFO:tasks.workunit.client.0.smithi070.stdout:4/255: unlink d6/d5e/c42 0 2024-09-20T20:31:40.069 INFO:tasks.workunit.client.0.smithi070.stdout:9/195: symlink d1/l45 0 2024-09-20T20:31:40.070 INFO:tasks.workunit.client.0.smithi070.stdout:0/253: dread d4/d19/f3f [0,4194304] 0 2024-09-20T20:31:40.070 INFO:tasks.workunit.client.0.smithi070.stdout:4/256: rmdir d6/d26/d34 39 2024-09-20T20:31:40.070 INFO:tasks.workunit.client.0.smithi070.stdout:9/196: chown d1/df/d38/f3b 27760 1 2024-09-20T20:31:40.071 INFO:tasks.workunit.client.0.smithi070.stdout:4/257: fsync d6/d43/f47 0 2024-09-20T20:31:40.071 INFO:tasks.workunit.client.0.smithi070.stdout:9/197: mkdir d1/df/d18/d46 0 2024-09-20T20:31:40.072 INFO:tasks.workunit.client.0.smithi070.stdout:9/198: creat d1/df/d38/f47 x:0 0 0 2024-09-20T20:31:40.073 INFO:tasks.workunit.client.0.smithi070.stdout:4/258: getdents d6/d26/d34 0 2024-09-20T20:31:40.074 INFO:tasks.workunit.client.0.smithi070.stdout:4/259: chown d6/d26/d34/f21 3790 1 2024-09-20T20:31:40.074 INFO:tasks.workunit.client.0.smithi070.stdout:8/273: dwrite d4/d27/d2a/d3e/f55 [0,4194304] 0 2024-09-20T20:31:40.077 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-20T20:31:40.077 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-09-20T20:31:40.078 INFO:tasks.workunit.client.0.smithi070.stdout:8/274: mknod d4/d27/d2a/d3e/d31/d63/c65 0 2024-09-20T20:31:40.078 INFO:tasks.workunit.client.0.smithi070.stdout:0/254: dwrite d4/d1b/f3d [0,4194304] 0 2024-09-20T20:31:40.078 INFO:tasks.workunit.client.0.smithi070.stdout:0/255: getdents d4/d8/d12/d23 0 2024-09-20T20:31:40.081 INFO:tasks.workunit.client.0.smithi070.stdout:0/256: readlink d4/d8/d12/d23/d26/d1f/l22 0 2024-09-20T20:31:40.082 INFO:tasks.workunit.client.0.smithi070.stdout:4/260: dwrite d6/d7/dc/d20/f38 [0,4194304] 0 2024-09-20T20:31:40.083 INFO:tasks.workunit.client.0.smithi070.stdout:4/261: symlink d6/d26/l5f 0 2024-09-20T20:31:40.084 INFO:tasks.workunit.client.0.smithi070.stdout:8/275: dwrite d4/d27/d2a/d3e/f56 [0,4194304] 0 2024-09-20T20:31:40.084 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:40.084 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:40.086 INFO:tasks.workunit.client.0.smithi070.stdout:8/276: mkdir d4/db/d66 0 2024-09-20T20:31:40.086 INFO:tasks.workunit.client.0.smithi070.stdout:8/277: creat d4/d27/d2a/d3e/f67 x:0 0 0 2024-09-20T20:31:40.091 INFO:tasks.workunit.client.0.smithi070.stdout:8/278: dread - d4/d27/d2a/d3e/d31/f52 zero size 2024-09-20T20:31:40.092 INFO:tasks.workunit.client.0.smithi070.stdout:8/279: creat d4/d27/f68 x:0 0 0 2024-09-20T20:31:40.092 INFO:tasks.workunit.client.0.smithi070.stdout:4/262: dwrite d6/d7/dc/d4a/d58/f4f [4194304,4194304] 0 2024-09-20T20:31:40.092 INFO:tasks.workunit.client.0.smithi070.stdout:8/280: fsync d4/f38 0 2024-09-20T20:31:40.093 INFO:tasks.workunit.client.0.smithi070.stdout:4/263: write d6/d26/d34/f18 [7301843,106599] 0 2024-09-20T20:31:40.099 INFO:tasks.workunit.client.0.smithi070.stdout:4/264: dwrite d6/d5e/d17/f5b [0,4194304] 0 2024-09-20T20:31:40.100 INFO:tasks.workunit.client.0.smithi070.stdout:4/265: creat d6/d43/f60 x:0 0 0 2024-09-20T20:31:40.107 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:40.110 INFO:tasks.workunit.client.0.smithi070.stdout:8/281: dread d4/d27/d2a/d3e/d39/f51 [0,4194304] 0 2024-09-20T20:31:40.111 INFO:tasks.workunit.client.0.smithi070.stdout:0/257: dread f2 [0,4194304] 0 2024-09-20T20:31:40.112 INFO:tasks.workunit.client.0.smithi070.stdout:4/266: dread d6/d7/f16 [0,4194304] 0 2024-09-20T20:31:40.112 INFO:tasks.workunit.client.0.smithi070.stdout:0/258: readlink d4/d13/l34 0 2024-09-20T20:31:40.113 INFO:tasks.workunit.client.0.smithi070.stdout:4/267: mkdir d6/d26/d34/d61 0 2024-09-20T20:31:40.113 INFO:tasks.workunit.client.0.smithi070.stdout:0/259: symlink d4/d8/l47 0 2024-09-20T20:31:40.113 INFO:tasks.workunit.client.0.smithi070.stdout:0/260: mkdir d4/d48 0 2024-09-20T20:31:40.113 INFO:tasks.workunit.client.0.smithi070.stdout:4/268: creat d6/d7/dc/d20/f62 x:0 0 0 2024-09-20T20:31:40.114 INFO:tasks.workunit.client.0.smithi070.stdout:0/261: chown d4/d8/d12/d23/d26 9448 1 2024-09-20T20:31:40.114 INFO:tasks.workunit.client.0.smithi070.stdout:4/269: dread - d6/d7/dc/d20/f55 zero size 2024-09-20T20:31:40.114 INFO:tasks.workunit.client.0.smithi070.stdout:0/262: dread - d4/d13/f24 zero size 2024-09-20T20:31:40.115 INFO:tasks.workunit.client.0.smithi070.stdout:8/282: truncate d4/d27/d42/f54 3843438 0 2024-09-20T20:31:40.115 INFO:tasks.workunit.client.0.smithi070.stdout:4/270: fdatasync d6/d43/f47 0 2024-09-20T20:31:40.117 INFO:tasks.workunit.client.0.smithi070.stdout:4/271: read d6/d7/f29 [98050,36086] 0 2024-09-20T20:31:40.117 INFO:tasks.workunit.client.0.smithi070.stdout:1/260: sync 2024-09-20T20:31:40.117 INFO:tasks.workunit.client.0.smithi070.stdout:7/157: sync 2024-09-20T20:31:40.117 INFO:tasks.workunit.client.0.smithi070.stdout:2/252: sync 2024-09-20T20:31:40.119 INFO:tasks.workunit.client.0.smithi070.stdout:4/272: write d6/d7/dc/d4a/d58/f3c [581264,34210] 0 2024-09-20T20:31:40.120 INFO:tasks.workunit.client.0.smithi070.stdout:4/273: chown d6/d7/f59 4 1 2024-09-20T20:31:40.120 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:40.116+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:40.121 INFO:tasks.workunit.client.0.smithi070.stdout:1/261: link d4/d6/d11/d2c/d3b/c5c d4/d32/d34/d44/c67 0 2024-09-20T20:31:40.123 INFO:tasks.workunit.client.0.smithi070.stdout:1/262: dread d4/d6/f21 [0,4194304] 0 2024-09-20T20:31:40.124 INFO:tasks.workunit.client.0.smithi070.stdout:0/263: dwrite d4/d19/f29 [0,4194304] 0 2024-09-20T20:31:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:1/263: fdatasync d4/d6/d2f/f5f 0 2024-09-20T20:31:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:0/264: write d4/d1b/f3d [3267454,117757] 0 2024-09-20T20:31:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:6/192: sync 2024-09-20T20:31:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:5/202: sync 2024-09-20T20:31:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:3/203: sync 2024-09-20T20:31:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:2/253: dwrite d3/de/d12/d1a/f21 [0,4194304] 0 2024-09-20T20:31:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:5/203: creat d2/df/d15/f42 x:0 0 0 2024-09-20T20:31:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:3/204: write d7/d15/f18 [1305832,35951] 0 2024-09-20T20:31:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:7/158: dwrite d2/f10 [0,4194304] 0 2024-09-20T20:31:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:2/254: chown d3/d5/dd/ff 496086 1 2024-09-20T20:31:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:0/265: rename d4/d8/f10 to d4/f49 0 2024-09-20T20:31:40.131 INFO:tasks.workunit.client.0.smithi070.stdout:3/205: mknod d7/d15/d1e/c3b 0 2024-09-20T20:31:40.131 INFO:tasks.workunit.client.0.smithi070.stdout:4/274: dwrite d6/d26/f27 [4194304,4194304] 0 2024-09-20T20:31:40.131 INFO:tasks.workunit.client.0.smithi070.stdout:2/255: symlink d3/d5/d9/d42/l68 0 2024-09-20T20:31:40.131 INFO:tasks.workunit.client.0.smithi070.stdout:1/264: link d4/d6/d26/f5b d4/d6/d11/d2c/d3a/f68 0 2024-09-20T20:31:40.131 INFO:tasks.workunit.client.0.smithi070.stdout:0/266: readlink d4/d13/l34 0 2024-09-20T20:31:40.132 INFO:tasks.workunit.client.0.smithi070.stdout:1/265: chown d4/d6/f14 14759797 1 2024-09-20T20:31:40.133 INFO:tasks.workunit.client.0.smithi070.stdout:5/204: symlink d2/l43 0 2024-09-20T20:31:40.133 INFO:tasks.workunit.client.0.smithi070.stdout:3/206: creat d7/d15/d23/f3c x:0 0 0 2024-09-20T20:31:40.134 INFO:tasks.workunit.client.0.smithi070.stdout:1/266: mkdir d4/d1f/d69 0 2024-09-20T20:31:40.134 INFO:tasks.workunit.client.0.smithi070.stdout:7/159: rmdir d2/d8/d31 0 2024-09-20T20:31:40.135 INFO:tasks.workunit.client.0.smithi070.stdout:2/256: write d3/d5/d9/f29 [114605,18458] 0 2024-09-20T20:31:40.135 INFO:tasks.workunit.client.0.smithi070.stdout:4/275: write d6/ff [1023125,6620] 0 2024-09-20T20:31:40.136 INFO:tasks.workunit.client.0.smithi070.stdout:3/207: mknod d7/d8/d13/c3d 0 2024-09-20T20:31:40.137 INFO:tasks.workunit.client.0.smithi070.stdout:1/267: symlink d4/d32/d34/d44/l6a 0 2024-09-20T20:31:40.138 INFO:tasks.workunit.client.0.smithi070.stdout:9/199: sync 2024-09-20T20:31:40.138 INFO:tasks.workunit.client.0.smithi070.stdout:4/276: readlink d6/d26/d34/l36 0 2024-09-20T20:31:40.138 INFO:tasks.workunit.client.0.smithi070.stdout:3/208: rmdir d7/d15/d1a 39 2024-09-20T20:31:40.139 INFO:tasks.workunit.client.0.smithi070.stdout:6/193: dwrite d4/d8/fa [0,4194304] 0 2024-09-20T20:31:40.143 INFO:tasks.workunit.client.0.smithi070.stdout:2/257: link d3/d5/d9/d10/f13 d3/d5/d9/d42/f69 0 2024-09-20T20:31:40.145 INFO:tasks.workunit.client.0.smithi070.stdout:0/267: dwrite d4/d13/f24 [0,4194304] 0 2024-09-20T20:31:40.146 INFO:tasks.workunit.client.0.smithi070.stdout:7/160: dwrite d2/d8/f16 [0,4194304] 0 2024-09-20T20:31:40.149 INFO:tasks.workunit.client.0.smithi070.stdout:0/268: creat d4/d8/f4a x:0 0 0 2024-09-20T20:31:40.149 INFO:tasks.workunit.client.0.smithi070.stdout:8/283: dread d4/d27/d2a/f1c [0,4194304] 0 2024-09-20T20:31:40.150 INFO:tasks.workunit.client.0.smithi070.stdout:9/200: dwrite d1/f1a [0,4194304] 0 2024-09-20T20:31:40.152 INFO:tasks.workunit.client.0.smithi070.stdout:1/268: dread d4/d6/d11/f38 [0,4194304] 0 2024-09-20T20:31:40.153 INFO:tasks.workunit.client.0.smithi070.stdout:9/201: mknod d1/df/d18/c48 0 2024-09-20T20:31:40.156 INFO:tasks.workunit.client.0.smithi070.stdout:9/202: rmdir d1/df/d18 39 2024-09-20T20:31:40.156 INFO:tasks.workunit.client.0.smithi070.stdout:1/269: mknod d4/d6/d2f/c6b 0 2024-09-20T20:31:40.157 INFO:tasks.workunit.client.0.smithi070.stdout:4/277: write d6/d43/f5c [636443,17480] 0 2024-09-20T20:31:40.160 INFO:tasks.workunit.client.0.smithi070.stdout:1/270: write d4/d6/f47 [459958,75642] 0 2024-09-20T20:31:40.161 INFO:tasks.workunit.client.0.smithi070.stdout:2/258: dwrite d3/d5/dd/d5a/f5f [0,4194304] 0 2024-09-20T20:31:40.161 INFO:tasks.workunit.client.0.smithi070.stdout:0/269: dwrite d4/f7 [4194304,4194304] 0 2024-09-20T20:31:40.162 INFO:tasks.workunit.client.0.smithi070.stdout:3/209: dwrite d7/d15/d1a/f2c [0,4194304] 0 2024-09-20T20:31:40.162 INFO:tasks.workunit.client.0.smithi070.stdout:2/259: dread - d3/f36 zero size 2024-09-20T20:31:40.162 INFO:tasks.workunit.client.0.smithi070.stdout:2/260: fsync d3/de/f39 0 2024-09-20T20:31:40.163 INFO:tasks.workunit.client.0.smithi070.stdout:2/261: write d3/f36 [715882,39938] 0 2024-09-20T20:31:40.164 INFO:tasks.workunit.client.0.smithi070.stdout:1/271: dread - d4/d6/d11/d2c/d3b/f3e zero size 2024-09-20T20:31:40.166 INFO:tasks.workunit.client.0.smithi070.stdout:0/270: dread d4/d8/d12/d23/d26/f2a [0,4194304] 0 2024-09-20T20:31:40.166 INFO:tasks.workunit.client.0.smithi070.stdout:3/210: mknod d7/d15/d23/c3e 0 2024-09-20T20:31:40.166 INFO:tasks.workunit.client.0.smithi070.stdout:1/272: mkdir d4/d6/d11/d63/d6c 0 2024-09-20T20:31:40.167 INFO:tasks.workunit.client.0.smithi070.stdout:9/203: getdents d1 0 2024-09-20T20:31:40.167 INFO:tasks.workunit.client.0.smithi070.stdout:0/271: chown d4/d8/d12/d43/f2c 27894 1 2024-09-20T20:31:40.170 INFO:tasks.workunit.client.0.smithi070.stdout:9/204: mknod d1/df/d25/c49 0 2024-09-20T20:31:40.171 INFO:tasks.workunit.client.0.smithi070.stdout:0/272: mkdir d4/d1b/d4b 0 2024-09-20T20:31:40.176 INFO:tasks.workunit.client.0.smithi070.stdout:4/278: dwrite d6/d7/f59 [0,4194304] 0 2024-09-20T20:31:40.177 INFO:tasks.workunit.client.0.smithi070.stdout:2/262: dwrite d3/d5/dd/f15 [4194304,4194304] 0 2024-09-20T20:31:40.178 INFO:tasks.workunit.client.0.smithi070.stdout:9/205: getdents d1/df/d18 0 2024-09-20T20:31:40.179 INFO:tasks.workunit.client.0.smithi070.stdout:1/273: dwrite d4/d6/f52 [0,4194304] 0 2024-09-20T20:31:40.179 INFO:tasks.workunit.client.0.smithi070.stdout:4/279: write d6/d7/f3b [597498,124272] 0 2024-09-20T20:31:40.179 INFO:tasks.workunit.client.0.smithi070.stdout:3/211: truncate d7/d8/f24 1814061 0 2024-09-20T20:31:40.181 INFO:tasks.workunit.client.0.smithi070.stdout:0/273: dread d4/f7 [4194304,4194304] 0 2024-09-20T20:31:40.181 INFO:tasks.workunit.client.0.smithi070.stdout:9/206: mkdir d1/df/d4a 0 2024-09-20T20:31:40.182 INFO:tasks.workunit.client.0.smithi070.stdout:2/263: rename d3/d5/d9/d1c/d1f/d3e/f51 to d3/d5/d9/d10/f6a 0 2024-09-20T20:31:40.182 INFO:tasks.workunit.client.0.smithi070.stdout:8/284: dread d4/db/ff [0,4194304] 0 2024-09-20T20:31:40.182 INFO:tasks.workunit.client.0.smithi070.stdout:3/212: write d7/d8/d13/d1d/f37 [1103272,59561] 0 2024-09-20T20:31:40.184 INFO:tasks.workunit.client.0.smithi070.stdout:5/205: dread d2/df/d15/f26 [0,4194304] 0 2024-09-20T20:31:40.184 INFO:tasks.workunit.client.0.smithi070.stdout:4/280: mkdir d6/d5e/d51/d63 0 2024-09-20T20:31:40.184 INFO:tasks.workunit.client.0.smithi070.stdout:9/207: creat d1/df/d38/f4b x:0 0 0 2024-09-20T20:31:40.184 INFO:tasks.workunit.client.0.smithi070.stdout:8/285: symlink d4/d27/d2a/d3e/d39/l69 0 2024-09-20T20:31:40.185 INFO:tasks.workunit.client.0.smithi070.stdout:0/274: unlink d4/d8/l47 0 2024-09-20T20:31:40.185 INFO:tasks.workunit.client.0.smithi070.stdout:4/281: symlink d6/d43/l64 0 2024-09-20T20:31:40.185 INFO:tasks.workunit.client.0.smithi070.stdout:7/161: dread d2/f26 [0,4194304] 0 2024-09-20T20:31:40.186 INFO:tasks.workunit.client.0.smithi070.stdout:3/213: getdents d7/d15/d1a 0 2024-09-20T20:31:40.187 INFO:tasks.workunit.client.0.smithi070.stdout:5/206: fsync d2/df/d15/f42 0 2024-09-20T20:31:40.187 INFO:tasks.workunit.client.0.smithi070.stdout:7/162: stat d2/d19/d2e/c34 0 2024-09-20T20:31:40.188 INFO:tasks.workunit.client.0.smithi070.stdout:3/214: dread - d7/d15/d23/f3c zero size 2024-09-20T20:31:40.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/207: creat d2/d4/de/d19/f44 x:0 0 0 2024-09-20T20:31:40.189 INFO:tasks.workunit.client.0.smithi070.stdout:1/274: write d4/d6/d26/f5b [369924,92175] 0 2024-09-20T20:31:40.189 INFO:tasks.workunit.client.0.smithi070.stdout:0/275: creat d4/d8/d12/d23/d26/d1d/d37/f4c x:0 0 0 2024-09-20T20:31:40.190 INFO:tasks.workunit.client.0.smithi070.stdout:3/215: chown d7/d15/d1e 13 1 2024-09-20T20:31:40.191 INFO:tasks.workunit.client.0.smithi070.stdout:5/208: chown d2/l1f 7747 1 2024-09-20T20:31:40.192 INFO:tasks.workunit.client.0.smithi070.stdout:2/264: dwrite d3/d5/d9/d42/f59 [0,4194304] 0 2024-09-20T20:31:40.192 INFO:tasks.workunit.client.0.smithi070.stdout:9/208: read f0 [7198753,96059] 0 2024-09-20T20:31:40.192 INFO:tasks.workunit.client.0.smithi070.stdout:1/275: rmdir d4/d6/d11/d63 39 2024-09-20T20:31:40.193 INFO:tasks.workunit.client.0.smithi070.stdout:5/209: write d2/d4/de/f34 [823141,68717] 0 2024-09-20T20:31:40.193 INFO:tasks.workunit.client.0.smithi070.stdout:8/286: dread d4/d27/d2a/f1c [0,4194304] 0 2024-09-20T20:31:40.194 INFO:tasks.workunit.client.0.smithi070.stdout:0/276: mkdir d4/d8/d12/d23/d26/d1f/d4d 0 2024-09-20T20:31:40.194 INFO:tasks.workunit.client.0.smithi070.stdout:2/265: dread - d3/de/d12/d1a/f46 zero size 2024-09-20T20:31:40.195 INFO:tasks.workunit.client.0.smithi070.stdout:0/277: readlink d4/lf 0 2024-09-20T20:31:40.195 INFO:tasks.workunit.client.0.smithi070.stdout:5/210: creat d2/df/d15/f45 x:0 0 0 2024-09-20T20:31:40.195 INFO:tasks.workunit.client.0.smithi070.stdout:1/276: mknod d4/d6/c6d 0 2024-09-20T20:31:40.195 INFO:tasks.workunit.client.0.smithi070.stdout:9/209: mknod d1/df/d18/d44/c4c 0 2024-09-20T20:31:40.196 INFO:tasks.workunit.client.0.smithi070.stdout:3/216: link f3 d7/d15/f3f 0 2024-09-20T20:31:40.196 INFO:tasks.workunit.client.0.smithi070.stdout:0/278: mkdir d4/d48/d4e 0 2024-09-20T20:31:40.196 INFO:tasks.workunit.client.0.smithi070.stdout:5/211: mkdir d2/df/d40/d46 0 2024-09-20T20:31:40.196 INFO:tasks.workunit.client.0.smithi070.stdout:2/266: mknod d3/de/c6b 0 2024-09-20T20:31:40.197 INFO:tasks.workunit.client.0.smithi070.stdout:3/217: stat d7/fb 0 2024-09-20T20:31:40.198 INFO:tasks.workunit.client.0.smithi070.stdout:2/267: mknod d3/de/d12/d1a/c6c 0 2024-09-20T20:31:40.198 INFO:tasks.workunit.client.0.smithi070.stdout:5/212: fsync d2/fb 0 2024-09-20T20:31:40.198 INFO:tasks.workunit.client.0.smithi070.stdout:9/210: rename d1/df/d38/l41 to d1/df/d18/d44/l4d 0 2024-09-20T20:31:40.199 INFO:tasks.workunit.client.0.smithi070.stdout:1/277: getdents d4/d6/d11/d2c/d3a 0 2024-09-20T20:31:40.199 INFO:tasks.workunit.client.0.smithi070.stdout:9/211: dread - d1/f26 zero size 2024-09-20T20:31:40.199 INFO:tasks.workunit.client.0.smithi070.stdout:3/218: mknod d7/d15/c40 0 2024-09-20T20:31:40.200 INFO:tasks.workunit.client.0.smithi070.stdout:5/213: chown d2/d4/de/l3d 7 1 2024-09-20T20:31:40.200 INFO:tasks.workunit.client.0.smithi070.stdout:0/279: symlink d4/d8/d12/d23/d26/d1d/d41/l4f 0 2024-09-20T20:31:40.201 INFO:tasks.workunit.client.0.smithi070.stdout:2/268: getdents d3/de/d12 0 2024-09-20T20:31:40.201 INFO:tasks.workunit.client.0.smithi070.stdout:9/212: creat d1/df/d2d/f4e x:0 0 0 2024-09-20T20:31:40.201 INFO:tasks.workunit.client.0.smithi070.stdout:5/214: write d2/df/d15/f45 [1022322,23612] 0 2024-09-20T20:31:40.202 INFO:tasks.workunit.client.0.smithi070.stdout:8/287: dwrite d4/d27/d2a/f21 [0,4194304] 0 2024-09-20T20:31:40.202 INFO:tasks.workunit.client.0.smithi070.stdout:3/219: write d7/d8/d13/f38 [324699,80392] 0 2024-09-20T20:31:40.203 INFO:tasks.workunit.client.0.smithi070.stdout:3/220: chown d7/d15/d23/f27 110430 1 2024-09-20T20:31:40.204 INFO:tasks.workunit.client.0.smithi070.stdout:9/213: creat d1/df/d25/f4f x:0 0 0 2024-09-20T20:31:40.204 INFO:tasks.workunit.client.0.smithi070.stdout:2/269: fsync d3/d5/d9/d1c/d1f/f5e 0 2024-09-20T20:31:40.205 INFO:tasks.workunit.client.0.smithi070.stdout:3/221: rmdir d7/d15/d1a 39 2024-09-20T20:31:40.205 INFO:tasks.workunit.client.0.smithi070.stdout:8/288: write d4/d27/d2a/f1c [5038418,21761] 0 2024-09-20T20:31:40.205 INFO:tasks.workunit.client.0.smithi070.stdout:5/215: mkdir d2/d4/de/d47 0 2024-09-20T20:31:40.205 INFO:tasks.workunit.client.0.smithi070.stdout:2/270: fsync d3/de/f1b 0 2024-09-20T20:31:40.206 INFO:tasks.workunit.client.0.smithi070.stdout:5/216: write d2/d7/f11 [865062,22951] 0 2024-09-20T20:31:40.206 INFO:tasks.workunit.client.0.smithi070.stdout:2/271: read - d3/d5/d9/d1c/d1f/f5e zero size 2024-09-20T20:31:40.207 INFO:tasks.workunit.client.0.smithi070.stdout:5/217: mknod d2/d7/c48 0 2024-09-20T20:31:40.208 INFO:tasks.workunit.client.0.smithi070.stdout:5/218: readlink d2/d4/de/l24 0 2024-09-20T20:31:40.208 INFO:tasks.workunit.client.0.smithi070.stdout:2/272: truncate d3/d5/d9/f29 993533 0 2024-09-20T20:31:40.209 INFO:tasks.workunit.client.0.smithi070.stdout:6/194: dread d4/f11 [0,4194304] 0 2024-09-20T20:31:40.210 INFO:tasks.workunit.client.0.smithi070.stdout:3/222: truncate d7/d15/f18 1546746 0 2024-09-20T20:31:40.211 INFO:tasks.workunit.client.0.smithi070.stdout:6/195: chown d4/d8/d10/d3c 56987896 1 2024-09-20T20:31:40.211 INFO:tasks.workunit.client.0.smithi070.stdout:2/273: creat d3/de/f6d x:0 0 0 2024-09-20T20:31:40.212 INFO:tasks.workunit.client.0.smithi070.stdout:5/219: getdents d2/d4/de/d19 0 2024-09-20T20:31:40.212 INFO:tasks.workunit.client.0.smithi070.stdout:3/223: creat d7/d8/d13/d1d/f41 x:0 0 0 2024-09-20T20:31:40.213 INFO:tasks.workunit.client.0.smithi070.stdout:5/220: fdatasync d2/d7/f11 0 2024-09-20T20:31:40.214 INFO:tasks.workunit.client.0.smithi070.stdout:6/196: truncate d4/d8/d10/f15 946955 0 2024-09-20T20:31:40.214 INFO:tasks.workunit.client.0.smithi070.stdout:5/221: creat d2/d7/f49 x:0 0 0 2024-09-20T20:31:40.216 INFO:tasks.workunit.client.0.smithi070.stdout:8/289: dwrite d4/db/f1b [0,4194304] 0 2024-09-20T20:31:40.218 INFO:tasks.workunit.client.0.smithi070.stdout:9/214: dwrite d1/f11 [0,4194304] 0 2024-09-20T20:31:40.221 INFO:tasks.workunit.client.0.smithi070.stdout:2/274: dwrite f2 [12582912,4194304] 0 2024-09-20T20:31:40.221 INFO:tasks.workunit.client.0.smithi070.stdout:9/215: chown d1/df/d18/l27 2401310 1 2024-09-20T20:31:40.221 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:40.217+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:40.222 INFO:tasks.workunit.client.0.smithi070.stdout:6/197: rmdir d4 39 2024-09-20T20:31:40.222 INFO:tasks.workunit.client.0.smithi070.stdout:8/290: rename d4/d27/f68 to d4/db/d66/f6a 0 2024-09-20T20:31:40.223 INFO:tasks.workunit.client.0.smithi070.stdout:7/163: dread d2/fa [0,4194304] 0 2024-09-20T20:31:40.224 INFO:tasks.workunit.client.0.smithi070.stdout:3/224: dwrite d7/d15/d1a/f32 [4194304,4194304] 0 2024-09-20T20:31:40.228 INFO:tasks.workunit.client.0.smithi070.stdout:2/275: fsync d3/d5/d9/d10/f13 0 2024-09-20T20:31:40.228 INFO:tasks.workunit.client.0.smithi070.stdout:3/225: readlink l6 0 2024-09-20T20:31:40.228 INFO:tasks.workunit.client.0.smithi070.stdout:2/276: fdatasync d3/de/d12/d1a/f30 0 2024-09-20T20:31:40.229 INFO:tasks.workunit.client.0.smithi070.stdout:5/222: link d2/d7/d28/l30 d2/df/d40/l4a 0 2024-09-20T20:31:40.229 INFO:tasks.workunit.client.0.smithi070.stdout:9/216: symlink d1/df/d4a/l50 0 2024-09-20T20:31:40.229 INFO:tasks.workunit.client.0.smithi070.stdout:6/198: truncate d4/d8/f2f 303086 0 2024-09-20T20:31:40.229 INFO:tasks.workunit.client.0.smithi070.stdout:3/226: creat d7/d8/f42 x:0 0 0 2024-09-20T20:31:40.232 INFO:tasks.workunit.client.0.smithi070.stdout:6/199: creat d4/d8/d17/f42 x:0 0 0 2024-09-20T20:31:40.232 INFO:tasks.workunit.client.0.smithi070.stdout:8/291: read d4/db/f16 [883492,8820] 0 2024-09-20T20:31:40.232 INFO:tasks.workunit.client.0.smithi070.stdout:1/278: dread d4/d6/f17 [0,4194304] 0 2024-09-20T20:31:40.233 INFO:tasks.workunit.client.0.smithi070.stdout:6/200: mknod d4/d8/d10/d3c/c43 0 2024-09-20T20:31:40.233 INFO:tasks.workunit.client.0.smithi070.stdout:1/279: creat d4/d1f/f6e x:0 0 0 2024-09-20T20:31:40.233 INFO:tasks.workunit.client.0.smithi070.stdout:9/217: link d1/df/d2d/l31 d1/df/d18/l51 0 2024-09-20T20:31:40.233 INFO:tasks.workunit.client.0.smithi070.stdout:7/164: dwrite d2/d8/f33 [0,4194304] 0 2024-09-20T20:31:40.234 INFO:tasks.workunit.client.0.smithi070.stdout:5/223: write d2/d4/f1e [1594062,9868] 0 2024-09-20T20:31:40.234 INFO:tasks.workunit.client.0.smithi070.stdout:1/280: readlink d4/l61 0 2024-09-20T20:31:40.234 INFO:tasks.workunit.client.0.smithi070.stdout:9/218: chown d1/df/d25/l33 43570 1 2024-09-20T20:31:40.235 INFO:tasks.workunit.client.0.smithi070.stdout:9/219: write d1/df/d38/f47 [776589,78488] 0 2024-09-20T20:31:40.239 INFO:tasks.workunit.client.0.smithi070.stdout:1/281: unlink d4/d32/d34/d44/c67 0 2024-09-20T20:31:40.239 INFO:tasks.workunit.client.0.smithi070.stdout:8/292: dwrite d4/f38 [0,4194304] 0 2024-09-20T20:31:40.240 INFO:tasks.workunit.client.0.smithi070.stdout:8/293: fdatasync d4/db/f11 0 2024-09-20T20:31:40.241 INFO:tasks.workunit.client.0.smithi070.stdout:1/282: symlink d4/d1f/l6f 0 2024-09-20T20:31:40.242 INFO:tasks.workunit.client.0.smithi070.stdout:6/201: dwrite d4/d8/f28 [0,4194304] 0 2024-09-20T20:31:40.244 INFO:tasks.workunit.client.0.smithi070.stdout:1/283: creat d4/d6/d26/f70 x:0 0 0 2024-09-20T20:31:40.245 INFO:tasks.workunit.client.0.smithi070.stdout:6/202: write d4/d8/d10/f1d [3839290,123914] 0 2024-09-20T20:31:40.245 INFO:tasks.workunit.client.0.smithi070.stdout:5/224: dwrite d2/d7/f9 [0,4194304] 0 2024-09-20T20:31:40.246 INFO:tasks.workunit.client.0.smithi070.stdout:6/203: chown d4/d8/d10/d3c 1 1 2024-09-20T20:31:40.247 INFO:tasks.workunit.client.0.smithi070.stdout:7/165: dwrite d2/d19/f27 [0,4194304] 0 2024-09-20T20:31:40.247 INFO:tasks.workunit.client.0.smithi070.stdout:5/225: fdatasync d2/d4/de/f34 0 2024-09-20T20:31:40.249 INFO:tasks.workunit.client.0.smithi070.stdout:5/226: write d2/d7/fc [4696568,75106] 0 2024-09-20T20:31:40.249 INFO:tasks.workunit.client.0.smithi070.stdout:6/204: creat d4/d8/d10/f44 x:0 0 0 2024-09-20T20:31:40.250 INFO:tasks.workunit.client.0.smithi070.stdout:3/227: dwrite f3 [0,4194304] 0 2024-09-20T20:31:40.250 INFO:tasks.workunit.client.0.smithi070.stdout:7/166: creat d2/d19/d25/f36 x:0 0 0 2024-09-20T20:31:40.250 INFO:tasks.workunit.client.0.smithi070.stdout:5/227: chown d2/d4/de/d19/f44 3331605 1 2024-09-20T20:31:40.255 INFO:tasks.workunit.client.0.smithi070.stdout:5/228: symlink d2/d4/de/l4b 0 2024-09-20T20:31:40.256 INFO:tasks.workunit.client.0.smithi070.stdout:9/220: truncate d1/fe 3240608 0 2024-09-20T20:31:40.257 INFO:tasks.workunit.client.0.smithi070.stdout:8/294: truncate d4/f7 1120799 0 2024-09-20T20:31:40.257 INFO:tasks.workunit.client.0.smithi070.stdout:5/229: unlink d2/c3c 0 2024-09-20T20:31:40.257 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:40.257 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:40.259 INFO:tasks.workunit.client.0.smithi070.stdout:9/221: creat d1/df/d38/f52 x:0 0 0 2024-09-20T20:31:40.259 INFO:tasks.workunit.client.0.smithi070.stdout:1/284: dwrite d4/d6/d11/f3f [0,4194304] 0 2024-09-20T20:31:40.261 INFO:tasks.workunit.client.0.smithi070.stdout:5/230: rename d2/d4/de/d19 to d2/df/d40/d46/d4c 0 2024-09-20T20:31:40.261 INFO:tasks.workunit.client.0.smithi070.stdout:8/295: symlink d4/db/d64/l6b 0 2024-09-20T20:31:40.261 INFO:tasks.workunit.client.0.smithi070.stdout:5/231: chown d2/d4 691 1 2024-09-20T20:31:40.262 INFO:tasks.workunit.client.0.smithi070.stdout:9/222: chown d1/df/d25 192229 1 2024-09-20T20:31:40.262 INFO:tasks.workunit.client.0.smithi070.stdout:3/228: dwrite d7/d15/d1e/f2f [4194304,4194304] 0 2024-09-20T20:31:40.263 INFO:tasks.workunit.client.0.smithi070.stdout:1/285: read - d4/d32/d34/f59 zero size 2024-09-20T20:31:40.265 INFO:tasks.workunit.client.0.smithi070.stdout:7/167: dwrite d2/f10 [0,4194304] 0 2024-09-20T20:31:40.265 INFO:tasks.workunit.client.0.smithi070.stdout:8/296: dread - d4/d27/d2a/d43/d61/f62 zero size 2024-09-20T20:31:40.265 INFO:tasks.workunit.client.0.smithi070.stdout:9/223: symlink d1/l53 0 2024-09-20T20:31:40.266 INFO:tasks.workunit.client.0.smithi070.stdout:5/232: unlink d2/df/d40/l4a 0 2024-09-20T20:31:40.268 INFO:tasks.workunit.client.0.smithi070.stdout:9/224: creat d1/df/d2d/f54 x:0 0 0 2024-09-20T20:31:40.269 INFO:tasks.workunit.client.0.smithi070.stdout:5/233: unlink d2/df/d15/c27 0 2024-09-20T20:31:40.269 INFO:tasks.workunit.client.0.smithi070.stdout:7/168: link d2/d8/c29 d2/d19/d2e/c37 0 2024-09-20T20:31:40.270 INFO:tasks.workunit.client.0.smithi070.stdout:8/297: mkdir d4/d27/d2a/d5b/d6c 0 2024-09-20T20:31:40.271 INFO:tasks.workunit.client.0.smithi070.stdout:7/169: readlink d2/d19/l32 0 2024-09-20T20:31:40.271 INFO:tasks.workunit.client.0.smithi070.stdout:9/225: write d1/df/d2d/f4e [584436,104372] 0 2024-09-20T20:31:40.272 INFO:tasks.workunit.client.0.smithi070.stdout:9/226: fsync d1/df/f22 0 2024-09-20T20:31:40.272 INFO:tasks.workunit.client.0.smithi070.stdout:8/298: creat d4/d27/d2a/d3e/f6d x:0 0 0 2024-09-20T20:31:40.272 INFO:tasks.workunit.client.0.smithi070.stdout:6/205: dwrite d4/d8/d10/f15 [0,4194304] 0 2024-09-20T20:31:40.272 INFO:tasks.workunit.client.0.smithi070.stdout:7/170: link d2/d19/d2e/c37 d2/d19/d25/c38 0 2024-09-20T20:31:40.274 INFO:tasks.workunit.client.0.smithi070.stdout:9/227: creat d1/df/d18/d46/f55 x:0 0 0 2024-09-20T20:31:40.275 INFO:tasks.workunit.client.0.smithi070.stdout:6/206: link d4/d8/d17/d33/d36/f37 d4/d8/d10/f45 0 2024-09-20T20:31:40.276 INFO:tasks.workunit.client.0.smithi070.stdout:5/234: chown d2/d4/l38 30558 1 2024-09-20T20:31:40.276 INFO:tasks.workunit.client.0.smithi070.stdout:7/171: getdents d2 0 2024-09-20T20:31:40.276 INFO:tasks.workunit.client.0.smithi070.stdout:9/228: read - d1/df/d38/f4b zero size 2024-09-20T20:31:40.276 INFO:tasks.workunit.client.0.smithi070.stdout:5/235: chown d2/d4/l3b 1 1 2024-09-20T20:31:40.278 INFO:tasks.workunit.client.0.smithi070.stdout:1/286: read d4/d6/f14 [2955770,66757] 0 2024-09-20T20:31:40.278 INFO:tasks.workunit.client.0.smithi070.stdout:5/236: write d2/d7/fc [10020469,74176] 0 2024-09-20T20:31:40.278 INFO:tasks.workunit.client.0.smithi070.stdout:1/287: readlink d4/l1b 0 2024-09-20T20:31:40.278 INFO:tasks.workunit.client.0.smithi070.stdout:6/207: write d4/d8/d17/d33/d36/f37 [97451,29353] 0 2024-09-20T20:31:40.279 INFO:tasks.workunit.client.0.smithi070.stdout:1/288: dread - d4/d6/d2f/f5f zero size 2024-09-20T20:31:40.280 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:40.282 INFO:tasks.workunit.client.0.smithi070.stdout:5/237: creat d2/d7/d28/f4d x:0 0 0 2024-09-20T20:31:40.282 INFO:tasks.workunit.client.0.smithi070.stdout:7/172: dwrite d2/f10 [4194304,4194304] 0 2024-09-20T20:31:40.283 INFO:tasks.workunit.client.0.smithi070.stdout:9/229: getdents d1/df/d38 0 2024-09-20T20:31:40.286 INFO:tasks.workunit.client.0.smithi070.stdout:5/238: mknod d2/df/d15/c4e 0 2024-09-20T20:31:40.288 INFO:tasks.workunit.client.0.smithi070.stdout:5/239: mknod d2/d7/c4f 0 2024-09-20T20:31:40.290 INFO:tasks.workunit.client.0.smithi070.stdout:5/240: write f0 [5589630,67771] 0 2024-09-20T20:31:40.291 INFO:tasks.workunit.client.0.smithi070.stdout:1/289: dwrite d4/d6/d11/f38 [0,4194304] 0 2024-09-20T20:31:40.292 INFO:tasks.workunit.client.0.smithi070.stdout:8/299: dread d4/f25 [0,4194304] 0 2024-09-20T20:31:40.292 INFO:tasks.workunit.client.0.smithi070.stdout:7/173: dwrite d2/f14 [0,4194304] 0 2024-09-20T20:31:40.293 INFO:tasks.workunit.client.0.smithi070.stdout:5/241: write d2/d4/de/f34 [1205603,43091] 0 2024-09-20T20:31:40.293 INFO:tasks.workunit.client.0.smithi070.stdout:4/282: sync 2024-09-20T20:31:40.293 INFO:tasks.workunit.client.0.smithi070.stdout:2/277: sync 2024-09-20T20:31:40.295 INFO:tasks.workunit.client.0.smithi070.stdout:9/230: dwrite d1/f1f [0,4194304] 0 2024-09-20T20:31:40.295 INFO:tasks.workunit.client.0.smithi070.stdout:2/278: write d3/de/f6d [650636,28044] 0 2024-09-20T20:31:40.301 INFO:tasks.workunit.client.0.smithi070.stdout:9/231: rename d1/c35 to d1/df/d18/c56 0 2024-09-20T20:31:40.302 INFO:tasks.workunit.client.0.smithi070.stdout:2/279: dread d3/f36 [0,4194304] 0 2024-09-20T20:31:40.302 INFO:tasks.workunit.client.0.smithi070.stdout:3/229: dread d7/d15/f2d [0,4194304] 0 2024-09-20T20:31:40.304 INFO:tasks.workunit.client.0.smithi070.stdout:4/283: dwrite d6/d7/dc/d20/f24 [0,4194304] 0 2024-09-20T20:31:40.304 INFO:tasks.workunit.client.0.smithi070.stdout:8/300: chown d4/d27/d2a/d3e/f55 494029689 1 2024-09-20T20:31:40.304 INFO:tasks.workunit.client.0.smithi070.stdout:7/174: dwrite d2/f14 [0,4194304] 0 2024-09-20T20:31:40.305 INFO:tasks.workunit.client.0.smithi070.stdout:1/290: dwrite d4/d6/d2f/f31 [0,4194304] 0 2024-09-20T20:31:40.306 INFO:tasks.workunit.client.0.smithi070.stdout:9/232: fdatasync d1/df/f28 0 2024-09-20T20:31:40.307 INFO:tasks.workunit.client.0.smithi070.stdout:4/284: fsync d6/f4e 0 2024-09-20T20:31:40.308 INFO:tasks.workunit.client.0.smithi070.stdout:3/230: truncate d7/d8/f33 382542 0 2024-09-20T20:31:40.309 INFO:tasks.workunit.client.0.smithi070.stdout:2/280: rename d3/de/d12/c60 to d3/d5/d9/d42/c6e 0 2024-09-20T20:31:40.309 INFO:tasks.workunit.client.0.smithi070.stdout:1/291: chown d4/d6/l1c 4605 1 2024-09-20T20:31:40.309 INFO:tasks.workunit.client.0.smithi070.stdout:4/285: unlink d6/d7/dc/d4a/d58/f3c 0 2024-09-20T20:31:40.309 INFO:tasks.workunit.client.0.smithi070.stdout:7/175: write d2/f35 [2654170,98299] 0 2024-09-20T20:31:40.310 INFO:tasks.workunit.client.0.smithi070.stdout:3/231: mknod d7/d15/d1a/c43 0 2024-09-20T20:31:40.310 INFO:tasks.workunit.client.0.smithi070.stdout:4/286: dread - d6/d7/f3e zero size 2024-09-20T20:31:40.310 INFO:tasks.workunit.client.0.smithi070.stdout:2/281: symlink d3/d5/l6f 0 2024-09-20T20:31:40.311 INFO:tasks.workunit.client.0.smithi070.stdout:8/301: symlink d4/d27/d2a/d43/d61/l6e 0 2024-09-20T20:31:40.311 INFO:tasks.workunit.client.0.smithi070.stdout:0/280: sync 2024-09-20T20:31:40.312 INFO:tasks.workunit.client.0.smithi070.stdout:9/233: getdents d1/df/d4a 0 2024-09-20T20:31:40.313 INFO:tasks.workunit.client.0.smithi070.stdout:4/287: write d6/d7/f45 [368636,10090] 0 2024-09-20T20:31:40.313 INFO:tasks.workunit.client.0.smithi070.stdout:9/234: chown d1 0 1 2024-09-20T20:31:40.313 INFO:tasks.workunit.client.0.smithi070.stdout:1/292: creat d4/f71 x:0 0 0 2024-09-20T20:31:40.314 INFO:tasks.workunit.client.0.smithi070.stdout:5/242: dwrite d2/df/d15/f45 [0,4194304] 0 2024-09-20T20:31:40.315 INFO:tasks.workunit.client.0.smithi070.stdout:1/293: write d4/d6/d11/f38 [2756063,77994] 0 2024-09-20T20:31:40.316 INFO:tasks.workunit.client.0.smithi070.stdout:7/176: creat d2/d30/f39 x:0 0 0 2024-09-20T20:31:40.318 INFO:tasks.workunit.client.0.smithi070.stdout:1/294: chown d4/d32/d34/d44/d48 393885019 1 2024-09-20T20:31:40.319 INFO:tasks.workunit.client.0.smithi070.stdout:7/177: write d2/d19/f27 [3372114,64547] 0 2024-09-20T20:31:40.319 INFO:tasks.workunit.client.0.smithi070.stdout:1/295: creat d4/d32/f72 x:0 0 0 2024-09-20T20:31:40.320 INFO:tasks.workunit.client.0.smithi070.stdout:7/178: stat d2/d19/f1a 0 2024-09-20T20:31:40.320 INFO:tasks.workunit.client.0.smithi070.stdout:3/232: dwrite d7/d8/d13/d1d/f41 [0,4194304] 0 2024-09-20T20:31:40.321 INFO:tasks.workunit.client.0.smithi070.stdout:2/282: dwrite d3/d5/dd/d5a/f66 [0,4194304] 0 2024-09-20T20:31:40.321 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:40.316+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:40.322 INFO:tasks.workunit.client.0.smithi070.stdout:3/233: chown d7/d15/c40 5 1 2024-09-20T20:31:40.323 INFO:tasks.workunit.client.0.smithi070.stdout:1/296: mknod d4/d6/d11/d2c/d3b/c73 0 2024-09-20T20:31:40.323 INFO:tasks.workunit.client.0.smithi070.stdout:3/234: stat d7/d8/d13/f26 0 2024-09-20T20:31:40.325 INFO:tasks.workunit.client.0.smithi070.stdout:7/179: getdents d2 0 2024-09-20T20:31:40.328 INFO:tasks.workunit.client.0.smithi070.stdout:7/180: creat d2/d19/d25/d2a/f3a x:0 0 0 2024-09-20T20:31:40.329 INFO:tasks.workunit.client.0.smithi070.stdout:3/235: rename d7/d8/d13/f38 to d7/d15/d1a/f44 0 2024-09-20T20:31:40.330 INFO:tasks.workunit.client.0.smithi070.stdout:1/297: creat d4/d6/d11/d2c/d3b/f74 x:0 0 0 2024-09-20T20:31:40.331 INFO:tasks.workunit.client.0.smithi070.stdout:0/281: dread d4/f49 [0,4194304] 0 2024-09-20T20:31:40.331 INFO:tasks.workunit.client.0.smithi070.stdout:9/235: dwrite d1/f1f [0,4194304] 0 2024-09-20T20:31:40.332 INFO:tasks.workunit.client.0.smithi070.stdout:6/208: dread d4/d8/d10/f1d [0,4194304] 0 2024-09-20T20:31:40.334 INFO:tasks.workunit.client.0.smithi070.stdout:5/243: dread d2/d4/de/f29 [0,4194304] 0 2024-09-20T20:31:40.335 INFO:tasks.workunit.client.0.smithi070.stdout:2/283: dwrite d3/d5/f14 [4194304,4194304] 0 2024-09-20T20:31:40.338 INFO:tasks.workunit.client.0.smithi070.stdout:9/236: creat d1/df/d2d/f57 x:0 0 0 2024-09-20T20:31:40.338 INFO:tasks.workunit.client.0.smithi070.stdout:5/244: truncate d2/d7/fc 13298129 0 2024-09-20T20:31:40.338 INFO:tasks.workunit.client.0.smithi070.stdout:6/209: read d4/d8/f28 [1331293,54665] 0 2024-09-20T20:31:40.338 INFO:tasks.workunit.client.0.smithi070.stdout:1/298: mknod d4/d32/d34/d44/d48/c75 0 2024-09-20T20:31:40.338 INFO:tasks.workunit.client.0.smithi070.stdout:5/245: dread - d2/f3f zero size 2024-09-20T20:31:40.339 INFO:tasks.workunit.client.0.smithi070.stdout:3/236: creat d7/d15/f45 x:0 0 0 2024-09-20T20:31:40.339 INFO:tasks.workunit.client.0.smithi070.stdout:2/284: unlink d3/de/d12/f5b 0 2024-09-20T20:31:40.340 INFO:tasks.workunit.client.0.smithi070.stdout:1/299: dread - d4/d6/d11/d2c/f46 zero size 2024-09-20T20:31:40.340 INFO:tasks.workunit.client.0.smithi070.stdout:9/237: truncate d1/fe 3688242 0 2024-09-20T20:31:40.340 INFO:tasks.workunit.client.0.smithi070.stdout:3/237: mknod d7/c46 0 2024-09-20T20:31:40.341 INFO:tasks.workunit.client.0.smithi070.stdout:7/181: dwrite d2/f15 [0,4194304] 0 2024-09-20T20:31:40.342 INFO:tasks.workunit.client.0.smithi070.stdout:9/238: stat d1/df/f28 0 2024-09-20T20:31:40.343 INFO:tasks.workunit.client.0.smithi070.stdout:7/182: readlink d2/d8/l23 0 2024-09-20T20:31:40.344 INFO:tasks.workunit.client.0.smithi070.stdout:6/210: getdents d4/d8/d10 0 2024-09-20T20:31:40.345 INFO:tasks.workunit.client.0.smithi070.stdout:5/246: mknod d2/d4/de/c50 0 2024-09-20T20:31:40.345 INFO:tasks.workunit.client.0.smithi070.stdout:0/282: dwrite d4/f11 [4194304,4194304] 0 2024-09-20T20:31:40.347 INFO:tasks.workunit.client.0.smithi070.stdout:3/238: link d7/d8/f33 d7/d8/d13/d1d/f47 0 2024-09-20T20:31:40.347 INFO:tasks.workunit.client.0.smithi070.stdout:1/300: creat d4/d6/d11/d63/f76 x:0 0 0 2024-09-20T20:31:40.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/288: dread d6/d5e/f25 [0,4194304] 0 2024-09-20T20:31:40.347 INFO:tasks.workunit.client.0.smithi070.stdout:1/301: dread - d4/d6/d11/d2c/f46 zero size 2024-09-20T20:31:40.348 INFO:tasks.workunit.client.0.smithi070.stdout:7/183: readlink d2/d8/l17 0 2024-09-20T20:31:40.349 INFO:tasks.workunit.client.0.smithi070.stdout:4/289: write d6/d7/dc/f46 [1742916,19723] 0 2024-09-20T20:31:40.350 INFO:tasks.workunit.client.0.smithi070.stdout:1/302: creat d4/d32/d34/d44/d48/f77 x:0 0 0 2024-09-20T20:31:40.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/211: link d4/d8/d17/f24 d4/d8/d17/d33/f46 0 2024-09-20T20:31:40.350 INFO:tasks.workunit.client.0.smithi070.stdout:7/184: rmdir d2/d19 39 2024-09-20T20:31:40.352 INFO:tasks.workunit.client.0.smithi070.stdout:6/212: chown d4/d8/d10/f1d 100098357 1 2024-09-20T20:31:40.354 INFO:tasks.workunit.client.0.smithi070.stdout:7/185: rename d2/d19/f24 to d2/d8/f3b 0 2024-09-20T20:31:40.354 INFO:tasks.workunit.client.0.smithi070.stdout:6/213: write d4/d8/d17/f42 [418506,103763] 0 2024-09-20T20:31:40.355 INFO:tasks.workunit.client.0.smithi070.stdout:4/290: dread d6/d7/dc/f4d [0,4194304] 0 2024-09-20T20:31:40.356 INFO:tasks.workunit.client.0.smithi070.stdout:5/247: dwrite d2/d4/fa [0,4194304] 0 2024-09-20T20:31:40.357 INFO:tasks.workunit.client.0.smithi070.stdout:7/186: chown d2/d8/l11 806805 1 2024-09-20T20:31:40.357 INFO:tasks.workunit.client.0.smithi070.stdout:6/214: mknod d4/d8/d17/d33/c47 0 2024-09-20T20:31:40.358 INFO:tasks.workunit.client.0.smithi070.stdout:0/283: dwrite d4/d1b/f3d [0,4194304] 0 2024-09-20T20:31:40.358 INFO:tasks.workunit.client.0.smithi070.stdout:5/248: read - d2/df/d15/f37 zero size 2024-09-20T20:31:40.358 INFO:tasks.workunit.client.0.smithi070.stdout:3/239: dwrite d7/d8/d13/d1d/f41 [0,4194304] 0 2024-09-20T20:31:40.359 INFO:tasks.workunit.client.0.smithi070.stdout:6/215: dread - d4/d8/d1e/f26 zero size 2024-09-20T20:31:40.359 INFO:tasks.workunit.client.0.smithi070.stdout:5/249: chown d2/d4/de/l20 2 1 2024-09-20T20:31:40.361 INFO:tasks.workunit.client.0.smithi070.stdout:8/302: sync 2024-09-20T20:31:40.361 INFO:tasks.workunit.client.0.smithi070.stdout:2/285: sync 2024-09-20T20:31:40.362 INFO:tasks.workunit.client.0.smithi070.stdout:4/291: mknod d6/d26/d34/d40/c65 0 2024-09-20T20:31:40.363 INFO:tasks.workunit.client.0.smithi070.stdout:9/239: dread d1/df/f1b [0,4194304] 0 2024-09-20T20:31:40.363 INFO:tasks.workunit.client.0.smithi070.stdout:0/284: creat d4/d8/d12/f50 x:0 0 0 2024-09-20T20:31:40.363 INFO:tasks.workunit.client.0.smithi070.stdout:5/250: chown d2/df/l2a 447549 1 2024-09-20T20:31:40.364 INFO:tasks.workunit.client.0.smithi070.stdout:8/303: write d4/d27/f36 [173599,30195] 0 2024-09-20T20:31:40.364 INFO:tasks.workunit.client.0.smithi070.stdout:2/286: symlink d3/de/d12/d4f/l70 0 2024-09-20T20:31:40.364 INFO:tasks.workunit.client.0.smithi070.stdout:9/240: truncate d1/f3e 840306 0 2024-09-20T20:31:40.364 INFO:tasks.workunit.client.0.smithi070.stdout:5/251: creat d2/d4/de/d47/f51 x:0 0 0 2024-09-20T20:31:40.365 INFO:tasks.workunit.client.0.smithi070.stdout:0/285: creat d4/d8/d12/d23/d26/f51 x:0 0 0 2024-09-20T20:31:40.365 INFO:tasks.workunit.client.0.smithi070.stdout:8/304: creat d4/d27/d2a/f6f x:0 0 0 2024-09-20T20:31:40.365 INFO:tasks.workunit.client.0.smithi070.stdout:2/287: write d3/de/d12/d1a/f46 [347459,102370] 0 2024-09-20T20:31:40.365 INFO:tasks.workunit.client.0.smithi070.stdout:5/252: chown d2/df/d15 579341 1 2024-09-20T20:31:40.366 INFO:tasks.workunit.client.0.smithi070.stdout:0/286: dread - d4/d19/f45 zero size 2024-09-20T20:31:40.366 INFO:tasks.workunit.client.0.smithi070.stdout:8/305: fsync d4/d27/d42/f44 0 2024-09-20T20:31:40.366 INFO:tasks.workunit.client.0.smithi070.stdout:2/288: dread - d3/d5/d9/d1c/f56 zero size 2024-09-20T20:31:40.366 INFO:tasks.workunit.client.0.smithi070.stdout:5/253: mknod d2/d4/de/c52 0 2024-09-20T20:31:40.366 INFO:tasks.workunit.client.0.smithi070.stdout:0/287: rmdir d4/d8/d12 39 2024-09-20T20:31:40.367 INFO:tasks.workunit.client.0.smithi070.stdout:0/288: creat d4/d19/f52 x:0 0 0 2024-09-20T20:31:40.367 INFO:tasks.workunit.client.0.smithi070.stdout:5/254: mkdir d2/d4/d53 0 2024-09-20T20:31:40.367 INFO:tasks.workunit.client.0.smithi070.stdout:2/289: unlink d3/d5/d9/d1c/d1f/f33 0 2024-09-20T20:31:40.371 INFO:tasks.workunit.client.0.smithi070.stdout:0/289: dread - d4/d8/d12/d23/d26/f51 zero size 2024-09-20T20:31:40.372 INFO:tasks.workunit.client.0.smithi070.stdout:7/187: truncate d2/d8/f18 2967223 0 2024-09-20T20:31:40.372 INFO:tasks.workunit.client.0.smithi070.stdout:3/240: write d7/d15/d23/f27 [703936,57817] 0 2024-09-20T20:31:40.374 INFO:tasks.workunit.client.0.smithi070.stdout:5/255: link d2/d4/de/f29 d2/df/d40/f54 0 2024-09-20T20:31:40.375 INFO:tasks.workunit.client.0.smithi070.stdout:6/216: dwrite d4/d8/d17/f1a [0,4194304] 0 2024-09-20T20:31:40.376 INFO:tasks.workunit.client.0.smithi070.stdout:1/303: dread d4/d6/f14 [0,4194304] 0 2024-09-20T20:31:40.377 INFO:tasks.workunit.client.0.smithi070.stdout:9/241: dwrite d1/f14 [0,4194304] 0 2024-09-20T20:31:40.377 INFO:tasks.workunit.client.0.smithi070.stdout:5/256: creat d2/df/f55 x:0 0 0 2024-09-20T20:31:40.378 INFO:tasks.workunit.client.0.smithi070.stdout:3/241: write d7/d15/f2d [1009788,48684] 0 2024-09-20T20:31:40.378 INFO:tasks.workunit.client.0.smithi070.stdout:0/290: getdents d4/d8/d12/d23/d26/d1d 0 2024-09-20T20:31:40.378 INFO:tasks.workunit.client.0.smithi070.stdout:6/217: write d4/d8/d17/f34 [227107,46062] 0 2024-09-20T20:31:40.379 INFO:tasks.workunit.client.0.smithi070.stdout:2/290: dwrite d3/d5/f14 [4194304,4194304] 0 2024-09-20T20:31:40.379 INFO:tasks.workunit.client.0.smithi070.stdout:8/306: dwrite d4/d27/d2a/d3e/d39/f51 [0,4194304] 0 2024-09-20T20:31:40.379 INFO:tasks.workunit.client.0.smithi070.stdout:6/218: readlink d4/d8/l18 0 2024-09-20T20:31:40.383 INFO:tasks.workunit.client.0.smithi070.stdout:3/242: dread d7/f14 [4194304,4194304] 0 2024-09-20T20:31:40.383 INFO:tasks.workunit.client.0.smithi070.stdout:3/243: chown d7/lf 0 1 2024-09-20T20:31:40.383 INFO:tasks.workunit.client.0.smithi070.stdout:9/242: creat d1/df/d25/f58 x:0 0 0 2024-09-20T20:31:40.384 INFO:tasks.workunit.client.0.smithi070.stdout:5/257: creat d2/df/d40/d46/f56 x:0 0 0 2024-09-20T20:31:40.384 INFO:tasks.workunit.client.0.smithi070.stdout:7/188: truncate d2/f26 2956322 0 2024-09-20T20:31:40.384 INFO:tasks.workunit.client.0.smithi070.stdout:0/291: creat d4/d8/d12/d23/d26/d1f/f53 x:0 0 0 2024-09-20T20:31:40.385 INFO:tasks.workunit.client.0.smithi070.stdout:2/291: symlink d3/d5/d9/d42/l71 0 2024-09-20T20:31:40.385 INFO:tasks.workunit.client.0.smithi070.stdout:6/219: rename d4/d8/d10/f1d to d4/d8/d17/d33/d36/f48 0 2024-09-20T20:31:40.385 INFO:tasks.workunit.client.0.smithi070.stdout:3/244: mkdir d7/d15/d1a/d48 0 2024-09-20T20:31:40.385 INFO:tasks.workunit.client.0.smithi070.stdout:5/258: unlink d2/d7/c12 0 2024-09-20T20:31:40.386 INFO:tasks.workunit.client.0.smithi070.stdout:2/292: mknod d3/c72 0 2024-09-20T20:31:40.386 INFO:tasks.workunit.client.0.smithi070.stdout:9/243: creat d1/df/f59 x:0 0 0 2024-09-20T20:31:40.386 INFO:tasks.workunit.client.0.smithi070.stdout:3/245: chown d7/d15/d1a/f44 511 1 2024-09-20T20:31:40.387 INFO:tasks.workunit.client.0.smithi070.stdout:9/244: symlink d1/df/d2d/l5a 0 2024-09-20T20:31:40.387 INFO:tasks.workunit.client.0.smithi070.stdout:3/246: creat d7/d15/d1e/f49 x:0 0 0 2024-09-20T20:31:40.388 INFO:tasks.workunit.client.0.smithi070.stdout:9/245: stat d1/df/d38/f4b 0 2024-09-20T20:31:40.388 INFO:tasks.workunit.client.0.smithi070.stdout:6/220: creat d4/d8/d17/f49 x:0 0 0 2024-09-20T20:31:40.388 INFO:tasks.workunit.client.0.smithi070.stdout:0/292: mknod d4/d8/d12/d23/d26/c54 0 2024-09-20T20:31:40.388 INFO:tasks.workunit.client.0.smithi070.stdout:3/247: mkdir d7/d15/d1a/d4a 0 2024-09-20T20:31:40.389 INFO:tasks.workunit.client.0.smithi070.stdout:7/189: dread d2/fa [0,4194304] 0 2024-09-20T20:31:40.389 INFO:tasks.workunit.client.0.smithi070.stdout:2/293: truncate d3/d5/dd/d5a/f5f 4593844 0 2024-09-20T20:31:40.389 INFO:tasks.workunit.client.0.smithi070.stdout:7/190: stat f1 0 2024-09-20T20:31:40.389 INFO:tasks.workunit.client.0.smithi070.stdout:3/248: truncate d7/d15/f2d 1604286 0 2024-09-20T20:31:40.389 INFO:tasks.workunit.client.0.smithi070.stdout:0/293: mkdir d4/d8/d55 0 2024-09-20T20:31:40.390 INFO:tasks.workunit.client.0.smithi070.stdout:2/294: chown f2 0 1 2024-09-20T20:31:40.390 INFO:tasks.workunit.client.0.smithi070.stdout:3/249: chown d7/fd 6 1 2024-09-20T20:31:40.390 INFO:tasks.workunit.client.0.smithi070.stdout:2/295: chown d3/de/d12/l27 7 1 2024-09-20T20:31:40.390 INFO:tasks.workunit.client.0.smithi070.stdout:2/296: stat d3/d5/dd/f63 0 2024-09-20T20:31:40.391 INFO:tasks.workunit.client.0.smithi070.stdout:3/250: symlink d7/d15/l4b 0 2024-09-20T20:31:40.392 INFO:tasks.workunit.client.0.smithi070.stdout:0/294: write d4/d8/f30 [1090358,120751] 0 2024-09-20T20:31:40.392 INFO:tasks.workunit.client.0.smithi070.stdout:2/297: fsync d3/d5/f1e 0 2024-09-20T20:31:40.393 INFO:tasks.workunit.client.0.smithi070.stdout:3/251: creat d7/f4c x:0 0 0 2024-09-20T20:31:40.393 INFO:tasks.workunit.client.0.smithi070.stdout:8/307: dread d4/d27/d2a/d3e/d31/f3f [0,4194304] 0 2024-09-20T20:31:40.393 INFO:tasks.workunit.client.0.smithi070.stdout:3/252: write d7/f1b [5575994,2256] 0 2024-09-20T20:31:40.394 INFO:tasks.workunit.client.0.smithi070.stdout:8/308: stat d4/db/l47 0 2024-09-20T20:31:40.394 INFO:tasks.workunit.client.0.smithi070.stdout:2/298: rmdir d3/d5/d9/d10 39 2024-09-20T20:31:40.394 INFO:tasks.workunit.client.0.smithi070.stdout:0/295: truncate d4/d19/f45 967652 0 2024-09-20T20:31:40.396 INFO:tasks.workunit.client.0.smithi070.stdout:3/253: readlink d7/d15/d1e/l28 0 2024-09-20T20:31:40.396 INFO:tasks.workunit.client.0.smithi070.stdout:0/296: symlink d4/d8/d55/l56 0 2024-09-20T20:31:40.396 INFO:tasks.workunit.client.0.smithi070.stdout:8/309: rename d4/d27/d2a to d4/d27/d2a/d3e/d31/d63/d70 22 2024-09-20T20:31:40.398 INFO:tasks.workunit.client.0.smithi070.stdout:1/304: dread d4/d6/f47 [0,4194304] 0 2024-09-20T20:31:40.399 INFO:tasks.workunit.client.0.smithi070.stdout:2/299: getdents d3/d5/d9/d1c/d47/d4b 0 2024-09-20T20:31:40.399 INFO:tasks.workunit.client.0.smithi070.stdout:0/297: chown d4/d8/d12/d23/d26/d1d/d37/f4c 13643 1 2024-09-20T20:31:40.400 INFO:tasks.workunit.client.0.smithi070.stdout:7/191: dwrite f1 [0,4194304] 0 2024-09-20T20:31:40.400 INFO:tasks.workunit.client.0.smithi070.stdout:8/310: read d4/d27/d2a/d3e/d31/f3f [18831,92860] 0 2024-09-20T20:31:40.401 INFO:tasks.workunit.client.0.smithi070.stdout:0/298: stat c3 0 2024-09-20T20:31:40.401 INFO:tasks.workunit.client.0.smithi070.stdout:5/259: dwrite d2/df/d40/f54 [0,4194304] 0 2024-09-20T20:31:40.401 INFO:tasks.workunit.client.0.smithi070.stdout:1/305: readlink d4/d1f/l2e 0 2024-09-20T20:31:40.402 INFO:tasks.workunit.client.0.smithi070.stdout:1/306: fsync d4/d6/d11/d2c/d3b/f74 0 2024-09-20T20:31:40.403 INFO:tasks.workunit.client.0.smithi070.stdout:5/260: write d2/df/f55 [887158,54713] 0 2024-09-20T20:31:40.403 INFO:tasks.workunit.client.0.smithi070.stdout:5/261: readlink d2/d4/de/l24 0 2024-09-20T20:31:40.404 INFO:tasks.workunit.client.0.smithi070.stdout:3/254: dread d7/f14 [4194304,4194304] 0 2024-09-20T20:31:40.405 INFO:tasks.workunit.client.0.smithi070.stdout:1/307: mkdir d4/d6/d11/d2c/d3a/d78 0 2024-09-20T20:31:40.406 INFO:tasks.workunit.client.0.smithi070.stdout:0/299: link d4/d8/fc d4/d8/d12/d23/d26/d1d/d37/d38/f57 0 2024-09-20T20:31:40.408 INFO:tasks.workunit.client.0.smithi070.stdout:1/308: symlink d4/d1f/d69/l79 0 2024-09-20T20:31:40.408 INFO:tasks.workunit.client.0.smithi070.stdout:0/300: rmdir d4 39 2024-09-20T20:31:40.409 INFO:tasks.workunit.client.0.smithi070.stdout:6/221: dread d4/d8/ff [0,4194304] 0 2024-09-20T20:31:40.409 INFO:tasks.workunit.client.0.smithi070.stdout:9/246: dread d1/f7 [0,4194304] 0 2024-09-20T20:31:40.410 INFO:tasks.workunit.client.0.smithi070.stdout:6/222: dread - d4/d8/d1e/f26 zero size 2024-09-20T20:31:40.410 INFO:tasks.workunit.client.0.smithi070.stdout:1/309: read - d4/d32/d34/d44/d48/f5e zero size 2024-09-20T20:31:40.411 INFO:tasks.workunit.client.0.smithi070.stdout:7/192: dwrite d2/d19/d25/d2a/f3a [0,4194304] 0 2024-09-20T20:31:40.412 INFO:tasks.workunit.client.0.smithi070.stdout:3/255: dread d7/d15/d1a/f2c [0,4194304] 0 2024-09-20T20:31:40.413 INFO:tasks.workunit.client.0.smithi070.stdout:0/301: rename d4/f49 to d4/d1b/d4b/f58 0 2024-09-20T20:31:40.414 INFO:tasks.workunit.client.0.smithi070.stdout:1/310: creat d4/d1f/f7a x:0 0 0 2024-09-20T20:31:40.414 INFO:tasks.workunit.client.0.smithi070.stdout:7/193: symlink d2/d8/l3c 0 2024-09-20T20:31:40.414 INFO:tasks.workunit.client.0.smithi070.stdout:9/247: creat d1/df/f5b x:0 0 0 2024-09-20T20:31:40.414 INFO:tasks.workunit.client.0.smithi070.stdout:6/223: chown d4/c5 20409627 1 2024-09-20T20:31:40.414 INFO:tasks.workunit.client.0.smithi070.stdout:5/262: dwrite d2/d7/f49 [0,4194304] 0 2024-09-20T20:31:40.415 INFO:tasks.workunit.client.0.smithi070.stdout:2/300: dwrite d3/de/f6d [0,4194304] 0 2024-09-20T20:31:40.415 INFO:tasks.workunit.client.0.smithi070.stdout:3/256: creat d7/d15/d1a/d4a/f4d x:0 0 0 2024-09-20T20:31:40.416 INFO:tasks.workunit.client.0.smithi070.stdout:5/263: write d2/df/d40/d46/f56 [628363,82152] 0 2024-09-20T20:31:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:8/311: truncate d4/db/f4a 135770 0 2024-09-20T20:31:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:6/224: fsync d4/d8/d1e/f26 0 2024-09-20T20:31:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:5/264: write d2/d4/de/d47/f51 [535075,130545] 0 2024-09-20T20:31:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:2/301: creat d3/d5/d9/d1c/d1f/f73 x:0 0 0 2024-09-20T20:31:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:1/311: mkdir d4/d6/d11/d7b 0 2024-09-20T20:31:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:7/194: link d2/d8/l3c d2/d19/d2e/l3d 0 2024-09-20T20:31:40.422 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:40.417+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:40.423 INFO:tasks.workunit.client.0.smithi070.stdout:2/302: symlink d3/l74 0 2024-09-20T20:31:40.423 INFO:tasks.workunit.client.0.smithi070.stdout:5/265: creat d2/d4/f57 x:0 0 0 2024-09-20T20:31:40.424 INFO:tasks.workunit.client.0.smithi070.stdout:2/303: fsync d3/d5/d9/f29 0 2024-09-20T20:31:40.424 INFO:tasks.workunit.client.0.smithi070.stdout:5/266: mknod d2/d7/d28/c58 0 2024-09-20T20:31:40.425 INFO:tasks.workunit.client.0.smithi070.stdout:9/248: dwrite f0 [0,4194304] 0 2024-09-20T20:31:40.426 INFO:tasks.workunit.client.0.smithi070.stdout:0/302: dwrite f2 [0,4194304] 0 2024-09-20T20:31:40.427 INFO:tasks.workunit.client.0.smithi070.stdout:3/257: dwrite d7/d15/d1e/f2f [8388608,4194304] 0 2024-09-20T20:31:40.428 INFO:tasks.workunit.client.0.smithi070.stdout:6/225: dread d4/d8/d10/f15 [0,4194304] 0 2024-09-20T20:31:40.428 INFO:tasks.workunit.client.0.smithi070.stdout:5/267: fsync d2/df/d15/f42 0 2024-09-20T20:31:40.428 INFO:tasks.workunit.client.0.smithi070.stdout:2/304: link d3/d5/dd/f15 d3/f75 0 2024-09-20T20:31:40.428 INFO:tasks.workunit.client.0.smithi070.stdout:3/258: rmdir d7/d8 39 2024-09-20T20:31:40.429 INFO:tasks.workunit.client.0.smithi070.stdout:3/259: readlink d7/lf 0 2024-09-20T20:31:40.429 INFO:tasks.workunit.client.0.smithi070.stdout:5/268: write d2/d4/de/f29 [4726798,129255] 0 2024-09-20T20:31:40.430 INFO:tasks.workunit.client.0.smithi070.stdout:2/305: mkdir d3/d5/d9/d1c/d47/d76 0 2024-09-20T20:31:40.430 INFO:tasks.workunit.client.0.smithi070.stdout:6/226: rename d4/cd to d4/d8/d17/d33/c4a 0 2024-09-20T20:31:40.431 INFO:tasks.workunit.client.0.smithi070.stdout:5/269: stat d2/d7/d28/c58 0 2024-09-20T20:31:40.432 INFO:tasks.workunit.client.0.smithi070.stdout:2/306: unlink d3/de/d12/d4f/l70 0 2024-09-20T20:31:40.432 INFO:tasks.workunit.client.0.smithi070.stdout:6/227: symlink d4/d8/d10/d3c/l4b 0 2024-09-20T20:31:40.432 INFO:tasks.workunit.client.0.smithi070.stdout:5/270: rmdir d2/df 39 2024-09-20T20:31:40.432 INFO:tasks.workunit.client.0.smithi070.stdout:7/195: dwrite d2/d8/f16 [0,4194304] 0 2024-09-20T20:31:40.434 INFO:tasks.workunit.client.0.smithi070.stdout:2/307: dread - d3/d5/f34 zero size 2024-09-20T20:31:40.434 INFO:tasks.workunit.client.0.smithi070.stdout:2/308: chown d3/d5/d9/d1c/f4d 42102264 1 2024-09-20T20:31:40.435 INFO:tasks.workunit.client.0.smithi070.stdout:5/271: unlink d2/d4/de/l24 0 2024-09-20T20:31:40.435 INFO:tasks.workunit.client.0.smithi070.stdout:3/260: link d7/d8/d13/d1d/f47 d7/d15/d1a/f4e 0 2024-09-20T20:31:40.436 INFO:tasks.workunit.client.0.smithi070.stdout:6/228: creat d4/d8/f4c x:0 0 0 2024-09-20T20:31:40.437 INFO:tasks.workunit.client.0.smithi070.stdout:9/249: truncate d1/f1f 2630547 0 2024-09-20T20:31:40.438 INFO:tasks.workunit.client.0.smithi070.stdout:9/250: dread - d1/df/d2d/f57 zero size 2024-09-20T20:31:40.439 INFO:tasks.workunit.client.0.smithi070.stdout:2/309: truncate d3/d5/f2e 1159461 0 2024-09-20T20:31:40.439 INFO:tasks.workunit.client.0.smithi070.stdout:5/272: mkdir d2/d4/d53/d59 0 2024-09-20T20:31:40.440 INFO:tasks.workunit.client.0.smithi070.stdout:0/303: dread d4/d8/fc [0,4194304] 0 2024-09-20T20:31:40.440 INFO:tasks.workunit.client.0.smithi070.stdout:9/251: symlink d1/df/d18/l5c 0 2024-09-20T20:31:40.440 INFO:tasks.workunit.client.0.smithi070.stdout:3/261: creat d7/d15/f4f x:0 0 0 2024-09-20T20:31:40.441 INFO:tasks.workunit.client.0.smithi070.stdout:2/310: mknod d3/de/d12/c77 0 2024-09-20T20:31:40.441 INFO:tasks.workunit.client.0.smithi070.stdout:5/273: write d2/d4/f1e [972422,119619] 0 2024-09-20T20:31:40.443 INFO:tasks.workunit.client.0.smithi070.stdout:3/262: readlink d7/d8/d13/d1d/l35 0 2024-09-20T20:31:40.443 INFO:tasks.workunit.client.0.smithi070.stdout:6/229: dread d4/f11 [0,4194304] 0 2024-09-20T20:31:40.443 INFO:tasks.workunit.client.0.smithi070.stdout:2/311: mknod d3/d4c/c78 0 2024-09-20T20:31:40.443 INFO:tasks.workunit.client.0.smithi070.stdout:7/196: dwrite d2/d19/d25/d2a/f3a [0,4194304] 0 2024-09-20T20:31:40.443 INFO:tasks.workunit.client.0.smithi070.stdout:5/274: write d2/f13 [2196171,13892] 0 2024-09-20T20:31:40.444 INFO:tasks.workunit.client.0.smithi070.stdout:2/312: write d3/d5/dd/d5a/f5f [709161,25350] 0 2024-09-20T20:31:40.444 INFO:tasks.workunit.client.0.smithi070.stdout:4/292: sync 2024-09-20T20:31:40.445 INFO:tasks.workunit.client.0.smithi070.stdout:0/304: rename d4/d8/d12/d43/f2c to d4/d8/d12/d23/d26/d1d/d37/d38/f59 0 2024-09-20T20:31:40.446 INFO:tasks.workunit.client.0.smithi070.stdout:3/263: creat d7/d15/d1a/d48/f50 x:0 0 0 2024-09-20T20:31:40.447 INFO:tasks.workunit.client.0.smithi070.stdout:7/197: mknod d2/c3e 0 2024-09-20T20:31:40.447 INFO:tasks.workunit.client.0.smithi070.stdout:3/264: stat d7/d8/d13 0 2024-09-20T20:31:40.448 INFO:tasks.workunit.client.0.smithi070.stdout:9/252: dwrite d1/df/d38/f4b [0,4194304] 0 2024-09-20T20:31:40.449 INFO:tasks.workunit.client.0.smithi070.stdout:3/265: truncate f3 5605422 0 2024-09-20T20:31:40.449 INFO:tasks.workunit.client.0.smithi070.stdout:3/266: chown f0 2544769 1 2024-09-20T20:31:40.449 INFO:tasks.workunit.client.0.smithi070.stdout:7/198: unlink d2/f15 0 2024-09-20T20:31:40.450 INFO:tasks.workunit.client.0.smithi070.stdout:2/313: rename d3/d5/d9/d1c/d47/d76 to d3/d5/d9/d79 0 2024-09-20T20:31:40.450 INFO:tasks.workunit.client.0.smithi070.stdout:9/253: truncate d1/df/d25/f4f 857426 0 2024-09-20T20:31:40.450 INFO:tasks.workunit.client.0.smithi070.stdout:0/305: creat d4/d48/d4e/f5a x:0 0 0 2024-09-20T20:31:40.451 INFO:tasks.workunit.client.0.smithi070.stdout:0/306: write d4/f11 [1606359,19679] 0 2024-09-20T20:31:40.452 INFO:tasks.workunit.client.0.smithi070.stdout:0/307: mkdir d4/d19/d5b 0 2024-09-20T20:31:40.454 INFO:tasks.workunit.client.0.smithi070.stdout:5/275: dwrite d2/df/d15/f37 [0,4194304] 0 2024-09-20T20:31:40.454 INFO:tasks.workunit.client.0.smithi070.stdout:2/314: creat d3/de/d12/f7a x:0 0 0 2024-09-20T20:31:40.459 INFO:tasks.workunit.client.0.smithi070.stdout:3/267: truncate d7/d8/f19 391473 0 2024-09-20T20:31:40.460 INFO:tasks.workunit.client.0.smithi070.stdout:2/315: rmdir d3/d5/d9/d1c/d4e 39 2024-09-20T20:31:40.461 INFO:tasks.workunit.client.0.smithi070.stdout:5/276: creat d2/df/d40/d46/f5a x:0 0 0 2024-09-20T20:31:40.463 INFO:tasks.workunit.client.0.smithi070.stdout:9/254: dwrite d1/f11 [0,4194304] 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:4/293: dwrite d6/d7/f9 [0,4194304] 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:0/308: link d4/d8/d12/d23/d26/d1f/f53 d4/d8/d12/d23/d26/d1d/d37/d38/f5c 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:5/277: stat d2/df/d15/f45 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:4/294: stat d6/f4e 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:5/278: write d2/d7/f11 [870029,5669] 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:2/316: creat d3/d5/d9/d79/f7b x:0 0 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:1/312: dread f2 [0,4194304] 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:6/230: dwrite d4/d8/f2f [0,4194304] 0 2024-09-20T20:31:40.464 INFO:tasks.workunit.client.0.smithi070.stdout:0/309: rename d4/f5 to d4/d8/d12/f5d 0 2024-09-20T20:31:40.465 INFO:tasks.workunit.client.0.smithi070.stdout:1/313: stat d4/d32/l4f 0 2024-09-20T20:31:40.465 INFO:tasks.workunit.client.0.smithi070.stdout:0/310: chown d4/d8/d12/d23 4066768 1 2024-09-20T20:31:40.465 INFO:tasks.workunit.client.0.smithi070.stdout:6/231: stat d4/d8/d1e/l29 0 2024-09-20T20:31:40.466 INFO:tasks.workunit.client.0.smithi070.stdout:5/279: truncate d2/df/d15/f37 4700288 0 2024-09-20T20:31:40.467 INFO:tasks.workunit.client.0.smithi070.stdout:4/295: symlink d6/d7/dc/d4a/d58/l66 0 2024-09-20T20:31:40.467 INFO:tasks.workunit.client.0.smithi070.stdout:9/255: chown d1/f1f 1937 1 2024-09-20T20:31:40.467 INFO:tasks.workunit.client.0.smithi070.stdout:6/232: symlink d4/d8/d17/l4d 0 2024-09-20T20:31:40.468 INFO:tasks.workunit.client.0.smithi070.stdout:1/314: symlink d4/l7c 0 2024-09-20T20:31:40.468 INFO:tasks.workunit.client.0.smithi070.stdout:3/268: dwrite d7/d15/d1e/f49 [0,4194304] 0 2024-09-20T20:31:40.469 INFO:tasks.workunit.client.0.smithi070.stdout:4/296: symlink d6/d7/l67 0 2024-09-20T20:31:40.469 INFO:tasks.workunit.client.0.smithi070.stdout:9/256: truncate d1/df/d38/f47 1767760 0 2024-09-20T20:31:40.470 INFO:tasks.workunit.client.0.smithi070.stdout:5/280: rename d2/df/d15 to d2/df/d40/d46/d5b 0 2024-09-20T20:31:40.471 INFO:tasks.workunit.client.0.smithi070.stdout:2/317: dread d3/de/f6d [0,4194304] 0 2024-09-20T20:31:40.471 INFO:tasks.workunit.client.0.smithi070.stdout:5/281: read d2/df/d40/d46/d5b/f45 [4038686,105901] 0 2024-09-20T20:31:40.471 INFO:tasks.workunit.client.0.smithi070.stdout:3/269: fsync d7/d15/d1a/f32 0 2024-09-20T20:31:40.471 INFO:tasks.workunit.client.0.smithi070.stdout:9/257: symlink d1/df/d4a/l5d 0 2024-09-20T20:31:40.474 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:40.474 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:40.474 INFO:tasks.workunit.client.0.smithi070.stdout:1/315: link d4/d6/d11/d2c/d3b/l4e d4/d32/d60/l7d 0 2024-09-20T20:31:40.474 INFO:tasks.workunit.client.0.smithi070.stdout:3/270: mkdir d7/d15/d1a/d4a/d51 0 2024-09-20T20:31:40.474 INFO:tasks.workunit.client.0.smithi070.stdout:1/316: rmdir d4/d32/d4d 0 2024-09-20T20:31:40.475 INFO:tasks.workunit.client.0.smithi070.stdout:6/233: dwrite d4/d8/d17/f31 [4194304,4194304] 0 2024-09-20T20:31:40.475 INFO:tasks.workunit.client.0.smithi070.stdout:9/258: read d1/df/f19 [146207,46964] 0 2024-09-20T20:31:40.477 INFO:tasks.workunit.client.0.smithi070.stdout:6/234: rename d4/f11 to d4/d8/d38/f4e 0 2024-09-20T20:31:40.477 INFO:tasks.workunit.client.0.smithi070.stdout:1/317: link d4/d6/d11/d2c/d3b/c5c d4/d6/d11/d63/c7e 0 2024-09-20T20:31:40.479 INFO:tasks.workunit.client.0.smithi070.stdout:9/259: rename d1/df/d4a/l50 to d1/df/l5e 0 2024-09-20T20:31:40.479 INFO:tasks.workunit.client.0.smithi070.stdout:1/318: unlink d4/d32/d34/d44/d48/c75 0 2024-09-20T20:31:40.480 INFO:tasks.workunit.client.0.smithi070.stdout:5/282: dwrite d2/df/d40/d46/d5b/f37 [0,4194304] 0 2024-09-20T20:31:40.480 INFO:tasks.workunit.client.0.smithi070.stdout:1/319: chown d4/d6/d11/d2c 947490257 1 2024-09-20T20:31:40.481 INFO:tasks.workunit.client.0.smithi070.stdout:1/320: write d4/d32/d34/d44/d48/f77 [274765,90573] 0 2024-09-20T20:31:40.483 INFO:tasks.workunit.client.0.smithi070.stdout:9/260: symlink d1/df/d18/l5f 0 2024-09-20T20:31:40.483 INFO:tasks.workunit.client.0.smithi070.stdout:1/321: creat d4/d1f/d69/f7f x:0 0 0 2024-09-20T20:31:40.483 INFO:tasks.workunit.client.0.smithi070.stdout:5/283: unlink d2/l2d 0 2024-09-20T20:31:40.483 INFO:tasks.workunit.client.0.smithi070.stdout:6/235: dwrite d4/d8/f4c [0,4194304] 0 2024-09-20T20:31:40.484 INFO:tasks.workunit.client.0.smithi070.stdout:1/322: dread f2 [4194304,4194304] 0 2024-09-20T20:31:40.485 INFO:tasks.workunit.client.0.smithi070.stdout:6/236: creat d4/d8/f4f x:0 0 0 2024-09-20T20:31:40.485 INFO:tasks.workunit.client.0.smithi070.stdout:1/323: chown d4/d6/d11/d2c/d3a/f68 3682160 1 2024-09-20T20:31:40.486 INFO:tasks.workunit.client.0.smithi070.stdout:6/237: mkdir d4/d8/d38/d50 0 2024-09-20T20:31:40.486 INFO:tasks.workunit.client.0.smithi070.stdout:1/324: chown d4/d32/d34/d44/d48/f54 275 1 2024-09-20T20:31:40.487 INFO:tasks.workunit.client.0.smithi070.stdout:1/325: fsync d4/d6/f29 0 2024-09-20T20:31:40.487 INFO:tasks.workunit.client.0.smithi070.stdout:1/326: creat d4/d1f/d69/f80 x:0 0 0 2024-09-20T20:31:40.489 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:40.490 INFO:tasks.workunit.client.0.smithi070.stdout:6/238: symlink d4/d8/l51 0 2024-09-20T20:31:40.490 INFO:tasks.workunit.client.0.smithi070.stdout:9/261: dwrite d1/df/d25/f58 [0,4194304] 0 2024-09-20T20:31:40.490 INFO:tasks.workunit.client.0.smithi070.stdout:0/311: truncate d4/d19/f29 4060908 0 2024-09-20T20:31:40.491 INFO:tasks.workunit.client.0.smithi070.stdout:0/312: creat d4/d8/d12/f5e x:0 0 0 2024-09-20T20:31:40.491 INFO:tasks.workunit.client.0.smithi070.stdout:6/239: creat d4/d8/d17/d33/f52 x:0 0 0 2024-09-20T20:31:40.491 INFO:tasks.workunit.client.0.smithi070.stdout:9/262: rename d1/df/d2d/c43 to d1/df/d38/c60 0 2024-09-20T20:31:40.492 INFO:tasks.workunit.client.0.smithi070.stdout:6/240: chown d4/d8/d17/f49 16647677 1 2024-09-20T20:31:40.492 INFO:tasks.workunit.client.0.smithi070.stdout:9/263: chown d1/df/d2d/f54 476887 1 2024-09-20T20:31:40.492 INFO:tasks.workunit.client.0.smithi070.stdout:9/264: rename d1/df/d38/f4b to d1/f61 0 2024-09-20T20:31:40.493 INFO:tasks.workunit.client.0.smithi070.stdout:6/241: creat d4/d8/d17/d33/d36/f53 x:0 0 0 2024-09-20T20:31:40.493 INFO:tasks.workunit.client.0.smithi070.stdout:6/242: mkdir d4/d8/d10/d54 0 2024-09-20T20:31:40.494 INFO:tasks.workunit.client.0.smithi070.stdout:8/312: sync 2024-09-20T20:31:40.494 INFO:tasks.workunit.client.0.smithi070.stdout:2/318: sync 2024-09-20T20:31:40.494 INFO:tasks.workunit.client.0.smithi070.stdout:9/265: sync 2024-09-20T20:31:40.494 INFO:tasks.workunit.client.0.smithi070.stdout:4/297: sync 2024-09-20T20:31:40.495 INFO:tasks.workunit.client.0.smithi070.stdout:7/199: sync 2024-09-20T20:31:40.495 INFO:tasks.workunit.client.0.smithi070.stdout:6/243: mkdir d4/d8/d10/d54/d55 0 2024-09-20T20:31:40.496 INFO:tasks.workunit.client.0.smithi070.stdout:8/313: symlink d4/d27/d2a/d3e/d31/l71 0 2024-09-20T20:31:40.496 INFO:tasks.workunit.client.0.smithi070.stdout:2/319: write d3/de/f39 [668000,44903] 0 2024-09-20T20:31:40.496 INFO:tasks.workunit.client.0.smithi070.stdout:4/298: write d6/d26/d34/f18 [8617206,111875] 0 2024-09-20T20:31:40.497 INFO:tasks.workunit.client.0.smithi070.stdout:6/244: chown d4/d8/d3a/l3b 22 1 2024-09-20T20:31:40.497 INFO:tasks.workunit.client.0.smithi070.stdout:8/314: unlink d4/la 0 2024-09-20T20:31:40.497 INFO:tasks.workunit.client.0.smithi070.stdout:6/245: rename c3 to d4/d8/d1e/c56 0 2024-09-20T20:31:40.498 INFO:tasks.workunit.client.0.smithi070.stdout:4/299: write d6/d26/d34/f21 [1219147,129574] 0 2024-09-20T20:31:40.498 INFO:tasks.workunit.client.0.smithi070.stdout:9/266: rename d1/l1e to d1/df/d18/l62 0 2024-09-20T20:31:40.498 INFO:tasks.workunit.client.0.smithi070.stdout:6/246: rmdir d4/d8/d3a 39 2024-09-20T20:31:40.499 INFO:tasks.workunit.client.0.smithi070.stdout:8/315: rename d4/f25 to d4/d27/d42/f72 0 2024-09-20T20:31:40.499 INFO:tasks.workunit.client.0.smithi070.stdout:9/267: dread - d1/df/d2d/f54 zero size 2024-09-20T20:31:40.499 INFO:tasks.workunit.client.0.smithi070.stdout:4/300: creat d6/d43/d5a/f68 x:0 0 0 2024-09-20T20:31:40.500 INFO:tasks.workunit.client.0.smithi070.stdout:1/327: truncate d4/d1f/f51 822423 0 2024-09-20T20:31:40.500 INFO:tasks.workunit.client.0.smithi070.stdout:8/316: mkdir d4/d27/d73 0 2024-09-20T20:31:40.501 INFO:tasks.workunit.client.0.smithi070.stdout:9/268: rmdir d1/df/d18 39 2024-09-20T20:31:40.501 INFO:tasks.workunit.client.0.smithi070.stdout:7/200: dwrite d2/d19/f1a [0,4194304] 0 2024-09-20T20:31:40.502 INFO:tasks.workunit.client.0.smithi070.stdout:9/269: read - d1/f2a zero size 2024-09-20T20:31:40.504 INFO:tasks.workunit.client.0.smithi070.stdout:1/328: truncate d4/d1f/f7a 711763 0 2024-09-20T20:31:40.504 INFO:tasks.workunit.client.0.smithi070.stdout:0/313: write d4/d8/d12/d23/d26/d1d/d37/d38/f5c [752488,98424] 0 2024-09-20T20:31:40.504 INFO:tasks.workunit.client.0.smithi070.stdout:8/317: truncate d4/d27/d2a/d3e/d31/f3f 2033644 0 2024-09-20T20:31:40.505 INFO:tasks.workunit.client.0.smithi070.stdout:3/271: dread d7/d8/d13/d1d/f37 [0,4194304] 0 2024-09-20T20:31:40.505 INFO:tasks.workunit.client.0.smithi070.stdout:7/201: rename d2/f14 to d2/d30/f3f 0 2024-09-20T20:31:40.506 INFO:tasks.workunit.client.0.smithi070.stdout:5/284: dread d2/d4/de/f34 [0,4194304] 0 2024-09-20T20:31:40.506 INFO:tasks.workunit.client.0.smithi070.stdout:2/320: dwrite d3/d5/d9/d1c/f4d [0,4194304] 0 2024-09-20T20:31:40.508 INFO:tasks.workunit.client.0.smithi070.stdout:5/285: truncate d2/d7/d28/f4d 577187 0 2024-09-20T20:31:40.508 INFO:tasks.workunit.client.0.smithi070.stdout:5/286: write d2/f3f [306556,105486] 0 2024-09-20T20:31:40.508 INFO:tasks.workunit.client.0.smithi070.stdout:9/270: rename d1/df/d38/f52 to d1/df/d18/d46/f63 0 2024-09-20T20:31:40.510 INFO:tasks.workunit.client.0.smithi070.stdout:7/202: creat d2/d19/d25/f40 x:0 0 0 2024-09-20T20:31:40.510 INFO:tasks.workunit.client.0.smithi070.stdout:0/314: fdatasync d4/d8/d12/d23/d26/f33 0 2024-09-20T20:31:40.510 INFO:tasks.workunit.client.0.smithi070.stdout:4/301: dwrite d6/d5e/d17/f5b [0,4194304] 0 2024-09-20T20:31:40.511 INFO:tasks.workunit.client.0.smithi070.stdout:6/247: sync 2024-09-20T20:31:40.512 INFO:tasks.workunit.client.0.smithi070.stdout:9/271: write d1/df/f59 [8880,101746] 0 2024-09-20T20:31:40.512 INFO:tasks.workunit.client.0.smithi070.stdout:5/287: symlink d2/d7/d28/l5c 0 2024-09-20T20:31:40.512 INFO:tasks.workunit.client.0.smithi070.stdout:3/272: mknod d7/d15/c52 0 2024-09-20T20:31:40.512 INFO:tasks.workunit.client.0.smithi070.stdout:2/321: fsync d3/d5/d9/d10/f52 0 2024-09-20T20:31:40.512 INFO:tasks.workunit.client.0.smithi070.stdout:7/203: chown d2/d8/l23 6 1 2024-09-20T20:31:40.513 INFO:tasks.workunit.client.0.smithi070.stdout:6/248: readlink d4/d8/d1e/l29 0 2024-09-20T20:31:40.513 INFO:tasks.workunit.client.0.smithi070.stdout:0/315: chown d4/d8/d12/d23/d26/d1d/d37/d38 10801 1 2024-09-20T20:31:40.516 INFO:tasks.workunit.client.0.smithi070.stdout:9/272: fdatasync d1/df/d25/f4f 0 2024-09-20T20:31:40.516 INFO:tasks.workunit.client.0.smithi070.stdout:8/318: dwrite d4/db/f16 [4194304,4194304] 0 2024-09-20T20:31:40.516 INFO:tasks.workunit.client.0.smithi070.stdout:7/204: creat d2/d19/d2e/f41 x:0 0 0 2024-09-20T20:31:40.516 INFO:tasks.workunit.client.0.smithi070.stdout:1/329: dwrite d4/d32/d34/d44/d5a/f66 [0,4194304] 0 2024-09-20T20:31:40.516 INFO:tasks.workunit.client.0.smithi070.stdout:2/322: mknod d3/de/d12/c7c 0 2024-09-20T20:31:40.517 INFO:tasks.workunit.client.0.smithi070.stdout:6/249: truncate d4/d8/d10/f2d 842083 0 2024-09-20T20:31:40.517 INFO:tasks.workunit.client.0.smithi070.stdout:0/316: creat d4/d19/d5b/f5f x:0 0 0 2024-09-20T20:31:40.518 INFO:tasks.workunit.client.0.smithi070.stdout:4/302: getdents d6/d5e/d17/d4c 0 2024-09-20T20:31:40.518 INFO:tasks.workunit.client.0.smithi070.stdout:1/330: stat d4/l25 0 2024-09-20T20:31:40.519 INFO:tasks.workunit.client.0.smithi070.stdout:3/273: dread f0 [4194304,4194304] 0 2024-09-20T20:31:40.523 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:40.519+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:40.523 INFO:tasks.workunit.client.0.smithi070.stdout:8/319: creat d4/db/d66/f74 x:0 0 0 2024-09-20T20:31:40.523 INFO:tasks.workunit.client.0.smithi070.stdout:7/205: mkdir d2/d19/d25/d42 0 2024-09-20T20:31:40.524 INFO:tasks.workunit.client.0.smithi070.stdout:2/323: rename d3/de/f18 to d3/de/d12/f7d 0 2024-09-20T20:31:40.524 INFO:tasks.workunit.client.0.smithi070.stdout:1/331: dwrite d4/d6/d2f/f5f [0,4194304] 0 2024-09-20T20:31:40.524 INFO:tasks.workunit.client.0.smithi070.stdout:0/317: creat d4/d8/d12/d23/d26/d1d/d37/f60 x:0 0 0 2024-09-20T20:31:40.525 INFO:tasks.workunit.client.0.smithi070.stdout:0/318: chown d4/d8/d55 1043 1 2024-09-20T20:31:40.526 INFO:tasks.workunit.client.0.smithi070.stdout:6/250: link d4/d8/d10/f44 d4/d8/d17/f57 0 2024-09-20T20:31:40.527 INFO:tasks.workunit.client.0.smithi070.stdout:2/324: unlink d3/de/d12/d1a/c41 0 2024-09-20T20:31:40.527 INFO:tasks.workunit.client.0.smithi070.stdout:1/332: creat d4/d6/d2f/f81 x:0 0 0 2024-09-20T20:31:40.527 INFO:tasks.workunit.client.0.smithi070.stdout:0/319: rmdir d4/d48/d4e 39 2024-09-20T20:31:40.528 INFO:tasks.workunit.client.0.smithi070.stdout:9/273: dwrite d1/df/f28 [0,4194304] 0 2024-09-20T20:31:40.528 INFO:tasks.workunit.client.0.smithi070.stdout:3/274: getdents d7/d15 0 2024-09-20T20:31:40.529 INFO:tasks.workunit.client.0.smithi070.stdout:1/333: fdatasync d4/d32/d34/d44/d48/f54 0 2024-09-20T20:31:40.530 INFO:tasks.workunit.client.0.smithi070.stdout:0/320: creat d4/d13/f61 x:0 0 0 2024-09-20T20:31:40.531 INFO:tasks.workunit.client.0.smithi070.stdout:6/251: creat d4/d8/d3a/f58 x:0 0 0 2024-09-20T20:31:40.531 INFO:tasks.workunit.client.0.smithi070.stdout:5/288: dread d2/d4/f1e [0,4194304] 0 2024-09-20T20:31:40.532 INFO:tasks.workunit.client.0.smithi070.stdout:3/275: symlink d7/d8/d13/d1d/l53 0 2024-09-20T20:31:40.533 INFO:tasks.workunit.client.0.smithi070.stdout:4/303: truncate d6/d26/d34/f18 4836640 0 2024-09-20T20:31:40.533 INFO:tasks.workunit.client.0.smithi070.stdout:1/334: chown d4/l22 7184 1 2024-09-20T20:31:40.533 INFO:tasks.workunit.client.0.smithi070.stdout:0/321: creat d4/f62 x:0 0 0 2024-09-20T20:31:40.534 INFO:tasks.workunit.client.0.smithi070.stdout:5/289: rmdir d2/df/d40 39 2024-09-20T20:31:40.534 INFO:tasks.workunit.client.0.smithi070.stdout:8/320: dwrite d4/d27/d2a/d3e/d39/f41 [0,4194304] 0 2024-09-20T20:31:40.535 INFO:tasks.workunit.client.0.smithi070.stdout:1/335: chown d4/d32/d34/d44/f55 258 1 2024-09-20T20:31:40.535 INFO:tasks.workunit.client.0.smithi070.stdout:2/325: getdents d3/d5/d9/d1c/d1f/d3e 0 2024-09-20T20:31:40.536 INFO:tasks.workunit.client.0.smithi070.stdout:3/276: write d7/d15/f3f [4678539,94818] 0 2024-09-20T20:31:40.538 INFO:tasks.workunit.client.0.smithi070.stdout:0/322: creat d4/d8/d12/d23/d26/d1d/d37/d38/f63 x:0 0 0 2024-09-20T20:31:40.538 INFO:tasks.workunit.client.0.smithi070.stdout:5/290: creat d2/df/d40/f5d x:0 0 0 2024-09-20T20:31:40.538 INFO:tasks.workunit.client.0.smithi070.stdout:2/326: fsync d3/d5/d9/f29 0 2024-09-20T20:31:40.538 INFO:tasks.workunit.client.0.smithi070.stdout:6/252: link d4/d8/d10/d3c/l3e d4/d8/d10/d54/d55/l59 0 2024-09-20T20:31:40.539 INFO:tasks.workunit.client.0.smithi070.stdout:3/277: fsync d7/d15/d1a/f44 0 2024-09-20T20:31:40.539 INFO:tasks.workunit.client.0.smithi070.stdout:8/321: chown d4/d27/d2a/d3e/d39/l3b 2861 1 2024-09-20T20:31:40.540 INFO:tasks.workunit.client.0.smithi070.stdout:5/291: fsync d2/df/d40/d46/d5b/f37 0 2024-09-20T20:31:40.540 INFO:tasks.workunit.client.0.smithi070.stdout:9/274: dwrite d1/f11 [0,4194304] 0 2024-09-20T20:31:40.540 INFO:tasks.workunit.client.0.smithi070.stdout:2/327: mkdir d3/d5/d9/d1c/d47/d7e 0 2024-09-20T20:31:40.541 INFO:tasks.workunit.client.0.smithi070.stdout:2/328: chown d3/f36 55 1 2024-09-20T20:31:40.542 INFO:tasks.workunit.client.0.smithi070.stdout:4/304: dwrite d6/d26/f27 [4194304,4194304] 0 2024-09-20T20:31:40.543 INFO:tasks.workunit.client.0.smithi070.stdout:6/253: mknod d4/d8/d17/d33/d36/c5a 0 2024-09-20T20:31:40.543 INFO:tasks.workunit.client.0.smithi070.stdout:9/275: rmdir d1/df/d38 39 2024-09-20T20:31:40.544 INFO:tasks.workunit.client.0.smithi070.stdout:5/292: rename f0 to d2/df/d40/d46/d5b/f5e 0 2024-09-20T20:31:40.545 INFO:tasks.workunit.client.0.smithi070.stdout:1/336: dwrite d4/d1f/f6e [0,4194304] 0 2024-09-20T20:31:40.545 INFO:tasks.workunit.client.0.smithi070.stdout:6/254: creat d4/d8/d1e/f5b x:0 0 0 2024-09-20T20:31:40.545 INFO:tasks.workunit.client.0.smithi070.stdout:9/276: mknod d1/df/d18/d44/c64 0 2024-09-20T20:31:40.545 INFO:tasks.workunit.client.0.smithi070.stdout:2/329: chown d3/d5/d9/d42/c6e 12705 1 2024-09-20T20:31:40.545 INFO:tasks.workunit.client.0.smithi070.stdout:4/305: mkdir d6/d26/d69 0 2024-09-20T20:31:40.546 INFO:tasks.workunit.client.0.smithi070.stdout:5/293: readlink d2/d4/l3b 0 2024-09-20T20:31:40.546 INFO:tasks.workunit.client.0.smithi070.stdout:8/322: getdents d4/d27/d2a/d3e/d31 0 2024-09-20T20:31:40.546 INFO:tasks.workunit.client.0.smithi070.stdout:4/306: chown d6/d7/dc/fe 174048 1 2024-09-20T20:31:40.547 INFO:tasks.workunit.client.0.smithi070.stdout:9/277: rename d1/fd to d1/df/d2d/f65 0 2024-09-20T20:31:40.548 INFO:tasks.workunit.client.0.smithi070.stdout:5/294: chown d2/d4/c25 114927713 1 2024-09-20T20:31:40.548 INFO:tasks.workunit.client.0.smithi070.stdout:6/255: rename d4/d8/d38/c3f to d4/d8/d17/d33/d36/c5c 0 2024-09-20T20:31:40.548 INFO:tasks.workunit.client.0.smithi070.stdout:9/278: creat d1/df/d18/f66 x:0 0 0 2024-09-20T20:31:40.549 INFO:tasks.workunit.client.0.smithi070.stdout:1/337: dread d4/d1f/f6e [0,4194304] 0 2024-09-20T20:31:40.550 INFO:tasks.workunit.client.0.smithi070.stdout:4/307: rename d6/d7/dc/d4a/c54 to d6/d7/dc/c6a 0 2024-09-20T20:31:40.550 INFO:tasks.workunit.client.0.smithi070.stdout:0/323: truncate d4/f7 2927716 0 2024-09-20T20:31:40.551 INFO:tasks.workunit.client.0.smithi070.stdout:1/338: mknod d4/d6/c82 0 2024-09-20T20:31:40.551 INFO:tasks.workunit.client.0.smithi070.stdout:9/279: write d1/df/d38/f47 [123477,46128] 0 2024-09-20T20:31:40.552 INFO:tasks.workunit.client.0.smithi070.stdout:6/256: rename d4/f2a to d4/d8/d38/f5d 0 2024-09-20T20:31:40.554 INFO:tasks.workunit.client.0.smithi070.stdout:0/324: chown d4/d8/d12/d43/d3b/c46 124 1 2024-09-20T20:31:40.554 INFO:tasks.workunit.client.0.smithi070.stdout:1/339: fdatasync d4/d6/d11/d2c/d3a/f68 0 2024-09-20T20:31:40.554 INFO:tasks.workunit.client.0.smithi070.stdout:6/257: chown d4/d8/d3a/f58 9511241 1 2024-09-20T20:31:40.554 INFO:tasks.workunit.client.0.smithi070.stdout:9/280: creat d1/df/d18/d44/f67 x:0 0 0 2024-09-20T20:31:40.555 INFO:tasks.workunit.client.0.smithi070.stdout:7/206: dread d2/f26 [0,4194304] 0 2024-09-20T20:31:40.555 INFO:tasks.workunit.client.0.smithi070.stdout:9/281: chown d1/df/f22 204 1 2024-09-20T20:31:40.555 INFO:tasks.workunit.client.0.smithi070.stdout:1/340: fsync d4/d6/d11/d2c/f46 0 2024-09-20T20:31:40.555 INFO:tasks.workunit.client.0.smithi070.stdout:9/282: chown d1/f11 209 1 2024-09-20T20:31:40.556 INFO:tasks.workunit.client.0.smithi070.stdout:5/295: dread d2/df/d40/d46/d5b/f45 [0,4194304] 0 2024-09-20T20:31:40.556 INFO:tasks.workunit.client.0.smithi070.stdout:7/207: unlink d2/d19/d25/f40 0 2024-09-20T20:31:40.557 INFO:tasks.workunit.client.0.smithi070.stdout:1/341: unlink d4/d6/d2f/c56 0 2024-09-20T20:31:40.558 INFO:tasks.workunit.client.0.smithi070.stdout:5/296: fdatasync d2/df/d40/d46/d5b/f42 0 2024-09-20T20:31:40.559 INFO:tasks.workunit.client.0.smithi070.stdout:7/208: symlink d2/d19/d25/d2a/l43 0 2024-09-20T20:31:40.560 INFO:tasks.workunit.client.0.smithi070.stdout:9/283: link d1/df/d18/l51 d1/df/l68 0 2024-09-20T20:31:40.560 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:31:40.560 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:31:40.560 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:31:40.560 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:31:40.560 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:31:40.560 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:31:40.561 INFO:teuthology.orchestra.run.smithi070.stdout:oload 1000 2024-09-20T20:31:40.561 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 3 2024-09-20T20:31:40.561 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:31:40.561 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0011 2024-09-20T20:31:40.561 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0108 2024-09-20T20:31:40.561 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:31:40.562 INFO:tasks.workunit.client.0.smithi070.stdout:3/278: dread d7/d8/f19 [0,4194304] 0 2024-09-20T20:31:40.562 INFO:tasks.workunit.client.0.smithi070.stdout:7/209: chown d2/f26 0 1 2024-09-20T20:31:40.562 INFO:tasks.workunit.client.0.smithi070.stdout:5/297: mkdir d2/d4/de/d47/d5f 0 2024-09-20T20:31:40.562 INFO:tasks.workunit.client.0.smithi070.stdout:0/325: dwrite d4/f11 [0,4194304] 0 2024-09-20T20:31:40.562 INFO:tasks.workunit.client.0.smithi070.stdout:9/284: mkdir d1/df/d25/d69 0 2024-09-20T20:31:40.563 INFO:tasks.workunit.client.0.smithi070.stdout:6/258: dwrite d4/f13 [0,4194304] 0 2024-09-20T20:31:40.563 INFO:tasks.workunit.client.0.smithi070.stdout:3/279: mkdir d7/d15/d1a/d4a/d54 0 2024-09-20T20:31:40.564 INFO:tasks.workunit.client.0.smithi070.stdout:9/285: chown d1/f2a 18 1 2024-09-20T20:31:40.564 INFO:tasks.workunit.client.0.smithi070.stdout:0/326: write d4/d8/f30 [5184199,122495] 0 2024-09-20T20:31:40.566 INFO:tasks.workunit.client.0.smithi070.stdout:5/298: mkdir d2/d7/d60 0 2024-09-20T20:31:40.566 INFO:tasks.workunit.client.0.smithi070.stdout:3/280: write d7/f9 [1896140,32716] 0 2024-09-20T20:31:40.568 INFO:tasks.workunit.client.0.smithi070.stdout:5/299: creat d2/d4/d53/d59/f61 x:0 0 0 2024-09-20T20:31:40.570 INFO:tasks.workunit.client.0.smithi070.stdout:1/342: dwrite f2 [0,4194304] 0 2024-09-20T20:31:40.570 INFO:tasks.workunit.client.0.smithi070.stdout:0/327: truncate d4/d8/fc 3349597 0 2024-09-20T20:31:40.571 INFO:tasks.workunit.client.0.smithi070.stdout:5/300: fsync d2/df/f55 0 2024-09-20T20:31:40.573 INFO:tasks.workunit.client.0.smithi070.stdout:0/328: rmdir d4/d8/d12/d43/d3b 39 2024-09-20T20:31:40.573 INFO:tasks.workunit.client.0.smithi070.stdout:3/281: write f5 [412404,36573] 0 2024-09-20T20:31:40.574 INFO:tasks.workunit.client.0.smithi070.stdout:5/301: creat d2/df/d40/f62 x:0 0 0 2024-09-20T20:31:40.574 INFO:tasks.workunit.client.0.smithi070.stdout:4/308: dread d6/ff [0,4194304] 0 2024-09-20T20:31:40.575 INFO:tasks.workunit.client.0.smithi070.stdout:8/323: dread d4/f28 [0,4194304] 0 2024-09-20T20:31:40.575 INFO:tasks.workunit.client.0.smithi070.stdout:9/286: dwrite d1/df/d2d/f54 [0,4194304] 0 2024-09-20T20:31:40.576 INFO:tasks.workunit.client.0.smithi070.stdout:5/302: rename d2/d7/d28 to d2/df/d40/d46/d63 0 2024-09-20T20:31:40.576 INFO:tasks.workunit.client.0.smithi070.stdout:8/324: unlink d4/d27/d2a/d43/f59 0 2024-09-20T20:31:40.577 INFO:tasks.workunit.client.0.smithi070.stdout:9/287: dread - d1/df/d18/d44/f67 zero size 2024-09-20T20:31:40.577 INFO:tasks.workunit.client.0.smithi070.stdout:0/329: rename d4/d8/d12/d23/d26/d1d/d41/l4f to d4/d8/d12/d23/d26/d1d/d41/l64 0 2024-09-20T20:31:40.577 INFO:tasks.workunit.client.0.smithi070.stdout:5/303: chown d2/d4/de/l20 4432 1 2024-09-20T20:31:40.577 INFO:tasks.workunit.client.0.smithi070.stdout:9/288: readlink d1/df/l5e 0 2024-09-20T20:31:40.578 INFO:tasks.workunit.client.0.smithi070.stdout:5/304: rmdir d2/d4 39 2024-09-20T20:31:40.579 INFO:tasks.workunit.client.0.smithi070.stdout:0/330: mknod d4/d8/d12/d23/d26/c65 0 2024-09-20T20:31:40.579 INFO:tasks.workunit.client.0.smithi070.stdout:7/210: dread d2/fb [0,4194304] 0 2024-09-20T20:31:40.579 INFO:tasks.workunit.client.0.smithi070.stdout:9/289: read - d1/df/d18/f66 zero size 2024-09-20T20:31:40.584 INFO:tasks.workunit.client.0.smithi070.stdout:0/331: write d4/d8/d12/d23/d26/f2a [4723645,95416] 0 2024-09-20T20:31:40.584 INFO:tasks.workunit.client.0.smithi070.stdout:4/309: dwrite d6/f4e [0,4194304] 0 2024-09-20T20:31:40.587 INFO:tasks.workunit.client.0.smithi070.stdout:4/310: fsync d6/d5e/d17/f5b 0 2024-09-20T20:31:40.588 INFO:tasks.workunit.client.0.smithi070.stdout:8/325: dwrite d4/db/f32 [4194304,4194304] 0 2024-09-20T20:31:40.591 INFO:tasks.workunit.client.0.smithi070.stdout:8/326: chown d4/d27/d2a/d43/d61/f62 296024806 1 2024-09-20T20:31:40.591 INFO:tasks.workunit.client.0.smithi070.stdout:5/305: dwrite d2/d4/f1e [0,4194304] 0 2024-09-20T20:31:40.591 INFO:tasks.workunit.client.0.smithi070.stdout:9/290: dwrite d1/f61 [4194304,4194304] 0 2024-09-20T20:31:40.595 INFO:tasks.workunit.client.0.smithi070.stdout:8/327: mkdir d4/d27/d2a/d75 0 2024-09-20T20:31:40.595 INFO:tasks.workunit.client.0.smithi070.stdout:9/291: rmdir d1/df 39 2024-09-20T20:31:40.595 INFO:tasks.workunit.client.0.smithi070.stdout:6/259: dread d4/f6 [0,4194304] 0 2024-09-20T20:31:40.597 INFO:tasks.workunit.client.0.smithi070.stdout:2/330: dread d3/de/f1b [0,4194304] 0 2024-09-20T20:31:40.597 INFO:tasks.workunit.client.0.smithi070.stdout:8/328: write d4/d27/d2a/d43/d61/f62 [757788,116] 0 2024-09-20T20:31:40.597 INFO:tasks.workunit.client.0.smithi070.stdout:4/311: dwrite d6/d7/dc/d4a/d58/f4f [4194304,4194304] 0 2024-09-20T20:31:40.597 INFO:tasks.workunit.client.0.smithi070.stdout:2/331: chown d3/de/d12/c7c 46532910 1 2024-09-20T20:31:40.597 INFO:tasks.workunit.client.0.smithi070.stdout:9/292: write d1/df/d18/f66 [557045,35801] 0 2024-09-20T20:31:40.598 INFO:tasks.workunit.client.0.smithi070.stdout:8/329: stat d4/db/d66 0 2024-09-20T20:31:40.599 INFO:tasks.workunit.client.0.smithi070.stdout:9/293: truncate d1/df/d2d/f4e 926451 0 2024-09-20T20:31:40.600 INFO:tasks.workunit.client.0.smithi070.stdout:9/294: stat d1/df/d18/l5f 0 2024-09-20T20:31:40.600 INFO:tasks.workunit.client.0.smithi070.stdout:8/330: link d4/d27/l58 d4/d27/d73/l76 0 2024-09-20T20:31:40.601 INFO:tasks.workunit.client.0.smithi070.stdout:8/331: write d4/d27/d2a/d3e/f56 [1308483,97624] 0 2024-09-20T20:31:40.601 INFO:tasks.workunit.client.0.smithi070.stdout:5/306: read d2/d7/f9 [2151824,74589] 0 2024-09-20T20:31:40.602 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-20T20:31:40.602 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-20T20:31:40.602 INFO:tasks.workunit.client.0.smithi070.stdout:5/307: write d2/d7/f11 [1422044,29625] 0 2024-09-20T20:31:40.602 INFO:tasks.workunit.client.0.smithi070.stdout:8/332: fdatasync d4/d27/d2a/d3e/d39/f51 0 2024-09-20T20:31:40.603 INFO:tasks.workunit.client.0.smithi070.stdout:5/308: creat d2/df/d40/d46/d4c/f64 x:0 0 0 2024-09-20T20:31:40.605 INFO:tasks.workunit.client.0.smithi070.stdout:5/309: mknod d2/df/d40/d46/c65 0 2024-09-20T20:31:40.606 INFO:tasks.workunit.client.0.smithi070.stdout:2/332: read d3/de/f39 [116125,13968] 0 2024-09-20T20:31:40.606 INFO:tasks.workunit.client.0.smithi070.stdout:5/310: write d2/df/d40/d46/d4c/f44 [688522,6614] 0 2024-09-20T20:31:40.606 INFO:tasks.workunit.client.0.smithi070.stdout:9/295: dread d1/f7 [0,4194304] 0 2024-09-20T20:31:40.607 INFO:tasks.workunit.client.0.smithi070.stdout:4/312: dwrite d6/d43/f47 [0,4194304] 0 2024-09-20T20:31:40.607 INFO:tasks.workunit.client.0.smithi070.stdout:9/296: stat d1/f2a 0 2024-09-20T20:31:40.607 INFO:tasks.workunit.client.0.smithi070.stdout:2/333: dread - d3/d5/d9/d1c/f65 zero size 2024-09-20T20:31:40.607 INFO:tasks.workunit.client.0.smithi070.stdout:5/311: unlink d2/df/d40/d46/d63/l35 0 2024-09-20T20:31:40.608 INFO:tasks.workunit.client.0.smithi070.stdout:4/313: mkdir d6/d5e/d6b 0 2024-09-20T20:31:40.609 INFO:tasks.workunit.client.0.smithi070.stdout:4/314: creat d6/d7/dc/d4a/d58/f6c x:0 0 0 2024-09-20T20:31:40.609 INFO:tasks.workunit.client.0.smithi070.stdout:9/297: creat d1/df/d25/d69/f6a x:0 0 0 2024-09-20T20:31:40.610 INFO:tasks.workunit.client.0.smithi070.stdout:9/298: chown d1/f1a 8429 1 2024-09-20T20:31:40.610 INFO:tasks.workunit.client.0.smithi070.stdout:4/315: chown d6/d7/dc/f4b 12 1 2024-09-20T20:31:40.611 INFO:tasks.workunit.client.0.smithi070.stdout:5/312: getdents d2/df/d40/d46/d5b 0 2024-09-20T20:31:40.611 INFO:tasks.workunit.client.0.smithi070.stdout:4/316: unlink d6/d7/f29 0 2024-09-20T20:31:40.611 INFO:tasks.workunit.client.0.smithi070.stdout:5/313: fsync d2/d4/f39 0 2024-09-20T20:31:40.612 INFO:tasks.workunit.client.0.smithi070.stdout:1/343: dread d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:40.613 INFO:tasks.workunit.client.0.smithi070.stdout:4/317: creat d6/d5e/d17/f6d x:0 0 0 2024-09-20T20:31:40.613 INFO:tasks.workunit.client.0.smithi070.stdout:2/334: write d3/d5/d9/d1c/d1f/f5e [790111,26758] 0 2024-09-20T20:31:40.614 INFO:tasks.workunit.client.0.smithi070.stdout:5/314: symlink d2/df/l66 0 2024-09-20T20:31:40.614 INFO:tasks.workunit.client.0.smithi070.stdout:1/344: rmdir d4/d6/d11/d2c 39 2024-09-20T20:31:40.615 INFO:tasks.workunit.client.0.smithi070.stdout:2/335: rename d3/d5/f14 to d3/d5/d9/d79/f7f 0 2024-09-20T20:31:40.615 INFO:tasks.workunit.client.0.smithi070.stdout:1/345: unlink d4/cb 0 2024-09-20T20:31:40.616 INFO:tasks.workunit.client.0.smithi070.stdout:1/346: chown d4/d6/l4a 1 1 2024-09-20T20:31:40.617 INFO:tasks.workunit.client.0.smithi070.stdout:7/211: dread d2/f1b [0,4194304] 0 2024-09-20T20:31:40.617 INFO:tasks.workunit.client.0.smithi070.stdout:1/347: chown d4/d6/f47 546 1 2024-09-20T20:31:40.618 INFO:tasks.workunit.client.0.smithi070.stdout:2/336: rename d3/d5/d9/d1c/f56 to d3/d5/d9/d79/f80 0 2024-09-20T20:31:40.619 INFO:tasks.workunit.client.0.smithi070.stdout:6/260: dread d4/d8/d10/f14 [0,4194304] 0 2024-09-20T20:31:40.620 INFO:tasks.workunit.client.0.smithi070.stdout:2/337: rmdir d3/d5/dd/d5a 39 2024-09-20T20:31:40.620 INFO:tasks.workunit.client.0.smithi070.stdout:1/348: unlink d4/d32/d34/d44/d5a/f66 0 2024-09-20T20:31:40.621 INFO:tasks.workunit.client.0.smithi070.stdout:5/315: dread d2/df/d40/d46/d5b/f37 [0,4194304] 0 2024-09-20T20:31:40.621 INFO:tasks.workunit.client.0.smithi070.stdout:0/332: dread d4/f16 [0,4194304] 0 2024-09-20T20:31:40.622 INFO:tasks.workunit.client.0.smithi070.stdout:4/318: dwrite d6/d7/dc/d4a/d58/f4f [4194304,4194304] 0 2024-09-20T20:31:40.622 INFO:tasks.workunit.client.0.smithi070.stdout:1/349: mkdir d4/d6/d11/d7b/d83 0 2024-09-20T20:31:40.622 INFO:tasks.workunit.client.0.smithi070.stdout:5/316: unlink d2/d7/c48 0 2024-09-20T20:31:40.624 INFO:tasks.workunit.client.0.smithi070.stdout:6/261: truncate d4/d8/d10/f14 2106926 0 2024-09-20T20:31:40.624 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:40.620+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:40.625 INFO:tasks.workunit.client.0.smithi070.stdout:8/333: dread d4/d27/d2a/d43/d61/f62 [0,4194304] 0 2024-09-20T20:31:40.625 INFO:tasks.workunit.client.0.smithi070.stdout:6/262: readlink d4/l2e 0 2024-09-20T20:31:40.626 INFO:tasks.workunit.client.0.smithi070.stdout:1/350: creat d4/d6/d11/d2c/d3a/d78/f84 x:0 0 0 2024-09-20T20:31:40.627 INFO:tasks.workunit.client.0.smithi070.stdout:0/333: truncate d4/d8/d12/d23/d26/d1d/d37/f60 1002429 0 2024-09-20T20:31:40.628 INFO:tasks.workunit.client.0.smithi070.stdout:0/334: stat d4/d19/d5b/f5f 0 2024-09-20T20:31:40.628 INFO:tasks.workunit.client.0.smithi070.stdout:7/212: dwrite d2/d8/f18 [0,4194304] 0 2024-09-20T20:31:40.630 INFO:tasks.workunit.client.0.smithi070.stdout:9/299: dread d1/f1f [0,4194304] 0 2024-09-20T20:31:40.630 INFO:tasks.workunit.client.0.smithi070.stdout:3/282: sync 2024-09-20T20:31:40.631 INFO:tasks.workunit.client.0.smithi070.stdout:7/213: fdatasync d2/d8/f6 0 2024-09-20T20:31:40.631 INFO:tasks.workunit.client.0.smithi070.stdout:1/351: rename d4/d1f/f6e to d4/d6/d11/d63/d6c/f85 0 2024-09-20T20:31:40.632 INFO:tasks.workunit.client.0.smithi070.stdout:0/335: mknod d4/d8/d12/d23/d26/c66 0 2024-09-20T20:31:40.633 INFO:tasks.workunit.client.0.smithi070.stdout:9/300: creat d1/df/d18/d46/f6b x:0 0 0 2024-09-20T20:31:40.633 INFO:tasks.workunit.client.0.smithi070.stdout:3/283: creat d7/d15/d1a/d4a/f55 x:0 0 0 2024-09-20T20:31:40.634 INFO:tasks.workunit.client.0.smithi070.stdout:1/352: symlink d4/d32/d34/l86 0 2024-09-20T20:31:40.636 INFO:tasks.workunit.client.0.smithi070.stdout:0/336: dread - d4/d8/d12/d23/d26/d1d/d37/d38/f63 zero size 2024-09-20T20:31:40.636 INFO:tasks.workunit.client.0.smithi070.stdout:9/301: chown d1/df/c40 49899 1 2024-09-20T20:31:40.636 INFO:tasks.workunit.client.0.smithi070.stdout:7/214: truncate d2/d19/f27 3106528 0 2024-09-20T20:31:40.636 INFO:tasks.workunit.client.0.smithi070.stdout:6/263: dwrite d4/d8/d17/d33/f52 [0,4194304] 0 2024-09-20T20:31:40.637 INFO:tasks.workunit.client.0.smithi070.stdout:5/317: dwrite d2/df/d40/d46/d5b/f45 [0,4194304] 0 2024-09-20T20:31:40.638 INFO:tasks.workunit.client.0.smithi070.stdout:1/353: mkdir d4/d32/d34/d44/d4b/d87 0 2024-09-20T20:31:40.638 INFO:tasks.workunit.client.0.smithi070.stdout:5/318: rmdir d2/d7 39 2024-09-20T20:31:40.638 INFO:tasks.workunit.client.0.smithi070.stdout:8/334: dwrite d4/d27/d42/f72 [0,4194304] 0 2024-09-20T20:31:40.638 INFO:tasks.workunit.client.0.smithi070.stdout:0/337: mkdir d4/d48/d67 0 2024-09-20T20:31:40.639 INFO:tasks.workunit.client.0.smithi070.stdout:1/354: chown d4/l53 2 1 2024-09-20T20:31:40.640 INFO:tasks.workunit.client.0.smithi070.stdout:5/319: mkdir d2/d4/de/d47/d67 0 2024-09-20T20:31:40.640 INFO:tasks.workunit.client.0.smithi070.stdout:9/302: rename d1/f26 to d1/df/f6c 0 2024-09-20T20:31:40.641 INFO:tasks.workunit.client.0.smithi070.stdout:1/355: symlink d4/d32/d60/l88 0 2024-09-20T20:31:40.642 INFO:tasks.workunit.client.0.smithi070.stdout:8/335: creat d4/d27/d2a/d75/f77 x:0 0 0 2024-09-20T20:31:40.642 INFO:tasks.workunit.client.0.smithi070.stdout:1/356: fdatasync d4/d32/d34/f59 0 2024-09-20T20:31:40.643 INFO:tasks.workunit.client.0.smithi070.stdout:6/264: rename d4/d8/f25 to d4/d8/d10/d3c/f5e 0 2024-09-20T20:31:40.644 INFO:tasks.workunit.client.0.smithi070.stdout:9/303: creat d1/df/d18/d44/f6d x:0 0 0 2024-09-20T20:31:40.644 INFO:tasks.workunit.client.0.smithi070.stdout:6/265: chown d4/d8/d10/f2b 471463 1 2024-09-20T20:31:40.645 INFO:tasks.workunit.client.0.smithi070.stdout:9/304: getdents d1/df/d2d 0 2024-09-20T20:31:40.648 INFO:tasks.workunit.client.0.smithi070.stdout:0/338: dwrite d4/f16 [0,4194304] 0 2024-09-20T20:31:40.648 INFO:tasks.workunit.client.0.smithi070.stdout:8/336: dread d4/d27/d42/f44 [0,4194304] 0 2024-09-20T20:31:40.650 INFO:tasks.workunit.client.0.smithi070.stdout:8/337: creat d4/db/d66/f78 x:0 0 0 2024-09-20T20:31:40.652 INFO:tasks.workunit.client.0.smithi070.stdout:8/338: rename d4/db/cd to d4/d27/d2a/d5b/d6c/c79 0 2024-09-20T20:31:40.652 INFO:tasks.workunit.client.0.smithi070.stdout:9/305: dwrite d1/df/f28 [0,4194304] 0 2024-09-20T20:31:40.652 INFO:tasks.workunit.client.0.smithi070.stdout:8/339: write d4/d27/f36 [860009,8659] 0 2024-09-20T20:31:40.654 INFO:tasks.workunit.client.0.smithi070.stdout:9/306: rmdir d1/df/d2d 39 2024-09-20T20:31:40.654 INFO:tasks.workunit.client.0.smithi070.stdout:8/340: mknod d4/d27/d42/c7a 0 2024-09-20T20:31:40.655 INFO:tasks.workunit.client.0.smithi070.stdout:9/307: rename d1/f3e to d1/df/d25/f6e 0 2024-09-20T20:31:40.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/341: write d4/d27/d2a/d75/f77 [185095,25949] 0 2024-09-20T20:31:40.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/342: write d4/db/f11 [4239420,66356] 0 2024-09-20T20:31:40.656 INFO:tasks.workunit.client.0.smithi070.stdout:9/308: mknod d1/df/d18/d44/c6f 0 2024-09-20T20:31:40.657 INFO:tasks.workunit.client.0.smithi070.stdout:9/309: truncate d1/f2a 269183 0 2024-09-20T20:31:40.658 INFO:tasks.workunit.client.0.smithi070.stdout:9/310: getdents d1/df/d4a 0 2024-09-20T20:31:40.659 INFO:tasks.workunit.client.0.smithi070.stdout:9/311: creat d1/df/f70 x:0 0 0 2024-09-20T20:31:40.662 INFO:tasks.workunit.client.0.smithi070.stdout:5/320: dread d2/df/d40/d46/d5b/f26 [0,4194304] 0 2024-09-20T20:31:40.664 INFO:tasks.workunit.client.0.smithi070.stdout:9/312: truncate d1/df/f59 67973 0 2024-09-20T20:31:40.664 INFO:tasks.workunit.client.0.smithi070.stdout:3/284: dread d7/d8/f11 [0,4194304] 0 2024-09-20T20:31:40.664 INFO:tasks.workunit.client.0.smithi070.stdout:5/321: creat d2/df/f68 x:0 0 0 2024-09-20T20:31:40.665 INFO:tasks.workunit.client.0.smithi070.stdout:7/215: dwrite d2/d19/f27 [0,4194304] 0 2024-09-20T20:31:40.665 INFO:tasks.workunit.client.0.smithi070.stdout:9/313: dread - d1/df/d18/d46/f55 zero size 2024-09-20T20:31:40.666 INFO:tasks.workunit.client.0.smithi070.stdout:3/285: mknod d7/d8/d13/d1d/c56 0 2024-09-20T20:31:40.668 INFO:tasks.workunit.client.0.smithi070.stdout:3/286: chown d7/d15/d1e/c1f 102728 1 2024-09-20T20:31:40.668 INFO:tasks.workunit.client.0.smithi070.stdout:6/266: dread d4/d8/d10/f2b [0,4194304] 0 2024-09-20T20:31:40.668 INFO:tasks.workunit.client.0.smithi070.stdout:7/216: rename d2/fa to d2/d19/d25/d2a/f44 0 2024-09-20T20:31:40.669 INFO:tasks.workunit.client.0.smithi070.stdout:3/287: chown d7/d15/d23 27952862 1 2024-09-20T20:31:40.669 INFO:tasks.workunit.client.0.smithi070.stdout:5/322: mknod d2/d7/d60/c69 0 2024-09-20T20:31:40.669 INFO:tasks.workunit.client.0.smithi070.stdout:6/267: creat d4/d8/d1e/f5f x:0 0 0 2024-09-20T20:31:40.670 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:40.670 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:40.671 INFO:tasks.workunit.client.0.smithi070.stdout:7/217: creat d2/f45 x:0 0 0 2024-09-20T20:31:40.672 INFO:tasks.workunit.client.0.smithi070.stdout:5/323: rename d2/df/d40/d46/d5b/c4e to d2/df/c6a 0 2024-09-20T20:31:40.672 INFO:tasks.workunit.client.0.smithi070.stdout:7/218: fsync d2/f1e 0 2024-09-20T20:31:40.672 INFO:tasks.workunit.client.0.smithi070.stdout:3/288: dread d7/d15/d1a/f44 [0,4194304] 0 2024-09-20T20:31:40.673 INFO:tasks.workunit.client.0.smithi070.stdout:8/343: dread d4/d27/f40 [4194304,4194304] 0 2024-09-20T20:31:40.673 INFO:tasks.workunit.client.0.smithi070.stdout:9/314: dwrite d1/df/d25/f2e [0,4194304] 0 2024-09-20T20:31:40.673 INFO:tasks.workunit.client.0.smithi070.stdout:3/289: unlink d7/f4c 0 2024-09-20T20:31:40.676 INFO:tasks.workunit.client.0.smithi070.stdout:8/344: mkdir d4/db/d64/d7b 0 2024-09-20T20:31:40.677 INFO:tasks.workunit.client.0.smithi070.stdout:5/324: getdents d2/d4/de/d47/d67 0 2024-09-20T20:31:40.680 INFO:tasks.workunit.client.0.smithi070.stdout:0/339: dread d4/d19/f3f [0,4194304] 0 2024-09-20T20:31:40.680 INFO:tasks.workunit.client.0.smithi070.stdout:6/268: dwrite d4/d8/d17/d33/d36/f53 [0,4194304] 0 2024-09-20T20:31:40.680 INFO:tasks.workunit.client.0.smithi070.stdout:8/345: rename d4/c1e to d4/d27/d2a/c7c 0 2024-09-20T20:31:40.680 INFO:tasks.workunit.client.0.smithi070.stdout:9/315: dread d1/f7 [0,4194304] 0 2024-09-20T20:31:40.680 INFO:tasks.workunit.client.0.smithi070.stdout:7/219: dread d2/d8/f18 [0,4194304] 0 2024-09-20T20:31:40.681 INFO:tasks.workunit.client.0.smithi070.stdout:0/340: fsync d4/d19/f29 0 2024-09-20T20:31:40.682 INFO:tasks.workunit.client.0.smithi070.stdout:5/325: getdents d2/df/d40/d46 0 2024-09-20T20:31:40.682 INFO:tasks.workunit.client.0.smithi070.stdout:6/269: read - d4/d8/d1e/f5b zero size 2024-09-20T20:31:40.682 INFO:tasks.workunit.client.0.smithi070.stdout:8/346: mknod d4/d27/d2a/d5b/d6c/c7d 0 2024-09-20T20:31:40.683 INFO:tasks.workunit.client.0.smithi070.stdout:9/316: link d1/c13 d1/df/d4a/c71 0 2024-09-20T20:31:40.683 INFO:tasks.workunit.client.0.smithi070.stdout:3/290: dwrite d7/d15/f3f [0,4194304] 0 2024-09-20T20:31:40.683 INFO:tasks.workunit.client.0.smithi070.stdout:3/291: stat d7/d15/d1a/c43 0 2024-09-20T20:31:40.685 INFO:tasks.workunit.client.0.smithi070.stdout:8/347: readlink d4/db/l23 0 2024-09-20T20:31:40.685 INFO:tasks.workunit.client.0.smithi070.stdout:9/317: rmdir d1/df/d25/d69 39 2024-09-20T20:31:40.685 INFO:tasks.workunit.client.0.smithi070.stdout:6/270: write d4/f6 [1401844,73937] 0 2024-09-20T20:31:40.686 INFO:tasks.workunit.client.0.smithi070.stdout:3/292: mkdir d7/d15/d1a/d48/d57 0 2024-09-20T20:31:40.686 INFO:tasks.workunit.client.0.smithi070.stdout:8/348: mkdir d4/d27/d2a/d7e 0 2024-09-20T20:31:40.686 INFO:tasks.workunit.client.0.smithi070.stdout:3/293: chown d7/d15/d23 60744 1 2024-09-20T20:31:40.686 INFO:tasks.workunit.client.0.smithi070.stdout:5/326: rename d2/df/d40/d46/d63/c58 to d2/df/c6b 0 2024-09-20T20:31:40.687 INFO:tasks.workunit.client.0.smithi070.stdout:6/271: symlink d4/d8/d38/d50/l60 0 2024-09-20T20:31:40.687 INFO:tasks.workunit.client.0.smithi070.stdout:5/327: chown d2/l36 3 1 2024-09-20T20:31:40.687 INFO:tasks.workunit.client.0.smithi070.stdout:3/294: write d7/d8/d13/f26 [1647062,90217] 0 2024-09-20T20:31:40.688 INFO:tasks.workunit.client.0.smithi070.stdout:6/272: mkdir d4/d8/d17/d33/d61 0 2024-09-20T20:31:40.688 INFO:tasks.workunit.client.0.smithi070.stdout:5/328: rename d2/df/l10 to d2/d4/l6c 0 2024-09-20T20:31:40.688 INFO:tasks.workunit.client.0.smithi070.stdout:3/295: symlink d7/d15/d1a/d4a/d54/l58 0 2024-09-20T20:31:40.689 INFO:tasks.workunit.client.0.smithi070.stdout:6/273: symlink d4/d8/d10/d3c/l62 0 2024-09-20T20:31:40.689 INFO:tasks.workunit.client.0.smithi070.stdout:5/329: dread - d2/df/f68 zero size 2024-09-20T20:31:40.689 INFO:tasks.workunit.client.0.smithi070.stdout:0/341: read d4/f11 [7032925,53693] 0 2024-09-20T20:31:40.690 INFO:tasks.workunit.client.0.smithi070.stdout:3/296: getdents d7/d15/d1a/d4a/d51 0 2024-09-20T20:31:40.690 INFO:tasks.workunit.client.0.smithi070.stdout:0/342: dread - d4/d13/f61 zero size 2024-09-20T20:31:40.690 INFO:tasks.workunit.client.0.smithi070.stdout:6/274: link d4/f6 d4/d8/d17/d33/d36/f63 0 2024-09-20T20:31:40.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:40.693 INFO:tasks.workunit.client.0.smithi070.stdout:5/330: write d2/df/d40/d46/d5b/f42 [217225,83105] 0 2024-09-20T20:31:40.693 INFO:tasks.workunit.client.0.smithi070.stdout:3/297: dread - d7/d8/f42 zero size 2024-09-20T20:31:40.693 INFO:tasks.workunit.client.0.smithi070.stdout:3/298: readlink d7/d8/d13/d1d/l30 0 2024-09-20T20:31:40.693 INFO:tasks.workunit.client.0.smithi070.stdout:3/299: fsync d7/d15/f4f 0 2024-09-20T20:31:40.693 INFO:tasks.workunit.client.0.smithi070.stdout:0/343: getdents d4/d8/d12/d23/d26/d1f/d2e 0 2024-09-20T20:31:40.694 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:40.695 INFO:tasks.workunit.client.0.smithi070.stdout:5/331: dread d2/df/d40/d46/d5b/f26 [0,4194304] 0 2024-09-20T20:31:40.695 INFO:tasks.workunit.client.0.smithi070.stdout:8/349: dwrite d4/d27/d2a/d3e/d31/f3f [0,4194304] 0 2024-09-20T20:31:40.695 INFO:tasks.workunit.client.0.smithi070.stdout:0/344: creat d4/d13/f68 x:0 0 0 2024-09-20T20:31:40.696 INFO:tasks.workunit.client.0.smithi070.stdout:3/300: link d7/d15/d1e/f2f d7/d15/d1a/d48/d57/f59 0 2024-09-20T20:31:40.696 INFO:tasks.workunit.client.0.smithi070.stdout:5/332: symlink d2/d4/de/d47/d5f/l6d 0 2024-09-20T20:31:40.696 INFO:tasks.workunit.client.0.smithi070.stdout:0/345: stat d4/f7 0 2024-09-20T20:31:40.698 INFO:tasks.workunit.client.0.smithi070.stdout:9/318: write d1/fe [2973750,91870] 0 2024-09-20T20:31:40.698 INFO:tasks.workunit.client.0.smithi070.stdout:8/350: getdents d4/d27/d2a 0 2024-09-20T20:31:40.700 INFO:tasks.workunit.client.0.smithi070.stdout:6/275: dwrite f0 [4194304,4194304] 0 2024-09-20T20:31:40.700 INFO:tasks.workunit.client.0.smithi070.stdout:0/346: readlink d4/d8/d12/d23/d26/d1f/l32 0 2024-09-20T20:31:40.701 INFO:tasks.workunit.client.0.smithi070.stdout:6/276: write d4/d8/d17/f31 [2977722,39811] 0 2024-09-20T20:31:40.702 INFO:tasks.workunit.client.0.smithi070.stdout:6/277: mkdir d4/d8/d10/d54/d64 0 2024-09-20T20:31:40.706 INFO:tasks.workunit.client.0.smithi070.stdout:0/347: unlink d4/d8/d12/d23/d26/d1f/l32 0 2024-09-20T20:31:40.707 INFO:tasks.workunit.client.0.smithi070.stdout:9/319: dwrite d1/f61 [4194304,4194304] 0 2024-09-20T20:31:40.709 INFO:tasks.workunit.client.0.smithi070.stdout:5/333: dread d2/df/d40/d46/d4c/f44 [0,4194304] 0 2024-09-20T20:31:40.709 INFO:tasks.workunit.client.0.smithi070.stdout:9/320: chown d1/df/d25/c49 40568 1 2024-09-20T20:31:40.710 INFO:tasks.workunit.client.0.smithi070.stdout:7/220: dread f1 [0,4194304] 0 2024-09-20T20:31:40.711 INFO:tasks.workunit.client.0.smithi070.stdout:5/334: symlink d2/df/d40/l6e 0 2024-09-20T20:31:40.711 INFO:tasks.workunit.client.0.smithi070.stdout:0/348: creat d4/d8/f69 x:0 0 0 2024-09-20T20:31:40.712 INFO:tasks.workunit.client.0.smithi070.stdout:9/321: mknod d1/df/d2d/c72 0 2024-09-20T20:31:40.712 INFO:tasks.workunit.client.0.smithi070.stdout:6/278: dwrite d4/d8/d3a/f41 [0,4194304] 0 2024-09-20T20:31:40.713 INFO:tasks.workunit.client.0.smithi070.stdout:7/221: readlink d2/d19/l21 0 2024-09-20T20:31:40.713 INFO:tasks.workunit.client.0.smithi070.stdout:5/335: read d2/df/d40/d46/d4c/f44 [318167,2868] 0 2024-09-20T20:31:40.714 INFO:tasks.workunit.client.0.smithi070.stdout:6/279: stat d4/d8/d17/f57 0 2024-09-20T20:31:40.714 INFO:tasks.workunit.client.0.smithi070.stdout:9/322: rmdir d1/df/d25/d69 39 2024-09-20T20:31:40.714 INFO:tasks.workunit.client.0.smithi070.stdout:6/280: write d4/f13 [6572581,92442] 0 2024-09-20T20:31:40.715 INFO:tasks.workunit.client.0.smithi070.stdout:9/323: unlink d1/df/d18/l5c 0 2024-09-20T20:31:40.715 INFO:tasks.workunit.client.0.smithi070.stdout:3/301: dread d7/d15/d1e/f2f [4194304,4194304] 0 2024-09-20T20:31:40.716 INFO:tasks.workunit.client.0.smithi070.stdout:9/324: fsync d1/f2a 0 2024-09-20T20:31:40.716 INFO:tasks.workunit.client.0.smithi070.stdout:0/349: symlink d4/d8/d12/d23/d26/d1f/d4d/l6a 0 2024-09-20T20:31:40.716 INFO:tasks.workunit.client.0.smithi070.stdout:3/302: mkdir d7/d8/d13/d5a 0 2024-09-20T20:31:40.717 INFO:tasks.workunit.client.0.smithi070.stdout:9/325: readlink d1/df/l5e 0 2024-09-20T20:31:40.717 INFO:tasks.workunit.client.0.smithi070.stdout:3/303: fdatasync d7/d15/d1a/d4a/f4d 0 2024-09-20T20:31:40.720 INFO:tasks.workunit.client.0.smithi070.stdout:9/326: write d1/df/d2d/f57 [385185,17509] 0 2024-09-20T20:31:40.721 INFO:tasks.workunit.client.0.smithi070.stdout:6/281: dwrite d4/d8/f2f [0,4194304] 0 2024-09-20T20:31:40.722 INFO:tasks.workunit.client.0.smithi070.stdout:9/327: chown d1/df/l15 21 1 2024-09-20T20:31:40.722 INFO:tasks.workunit.client.0.smithi070.stdout:7/222: dwrite d2/d8/f16 [0,4194304] 0 2024-09-20T20:31:40.723 INFO:tasks.workunit.client.0.smithi070.stdout:5/336: read d2/df/f22 [101979,95874] 0 2024-09-20T20:31:40.725 INFO:tasks.workunit.client.0.smithi070.stdout:8/351: fsync d4/d27/d2a/d3e/d31/f3f 0 2024-09-20T20:31:40.725 INFO:tasks.workunit.client.0.smithi070.stdout:6/282: creat d4/d8/d10/f65 x:0 0 0 2024-09-20T20:31:40.726 INFO:tasks.workunit.client.0.smithi070.stdout:9/328: creat d1/df/d18/d46/f73 x:0 0 0 2024-09-20T20:31:40.726 INFO:tasks.workunit.client.0.smithi070.stdout:8/352: fsync d4/db/f5e 0 2024-09-20T20:31:40.726 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:40.720+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:40.727 INFO:tasks.workunit.client.0.smithi070.stdout:9/329: chown d1/df/d2d/f4e 107362546 1 2024-09-20T20:31:40.727 INFO:tasks.workunit.client.0.smithi070.stdout:8/353: rename d4/c29 to d4/d27/d42/c7f 0 2024-09-20T20:31:40.728 INFO:tasks.workunit.client.0.smithi070.stdout:9/330: chown f0 9 1 2024-09-20T20:31:40.728 INFO:tasks.workunit.client.0.smithi070.stdout:9/331: stat d1/df/f28 0 2024-09-20T20:31:40.729 INFO:tasks.workunit.client.0.smithi070.stdout:0/350: dwrite d4/f7 [0,4194304] 0 2024-09-20T20:31:40.732 INFO:tasks.workunit.client.0.smithi070.stdout:7/223: truncate d2/d8/f16 898442 0 2024-09-20T20:31:40.732 INFO:tasks.workunit.client.0.smithi070.stdout:3/304: dread d7/fd [0,4194304] 0 2024-09-20T20:31:40.732 INFO:tasks.workunit.client.0.smithi070.stdout:9/332: rename d1/l53 to d1/df/d25/d69/l74 0 2024-09-20T20:31:40.732 INFO:tasks.workunit.client.0.smithi070.stdout:0/351: chown d4/d8/d55/l56 16134 1 2024-09-20T20:31:40.733 INFO:tasks.workunit.client.0.smithi070.stdout:7/224: symlink d2/d8/l46 0 2024-09-20T20:31:40.734 INFO:tasks.workunit.client.0.smithi070.stdout:9/333: chown f0 220725 1 2024-09-20T20:31:40.735 INFO:tasks.workunit.client.0.smithi070.stdout:3/305: chown d7/d15/d1a/c43 18613378 1 2024-09-20T20:31:40.735 INFO:tasks.workunit.client.0.smithi070.stdout:5/337: dwrite d2/df/d40/d46/d5b/f5e [4194304,4194304] 0 2024-09-20T20:31:40.736 INFO:tasks.workunit.client.0.smithi070.stdout:9/334: fsync d1/df/d25/f4f 0 2024-09-20T20:31:40.736 INFO:tasks.workunit.client.0.smithi070.stdout:2/338: sync 2024-09-20T20:31:40.736 INFO:tasks.workunit.client.0.smithi070.stdout:4/319: sync 2024-09-20T20:31:40.737 INFO:tasks.workunit.client.0.smithi070.stdout:1/357: sync 2024-09-20T20:31:40.737 INFO:tasks.workunit.client.0.smithi070.stdout:7/225: creat d2/d8/f47 x:0 0 0 2024-09-20T20:31:40.737 INFO:tasks.workunit.client.0.smithi070.stdout:6/283: dwrite d4/d8/d17/d33/d36/f53 [4194304,4194304] 0 2024-09-20T20:31:40.737 INFO:tasks.workunit.client.0.smithi070.stdout:0/352: dread d4/d8/d12/f25 [0,4194304] 0 2024-09-20T20:31:40.738 INFO:tasks.workunit.client.0.smithi070.stdout:8/354: dwrite d4/d27/d2a/d3e/d31/f52 [0,4194304] 0 2024-09-20T20:31:40.739 INFO:tasks.workunit.client.0.smithi070.stdout:7/226: fdatasync d2/d19/d2e/f41 0 2024-09-20T20:31:40.742 INFO:tasks.workunit.client.0.smithi070.stdout:2/339: unlink d3/d5/d9/d42/f69 0 2024-09-20T20:31:40.742 INFO:tasks.workunit.client.0.smithi070.stdout:3/306: mkdir d7/d15/d1a/d4a/d51/d5b 0 2024-09-20T20:31:40.744 INFO:tasks.workunit.client.0.smithi070.stdout:8/355: creat d4/db/d64/f80 x:0 0 0 2024-09-20T20:31:40.744 INFO:tasks.workunit.client.0.smithi070.stdout:7/227: mknod d2/d19/c48 0 2024-09-20T20:31:40.744 INFO:tasks.workunit.client.0.smithi070.stdout:5/338: rename d2/d4/fa to d2/d7/d60/f6f 0 2024-09-20T20:31:40.744 INFO:tasks.workunit.client.0.smithi070.stdout:6/284: rmdir d4/d8/d10/d54 39 2024-09-20T20:31:40.744 INFO:tasks.workunit.client.0.smithi070.stdout:3/307: dread - d7/d15/d23/f3c zero size 2024-09-20T20:31:40.745 INFO:tasks.workunit.client.0.smithi070.stdout:0/353: getdents d4/d19 0 2024-09-20T20:31:40.748 INFO:tasks.workunit.client.0.smithi070.stdout:0/354: chown d4/f9 0 1 2024-09-20T20:31:40.749 INFO:tasks.workunit.client.0.smithi070.stdout:9/335: dwrite d1/df/f22 [0,4194304] 0 2024-09-20T20:31:40.749 INFO:tasks.workunit.client.0.smithi070.stdout:4/320: dwrite d6/d43/d5a/f68 [0,4194304] 0 2024-09-20T20:31:40.751 INFO:tasks.workunit.client.0.smithi070.stdout:3/308: truncate d7/d15/d23/f27 574017 0 2024-09-20T20:31:40.752 INFO:tasks.workunit.client.0.smithi070.stdout:0/355: creat d4/d13/f6b x:0 0 0 2024-09-20T20:31:40.752 INFO:tasks.workunit.client.0.smithi070.stdout:7/228: dread d2/f1e [0,4194304] 0 2024-09-20T20:31:40.753 INFO:tasks.workunit.client.0.smithi070.stdout:8/356: getdents d4 0 2024-09-20T20:31:40.753 INFO:tasks.workunit.client.0.smithi070.stdout:1/358: link d4/d6/d11/d2c/d3b/c5c d4/d6/d2f/c89 0 2024-09-20T20:31:40.753 INFO:tasks.workunit.client.0.smithi070.stdout:7/229: stat d2/d30 0 2024-09-20T20:31:40.754 INFO:tasks.workunit.client.0.smithi070.stdout:4/321: readlink d6/d5e/l31 0 2024-09-20T20:31:40.754 INFO:tasks.workunit.client.0.smithi070.stdout:7/230: dread - d2/d8/f47 zero size 2024-09-20T20:31:40.754 INFO:tasks.workunit.client.0.smithi070.stdout:3/309: chown d7/d8/d13/d1d/f41 8351401 1 2024-09-20T20:31:40.755 INFO:tasks.workunit.client.0.smithi070.stdout:4/322: mknod d6/d43/c6e 0 2024-09-20T20:31:40.756 INFO:tasks.workunit.client.0.smithi070.stdout:6/285: dwrite d4/f13 [4194304,4194304] 0 2024-09-20T20:31:40.758 INFO:tasks.workunit.client.0.smithi070.stdout:0/356: stat d4/d48/d4e/f5a 0 2024-09-20T20:31:40.759 INFO:tasks.workunit.client.0.smithi070.stdout:2/340: dwrite d3/d5/dd/f63 [0,4194304] 0 2024-09-20T20:31:40.759 INFO:tasks.workunit.client.0.smithi070.stdout:9/336: creat d1/df/d25/d69/f75 x:0 0 0 2024-09-20T20:31:40.760 INFO:tasks.workunit.client.0.smithi070.stdout:1/359: rename d4/d1f/l2a to d4/l8a 0 2024-09-20T20:31:40.760 INFO:tasks.workunit.client.0.smithi070.stdout:3/310: creat d7/d15/d23/f5c x:0 0 0 2024-09-20T20:31:40.761 INFO:tasks.workunit.client.0.smithi070.stdout:5/339: getdents d2/df/d40/d46/d63 0 2024-09-20T20:31:40.761 INFO:tasks.workunit.client.0.smithi070.stdout:0/357: link d4/d19/d5b/f5f d4/d8/d12/d23/d26/d2d/f6c 0 2024-09-20T20:31:40.762 INFO:tasks.workunit.client.0.smithi070.stdout:6/286: chown d4/f23 45 1 2024-09-20T20:31:40.762 INFO:tasks.workunit.client.0.smithi070.stdout:1/360: mknod d4/d6/d11/d7b/c8b 0 2024-09-20T20:31:40.762 INFO:tasks.workunit.client.0.smithi070.stdout:4/323: fsync d6/d7/f3e 0 2024-09-20T20:31:40.762 INFO:tasks.workunit.client.0.smithi070.stdout:5/340: symlink d2/df/d40/l70 0 2024-09-20T20:31:40.763 INFO:tasks.workunit.client.0.smithi070.stdout:3/311: chown d7/d8/d13/d1d/f47 36567166 1 2024-09-20T20:31:40.764 INFO:tasks.workunit.client.0.smithi070.stdout:8/357: dwrite d4/d27/f36 [0,4194304] 0 2024-09-20T20:31:40.766 INFO:tasks.workunit.client.0.smithi070.stdout:5/341: write d2/df/d40/f62 [387373,95636] 0 2024-09-20T20:31:40.766 INFO:tasks.workunit.client.0.smithi070.stdout:8/358: chown d4/d27/d42/c7a 47588780 1 2024-09-20T20:31:40.766 INFO:tasks.workunit.client.0.smithi070.stdout:7/231: dread d2/d8/f18 [0,4194304] 0 2024-09-20T20:31:40.766 INFO:tasks.workunit.client.0.smithi070.stdout:9/337: rename d1/df/d4a to d1/d76 0 2024-09-20T20:31:40.768 INFO:tasks.workunit.client.0.smithi070.stdout:1/361: creat d4/d6/d2f/f8c x:0 0 0 2024-09-20T20:31:40.768 INFO:tasks.workunit.client.0.smithi070.stdout:5/342: write d2/d4/de/f29 [1938751,116103] 0 2024-09-20T20:31:40.768 INFO:tasks.workunit.client.0.smithi070.stdout:6/287: link d4/d8/d10/f45 d4/d8/d3a/f66 0 2024-09-20T20:31:40.768 INFO:tasks.workunit.client.0.smithi070.stdout:9/338: mkdir d1/df/d18/d44/d77 0 2024-09-20T20:31:40.772 INFO:tasks.workunit.client.0.smithi070.stdout:4/324: link d6/f8 d6/f6f 0 2024-09-20T20:31:40.772 INFO:tasks.workunit.client.0.smithi070.stdout:8/359: link d4/d27/d2a/d3e/d39/f41 d4/db/d66/f81 0 2024-09-20T20:31:40.772 INFO:tasks.workunit.client.0.smithi070.stdout:9/339: creat d1/df/d18/d46/f78 x:0 0 0 2024-09-20T20:31:40.772 INFO:tasks.workunit.client.0.smithi070.stdout:0/358: dwrite d4/d8/d12/f25 [0,4194304] 0 2024-09-20T20:31:40.772 INFO:tasks.workunit.client.0.smithi070.stdout:5/343: rename d2/fb to d2/df/d40/d46/d4c/f71 0 2024-09-20T20:31:40.773 INFO:tasks.workunit.client.0.smithi070.stdout:4/325: dread - d6/d7/f3e zero size 2024-09-20T20:31:40.777 INFO:tasks.workunit.client.0.smithi070.stdout:1/362: dread d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:40.779 INFO:tasks.workunit.client.0.smithi070.stdout:4/326: fsync d6/d43/f47 0 2024-09-20T20:31:40.779 INFO:tasks.workunit.client.0.smithi070.stdout:6/288: getdents d4/d8/d10 0 2024-09-20T20:31:40.779 INFO:tasks.workunit.client.0.smithi070.stdout:0/359: write f2 [121449,61594] 0 2024-09-20T20:31:40.780 INFO:tasks.workunit.client.0.smithi070.stdout:9/340: dread d1/f1f [0,4194304] 0 2024-09-20T20:31:40.781 INFO:tasks.workunit.client.0.smithi070.stdout:1/363: write d4/d6/d11/d2c/d3b/f74 [121147,107802] 0 2024-09-20T20:31:40.782 INFO:tasks.workunit.client.0.smithi070.stdout:0/360: chown d4/d8/d12/d23/d26/d1d/d37/f60 446664 1 2024-09-20T20:31:40.783 INFO:tasks.workunit.client.0.smithi070.stdout:7/232: write d2/d8/f3b [1269384,104021] 0 2024-09-20T20:31:40.784 INFO:tasks.workunit.client.0.smithi070.stdout:9/341: mkdir d1/d76/d79 0 2024-09-20T20:31:40.785 INFO:tasks.workunit.client.0.smithi070.stdout:8/360: dwrite d4/d27/d2a/d43/f45 [0,4194304] 0 2024-09-20T20:31:40.785 INFO:tasks.workunit.client.0.smithi070.stdout:7/233: symlink d2/d19/d25/l49 0 2024-09-20T20:31:40.785 INFO:tasks.workunit.client.0.smithi070.stdout:1/364: creat d4/d6/d26/f8d x:0 0 0 2024-09-20T20:31:40.785 INFO:tasks.workunit.client.0.smithi070.stdout:6/289: getdents d4/d8/d17/d33/d61 0 2024-09-20T20:31:40.785 INFO:tasks.workunit.client.0.smithi070.stdout:4/327: read d6/d43/f57 [3447020,91169] 0 2024-09-20T20:31:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:31:40.791 INFO:tasks.workunit.client.0.smithi070.stdout:0/361: creat d4/d8/d12/d23/d26/d1f/d2e/f6d x:0 0 0 2024-09-20T20:31:40.793 INFO:tasks.workunit.client.0.smithi070.stdout:8/361: mknod d4/d27/d2a/d43/d61/c82 0 2024-09-20T20:31:40.794 INFO:tasks.workunit.client.0.smithi070.stdout:6/290: dread d4/d8/d10/f2d [0,4194304] 0 2024-09-20T20:31:40.794 INFO:tasks.workunit.client.0.smithi070.stdout:3/312: dread d7/d8/d13/d1d/f37 [0,4194304] 0 2024-09-20T20:31:40.795 INFO:tasks.workunit.client.0.smithi070.stdout:7/234: mkdir d2/d19/d25/d2a/d4a 0 2024-09-20T20:31:40.795 INFO:tasks.workunit.client.0.smithi070.stdout:9/342: rename d1/df/d18/l62 to d1/df/d38/l7a 0 2024-09-20T20:31:40.798 INFO:tasks.workunit.client.0.smithi070.stdout:4/328: getdents d6/d5e/d17 0 2024-09-20T20:31:40.798 INFO:tasks.workunit.client.0.smithi070.stdout:3/313: truncate d7/f1b 6493756 0 2024-09-20T20:31:40.801 INFO:tasks.workunit.client.0.smithi070.stdout:1/365: dwrite d4/d6/f47 [0,4194304] 0 2024-09-20T20:31:40.802 INFO:tasks.workunit.client.0.smithi070.stdout:4/329: creat d6/d5e/f70 x:0 0 0 2024-09-20T20:31:40.803 INFO:tasks.workunit.client.0.smithi070.stdout:2/341: dread d3/f75 [0,4194304] 0 2024-09-20T20:31:40.804 INFO:tasks.workunit.client.0.smithi070.stdout:1/366: read - d4/d6/d26/f8d zero size 2024-09-20T20:31:40.805 INFO:tasks.workunit.client.0.smithi070.stdout:3/314: mknod d7/d8/d13/d5a/c5d 0 2024-09-20T20:31:40.805 INFO:tasks.workunit.client.0.smithi070.stdout:8/362: link d4/d27/d2a/d3e/d31/f52 d4/d27/d2a/d7e/f83 0 2024-09-20T20:31:40.805 INFO:tasks.workunit.client.0.smithi070.stdout:9/343: rename d1/df/d38/f3b to d1/df/d18/d44/d77/f7b 0 2024-09-20T20:31:40.808 INFO:tasks.workunit.client.0.smithi070.stdout:6/291: dwrite d4/d8/d10/f65 [0,4194304] 0 2024-09-20T20:31:40.809 INFO:tasks.workunit.client.0.smithi070.stdout:4/330: rename d6/d5e/d17 to d6/d26/d69/d71 0 2024-09-20T20:31:40.810 INFO:tasks.workunit.client.0.smithi070.stdout:0/362: link d4/d8/d12/d23/d26/d1f/f53 d4/d8/d12/d23/d26/d1f/d4d/f6e 0 2024-09-20T20:31:40.810 INFO:tasks.workunit.client.0.smithi070.stdout:3/315: write d7/d8/f11 [2608490,83745] 0 2024-09-20T20:31:40.810 INFO:tasks.workunit.client.0.smithi070.stdout:6/292: mknod d4/d8/d10/d54/d64/c67 0 2024-09-20T20:31:40.810 INFO:tasks.workunit.client.0.smithi070.stdout:9/344: creat d1/df/d38/f7c x:0 0 0 2024-09-20T20:31:40.810 INFO:tasks.workunit.client.0.smithi070.stdout:4/331: fsync d6/d43/f5c 0 2024-09-20T20:31:40.815 INFO:tasks.workunit.client.0.smithi070.stdout:6/293: getdents d4/d8 0 2024-09-20T20:31:40.817 INFO:tasks.workunit.client.0.smithi070.stdout:6/294: write d4/d8/d38/f4e [2443171,21199] 0 2024-09-20T20:31:40.818 INFO:tasks.workunit.client.0.smithi070.stdout:5/344: dread d2/d7/fc [8388608,4194304] 0 2024-09-20T20:31:40.819 INFO:tasks.workunit.client.0.smithi070.stdout:2/342: dwrite d3/d5/dd/d5a/f5f [0,4194304] 0 2024-09-20T20:31:40.820 INFO:tasks.workunit.client.0.smithi070.stdout:6/295: chown d4/d8/d17/d33 1 1 2024-09-20T20:31:40.822 INFO:tasks.workunit.client.0.smithi070.stdout:7/235: dread d2/d8/f12 [0,4194304] 0 2024-09-20T20:31:40.822 INFO:tasks.workunit.client.0.smithi070.stdout:5/345: dread d2/df/d40/d46/d4c/f44 [0,4194304] 0 2024-09-20T20:31:40.823 INFO:tasks.workunit.client.0.smithi070.stdout:0/363: dread d4/d8/d12/f14 [0,4194304] 0 2024-09-20T20:31:40.823 INFO:tasks.workunit.client.0.smithi070.stdout:9/345: dwrite d1/df/f19 [0,4194304] 0 2024-09-20T20:31:40.823 INFO:tasks.workunit.client.0.smithi070.stdout:6/296: mkdir d4/d8/d68 0 2024-09-20T20:31:40.824 INFO:tasks.workunit.client.0.smithi070.stdout:4/332: write d6/d26/d34/f18 [1168401,56443] 0 2024-09-20T20:31:40.824 INFO:tasks.workunit.client.0.smithi070.stdout:0/364: dread - d4/d8/d12/f50 zero size 2024-09-20T20:31:40.825 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:40.821+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:40.828 INFO:tasks.workunit.client.0.smithi070.stdout:5/346: mknod d2/d7/d60/c72 0 2024-09-20T20:31:40.828 INFO:tasks.workunit.client.0.smithi070.stdout:7/236: rename d2/f1e to d2/d19/d25/d2a/d4a/f4b 0 2024-09-20T20:31:40.828 INFO:tasks.workunit.client.0.smithi070.stdout:2/343: mknod d3/d5/d9/d10/c81 0 2024-09-20T20:31:40.829 INFO:tasks.workunit.client.0.smithi070.stdout:5/347: mknod d2/d7/c73 0 2024-09-20T20:31:40.830 INFO:tasks.workunit.client.0.smithi070.stdout:9/346: link d1/d76/c71 d1/df/d25/c7d 0 2024-09-20T20:31:40.830 INFO:tasks.workunit.client.0.smithi070.stdout:7/237: link d2/d19/d25/d2a/d4a/f4b d2/d19/d25/f4c 0 2024-09-20T20:31:40.832 INFO:tasks.workunit.client.0.smithi070.stdout:9/347: write d1/df/f6c [525855,106297] 0 2024-09-20T20:31:40.833 INFO:tasks.workunit.client.0.smithi070.stdout:0/365: dwrite d4/d8/d12/d23/d26/f33 [0,4194304] 0 2024-09-20T20:31:40.833 INFO:tasks.workunit.client.0.smithi070.stdout:9/348: read - d1/df/d18/d46/f55 zero size 2024-09-20T20:31:40.834 INFO:tasks.workunit.client.0.smithi070.stdout:0/366: chown d4/d8/d12/f25 25756822 1 2024-09-20T20:31:40.834 INFO:tasks.workunit.client.0.smithi070.stdout:9/349: unlink d1/df/l68 0 2024-09-20T20:31:40.835 INFO:tasks.workunit.client.0.smithi070.stdout:0/367: chown d4/d19/f29 1396 1 2024-09-20T20:31:40.838 INFO:tasks.workunit.client.0.smithi070.stdout:7/238: dwrite d2/d8/f3b [0,4194304] 0 2024-09-20T20:31:40.839 INFO:tasks.workunit.client.0.smithi070.stdout:9/350: dread d1/f1f [0,4194304] 0 2024-09-20T20:31:40.839 INFO:tasks.workunit.client.0.smithi070.stdout:4/333: read d6/d7/dc/fe [776799,31555] 0 2024-09-20T20:31:40.841 INFO:tasks.workunit.client.0.smithi070.stdout:1/367: dread d4/d6/f52 [0,4194304] 0 2024-09-20T20:31:40.843 INFO:tasks.workunit.client.0.smithi070.stdout:1/368: write d4/d32/d34/d44/d48/f5e [304864,8713] 0 2024-09-20T20:31:40.843 INFO:tasks.workunit.client.0.smithi070.stdout:0/368: read d4/d8/d12/d23/d26/f2a [1798828,16086] 0 2024-09-20T20:31:40.844 INFO:tasks.workunit.client.0.smithi070.stdout:9/351: write d1/df/d25/f4f [1764428,130151] 0 2024-09-20T20:31:40.844 INFO:tasks.workunit.client.0.smithi070.stdout:5/348: truncate d2/d7/f9 3236619 0 2024-09-20T20:31:40.845 INFO:tasks.workunit.client.0.smithi070.stdout:1/369: rename d4/d1f/d69/f80 to d4/d32/d60/f8e 0 2024-09-20T20:31:40.845 INFO:tasks.workunit.client.0.smithi070.stdout:0/369: symlink d4/d8/d12/d23/d26/l6f 0 2024-09-20T20:31:40.846 INFO:tasks.workunit.client.0.smithi070.stdout:0/370: write d4/f11 [7095590,5212] 0 2024-09-20T20:31:40.846 INFO:tasks.workunit.client.0.smithi070.stdout:9/352: rename d1/df/d18/d44/f67 to d1/df/f7e 0 2024-09-20T20:31:40.848 INFO:tasks.workunit.client.0.smithi070.stdout:0/371: creat d4/d48/f70 x:0 0 0 2024-09-20T20:31:40.848 INFO:tasks.workunit.client.0.smithi070.stdout:9/353: fsync d1/df/d25/d69/f6a 0 2024-09-20T20:31:40.849 INFO:tasks.workunit.client.0.smithi070.stdout:1/370: creat d4/d32/d34/d44/d4b/f8f x:0 0 0 2024-09-20T20:31:40.850 INFO:tasks.workunit.client.0.smithi070.stdout:9/354: creat d1/df/d18/d46/f7f x:0 0 0 2024-09-20T20:31:40.850 INFO:tasks.workunit.client.0.smithi070.stdout:7/239: dwrite d2/d19/d25/d2a/d4a/f4b [0,4194304] 0 2024-09-20T20:31:40.851 INFO:tasks.workunit.client.0.smithi070.stdout:0/372: rename d4/d13/f24 to d4/d19/f71 0 2024-09-20T20:31:40.851 INFO:tasks.workunit.client.0.smithi070.stdout:1/371: creat d4/d1f/f90 x:0 0 0 2024-09-20T20:31:40.853 INFO:tasks.workunit.client.0.smithi070.stdout:9/355: mkdir d1/df/d25/d69/d80 0 2024-09-20T20:31:40.853 INFO:tasks.workunit.client.0.smithi070.stdout:1/372: rmdir d4/d1f 39 2024-09-20T20:31:40.853 INFO:tasks.workunit.client.0.smithi070.stdout:4/334: dread d6/d26/d34/f21 [0,4194304] 0 2024-09-20T20:31:40.853 INFO:tasks.workunit.client.0.smithi070.stdout:5/349: dwrite d2/df/d40/d46/d5b/f37 [0,4194304] 0 2024-09-20T20:31:40.854 INFO:tasks.workunit.client.0.smithi070.stdout:0/373: rmdir d4/d13 39 2024-09-20T20:31:40.854 INFO:tasks.workunit.client.0.smithi070.stdout:7/240: unlink d2/d19/d2e/c37 0 2024-09-20T20:31:40.854 INFO:tasks.workunit.client.0.smithi070.stdout:1/373: read - d4/d6/d2f/f8c zero size 2024-09-20T20:31:40.855 INFO:tasks.workunit.client.0.smithi070.stdout:1/374: read - d4/f71 zero size 2024-09-20T20:31:40.856 INFO:tasks.workunit.client.0.smithi070.stdout:5/350: chown d2/d7/f11 1 1 2024-09-20T20:31:40.856 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:40.856 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:40.857 INFO:tasks.workunit.client.0.smithi070.stdout:9/356: write d1/df/d18/d46/f55 [497378,71264] 0 2024-09-20T20:31:40.857 INFO:tasks.workunit.client.0.smithi070.stdout:1/375: readlink d4/l23 0 2024-09-20T20:31:40.858 INFO:tasks.workunit.client.0.smithi070.stdout:5/351: dread - d2/d4/f57 zero size 2024-09-20T20:31:40.858 INFO:tasks.workunit.client.0.smithi070.stdout:5/352: fdatasync d2/df/d40/f5d 0 2024-09-20T20:31:40.858 INFO:tasks.workunit.client.0.smithi070.stdout:9/357: creat d1/df/d18/d46/f81 x:0 0 0 2024-09-20T20:31:40.858 INFO:tasks.workunit.client.0.smithi070.stdout:5/353: unlink d2/f3f 0 2024-09-20T20:31:40.858 INFO:tasks.workunit.client.0.smithi070.stdout:9/358: mkdir d1/df/d2d/d82 0 2024-09-20T20:31:40.859 INFO:tasks.workunit.client.0.smithi070.stdout:9/359: stat d1/df/c42 0 2024-09-20T20:31:40.859 INFO:tasks.workunit.client.0.smithi070.stdout:5/354: readlink d2/d4/de/l4b 0 2024-09-20T20:31:40.862 INFO:tasks.workunit.client.0.smithi070.stdout:5/355: write d2/df/d40/d46/d4c/f64 [446581,5718] 0 2024-09-20T20:31:40.863 INFO:tasks.workunit.client.0.smithi070.stdout:6/297: dread d4/d8/f28 [0,4194304] 0 2024-09-20T20:31:40.863 INFO:tasks.workunit.client.0.smithi070.stdout:7/241: dwrite d2/d8/f33 [0,4194304] 0 2024-09-20T20:31:40.863 INFO:tasks.workunit.client.0.smithi070.stdout:5/356: unlink d2/d4/f57 0 2024-09-20T20:31:40.864 INFO:tasks.workunit.client.0.smithi070.stdout:1/376: dwrite d4/d6/d11/d2c/d3a/f68 [0,4194304] 0 2024-09-20T20:31:40.868 INFO:tasks.workunit.client.0.smithi070.stdout:7/242: creat d2/d19/f4d x:0 0 0 2024-09-20T20:31:40.870 INFO:tasks.workunit.client.0.smithi070.stdout:4/335: truncate d6/d7/f59 3557775 0 2024-09-20T20:31:40.870 INFO:tasks.workunit.client.0.smithi070.stdout:4/336: symlink d6/d7/dc/l72 0 2024-09-20T20:31:40.870 INFO:tasks.workunit.client.0.smithi070.stdout:1/377: write d4/f15 [4358748,2756] 0 2024-09-20T20:31:40.870 INFO:tasks.workunit.client.0.smithi070.stdout:6/298: creat d4/d8/f69 x:0 0 0 2024-09-20T20:31:40.872 INFO:tasks.workunit.client.0.smithi070.stdout:9/360: dwrite d1/df/d18/f66 [0,4194304] 0 2024-09-20T20:31:40.872 INFO:tasks.workunit.client.0.smithi070.stdout:7/243: write d2/d30/f3f [2393242,4755] 0 2024-09-20T20:31:40.873 INFO:tasks.workunit.client.0.smithi070.stdout:7/244: write d2/f45 [1039387,20417] 0 2024-09-20T20:31:40.873 INFO:tasks.workunit.client.0.smithi070.stdout:9/361: read - d1/df/d18/d46/f81 zero size 2024-09-20T20:31:40.874 INFO:tasks.workunit.client.0.smithi070.stdout:7/245: creat d2/d19/d2e/f4e x:0 0 0 2024-09-20T20:31:40.874 INFO:tasks.workunit.client.0.smithi070.stdout:9/362: mkdir d1/df/d18/d83 0 2024-09-20T20:31:40.875 INFO:tasks.workunit.client.0.smithi070.stdout:6/299: link d4/d8/d3a/f41 d4/d8/d10/d3c/f6a 0 2024-09-20T20:31:40.876 INFO:tasks.workunit.client.0.smithi070.stdout:7/246: rmdir d2/d19/d2e 39 2024-09-20T20:31:40.876 INFO:tasks.workunit.client.0.smithi070.stdout:9/363: mkdir d1/df/d84 0 2024-09-20T20:31:40.876 INFO:tasks.workunit.client.0.smithi070.stdout:9/364: rmdir d1/df/d18/d46 39 2024-09-20T20:31:40.877 INFO:tasks.workunit.client.0.smithi070.stdout:6/300: creat d4/d8/d10/d54/f6b x:0 0 0 2024-09-20T20:31:40.877 INFO:tasks.workunit.client.0.smithi070.stdout:7/247: creat d2/d19/d25/d42/f4f x:0 0 0 2024-09-20T20:31:40.878 INFO:tasks.workunit.client.0.smithi070.stdout:7/248: rmdir d2/d19/d2e 39 2024-09-20T20:31:40.878 INFO:tasks.workunit.client.0.smithi070.stdout:1/378: dread d4/d6/f21 [0,4194304] 0 2024-09-20T20:31:40.880 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:40.881 INFO:tasks.workunit.client.0.smithi070.stdout:1/379: link d4/d6/d11/d63/c64 d4/d32/d60/c91 0 2024-09-20T20:31:40.883 INFO:tasks.workunit.client.0.smithi070.stdout:9/365: dread d1/df/f22 [0,4194304] 0 2024-09-20T20:31:40.883 INFO:tasks.workunit.client.0.smithi070.stdout:1/380: rename d4/d6/cf to d4/d6/c92 0 2024-09-20T20:31:40.884 INFO:tasks.workunit.client.0.smithi070.stdout:6/301: truncate d4/fe 1539091 0 2024-09-20T20:31:40.885 INFO:tasks.workunit.client.0.smithi070.stdout:7/249: dwrite d2/d19/d25/d2a/f3a [0,4194304] 0 2024-09-20T20:31:40.885 INFO:tasks.workunit.client.0.smithi070.stdout:9/366: rmdir d1/df/d18/d44/d77 39 2024-09-20T20:31:40.887 INFO:tasks.workunit.client.0.smithi070.stdout:7/250: write d2/d8/f16 [499183,12735] 0 2024-09-20T20:31:40.891 INFO:tasks.workunit.client.0.smithi070.stdout:1/381: link d4/d32/d34/d44/d48/f77 d4/d1f/d69/f93 0 2024-09-20T20:31:40.891 INFO:tasks.workunit.client.0.smithi070.stdout:7/251: link d2/c3e d2/d19/d25/d2a/c50 0 2024-09-20T20:31:40.892 INFO:tasks.workunit.client.0.smithi070.stdout:6/302: getdents d4/d8/d17 0 2024-09-20T20:31:40.895 INFO:tasks.workunit.client.0.smithi070.stdout:4/337: dread d6/d26/d34/d40/f56 [0,4194304] 0 2024-09-20T20:31:40.896 INFO:tasks.workunit.client.0.smithi070.stdout:7/252: creat d2/f51 x:0 0 0 2024-09-20T20:31:40.896 INFO:tasks.workunit.client.0.smithi070.stdout:5/357: dread d2/d4/de/f29 [0,4194304] 0 2024-09-20T20:31:40.897 INFO:tasks.workunit.client.0.smithi070.stdout:7/253: chown d2/d19/c48 3881783 1 2024-09-20T20:31:40.897 INFO:tasks.workunit.client.0.smithi070.stdout:1/382: dread d4/d6/d11/d2c/d3b/f3d [0,4194304] 0 2024-09-20T20:31:40.897 INFO:tasks.workunit.client.0.smithi070.stdout:4/338: mknod d6/c73 0 2024-09-20T20:31:40.897 INFO:tasks.workunit.client.0.smithi070.stdout:7/254: chown d2/d8/l11 50862482 1 2024-09-20T20:31:40.898 INFO:tasks.workunit.client.0.smithi070.stdout:9/367: dwrite d1/df/d18/d46/f73 [0,4194304] 0 2024-09-20T20:31:40.898 INFO:tasks.workunit.client.0.smithi070.stdout:4/339: mkdir d6/d5e/d6b/d74 0 2024-09-20T20:31:40.899 INFO:tasks.workunit.client.0.smithi070.stdout:7/255: mkdir d2/d52 0 2024-09-20T20:31:40.902 INFO:tasks.workunit.client.0.smithi070.stdout:7/256: fdatasync d2/d19/d25/d42/f4f 0 2024-09-20T20:31:40.903 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:40.904 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:40.904 INFO:tasks.workunit.client.0.smithi070.stdout:9/368: write d1/f1f [1878448,113163] 0 2024-09-20T20:31:40.905 INFO:tasks.workunit.client.0.smithi070.stdout:4/340: dwrite d6/d7/dc/d4a/d58/f6c [0,4194304] 0 2024-09-20T20:31:40.905 INFO:tasks.workunit.client.0.smithi070.stdout:9/369: chown d1/df/d18/d44/c4c 473 1 2024-09-20T20:31:40.906 INFO:tasks.workunit.client.0.smithi070.stdout:9/370: truncate d1/df/d38/f7c 1023730 0 2024-09-20T20:31:40.906 INFO:tasks.workunit.client.0.smithi070.stdout:9/371: fsync d1/df/f70 0 2024-09-20T20:31:40.907 INFO:tasks.workunit.client.0.smithi070.stdout:7/257: dread d2/f45 [0,4194304] 0 2024-09-20T20:31:40.908 INFO:tasks.workunit.client.0.smithi070.stdout:7/258: dread - d2/d30/f39 zero size 2024-09-20T20:31:40.911 INFO:tasks.workunit.client.0.smithi070.stdout:7/259: rmdir d2/d19/d25/d42 39 2024-09-20T20:31:40.914 INFO:tasks.workunit.client.0.smithi070.stdout:9/372: dwrite d1/df/d25/d69/f75 [0,4194304] 0 2024-09-20T20:31:40.916 INFO:tasks.workunit.client.0.smithi070.stdout:6/303: dread d4/fe [0,4194304] 0 2024-09-20T20:31:40.917 INFO:tasks.workunit.client.0.smithi070.stdout:6/304: chown d4/d8/d1e 1167265 1 2024-09-20T20:31:40.919 INFO:tasks.workunit.client.0.smithi070.stdout:6/305: chown d4/d8/d17/l4d 68030 1 2024-09-20T20:31:40.920 INFO:tasks.workunit.client.0.smithi070.stdout:6/306: symlink d4/d8/l6c 0 2024-09-20T20:31:40.921 INFO:tasks.workunit.client.0.smithi070.stdout:9/373: dwrite f0 [4194304,4194304] 0 2024-09-20T20:31:40.924 INFO:tasks.workunit.client.0.smithi070.stdout:1/383: dread d4/d6/d26/f39 [0,4194304] 0 2024-09-20T20:31:40.925 INFO:tasks.workunit.client.0.smithi070.stdout:1/384: fsync d4/d6/d11/d63/d6c/f85 0 2024-09-20T20:31:40.927 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:40.923+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:40.928 INFO:tasks.workunit.client.0.smithi070.stdout:6/307: dwrite d4/d8/d17/d33/d36/f53 [4194304,4194304] 0 2024-09-20T20:31:40.929 INFO:tasks.workunit.client.0.smithi070.stdout:9/374: dwrite d1/f7 [4194304,4194304] 0 2024-09-20T20:31:40.929 INFO:tasks.workunit.client.0.smithi070.stdout:6/308: unlink d4/d8/d1e/f32 0 2024-09-20T20:31:40.929 INFO:tasks.workunit.client.0.smithi070.stdout:9/375: mkdir d1/df/d25/d69/d85 0 2024-09-20T20:31:40.930 INFO:tasks.workunit.client.0.smithi070.stdout:1/385: dread d4/d6/f52 [0,4194304] 0 2024-09-20T20:31:40.931 INFO:tasks.workunit.client.0.smithi070.stdout:1/386: dread - d4/d6/f35 zero size 2024-09-20T20:31:40.932 INFO:tasks.workunit.client.0.smithi070.stdout:9/376: symlink d1/df/d18/d44/d77/l86 0 2024-09-20T20:31:40.932 INFO:tasks.workunit.client.0.smithi070.stdout:1/387: read - d4/d32/d34/d44/f55 zero size 2024-09-20T20:31:40.932 INFO:tasks.workunit.client.0.smithi070.stdout:6/309: creat d4/d8/d17/f6d x:0 0 0 2024-09-20T20:31:40.933 INFO:tasks.workunit.client.0.smithi070.stdout:6/310: chown d4/d8/l51 138430 1 2024-09-20T20:31:40.933 INFO:tasks.workunit.client.0.smithi070.stdout:4/341: dread d6/d7/dc/d4a/d58/f4f [4194304,4194304] 0 2024-09-20T20:31:40.933 INFO:tasks.workunit.client.0.smithi070.stdout:9/377: rename d1/df/d25/f4f to d1/df/d25/d69/d80/f87 0 2024-09-20T20:31:40.934 INFO:tasks.workunit.client.0.smithi070.stdout:6/311: creat d4/d8/d10/f6e x:0 0 0 2024-09-20T20:31:40.934 INFO:tasks.workunit.client.0.smithi070.stdout:9/378: write d1/df/d18/d46/f6b [860431,41623] 0 2024-09-20T20:31:40.935 INFO:tasks.workunit.client.0.smithi070.stdout:4/342: rename d6/d26/d34 to d6/d5e/d75 0 2024-09-20T20:31:40.935 INFO:tasks.workunit.client.0.smithi070.stdout:9/379: fsync d1/df/d18/d46/f7f 0 2024-09-20T20:31:40.935 INFO:tasks.workunit.client.0.smithi070.stdout:6/312: rename d4/fe to d4/d8/d10/f6f 0 2024-09-20T20:31:40.936 INFO:tasks.workunit.client.0.smithi070.stdout:1/388: dread d4/d6/d26/f39 [0,4194304] 0 2024-09-20T20:31:40.936 INFO:tasks.workunit.client.0.smithi070.stdout:4/343: truncate d6/d7/dc/d20/f55 670322 0 2024-09-20T20:31:40.936 INFO:tasks.workunit.client.0.smithi070.stdout:9/380: write d1/df/d18/d46/f6b [343433,93427] 0 2024-09-20T20:31:40.936 INFO:tasks.workunit.client.0.smithi070.stdout:6/313: symlink d4/d8/d10/d3c/l70 0 2024-09-20T20:31:40.937 INFO:tasks.workunit.client.0.smithi070.stdout:1/389: creat d4/d6/d11/d2c/d3b/f94 x:0 0 0 2024-09-20T20:31:40.937 INFO:tasks.workunit.client.0.smithi070.stdout:9/381: chown d1/df/d38 79102 1 2024-09-20T20:31:40.937 INFO:tasks.workunit.client.0.smithi070.stdout:1/390: readlink d4/d32/d60/l88 0 2024-09-20T20:31:40.937 INFO:tasks.workunit.client.0.smithi070.stdout:4/344: rename d6/d5e/d75/c39 to d6/d5e/d6b/c76 0 2024-09-20T20:31:40.938 INFO:tasks.workunit.client.0.smithi070.stdout:6/314: symlink d4/d8/d38/d50/l71 0 2024-09-20T20:31:40.938 INFO:tasks.workunit.client.0.smithi070.stdout:9/382: truncate d1/df/f70 507520 0 2024-09-20T20:31:40.938 INFO:tasks.workunit.client.0.smithi070.stdout:4/345: mkdir d6/d7/d77 0 2024-09-20T20:31:40.939 INFO:tasks.workunit.client.0.smithi070.stdout:1/391: getdents d4/d32/d34/d44/d4b 0 2024-09-20T20:31:40.939 INFO:tasks.workunit.client.0.smithi070.stdout:9/383: symlink d1/d76/l88 0 2024-09-20T20:31:40.939 INFO:tasks.workunit.client.0.smithi070.stdout:6/315: mkdir d4/d8/d10/d54/d55/d72 0 2024-09-20T20:31:40.939 INFO:tasks.workunit.client.0.smithi070.stdout:4/346: chown d6/d26/l5f 8509 1 2024-09-20T20:31:40.939 INFO:tasks.workunit.client.0.smithi070.stdout:9/384: write f0 [2274084,13273] 0 2024-09-20T20:31:40.940 INFO:tasks.workunit.client.0.smithi070.stdout:6/316: stat d4/d8/f1f 0 2024-09-20T20:31:40.940 INFO:tasks.workunit.client.0.smithi070.stdout:9/385: chown d1/df/c2b 2 1 2024-09-20T20:31:40.941 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:40.941 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:40.941 INFO:tasks.workunit.client.0.smithi070.stdout:6/317: mkdir d4/d8/d17/d33/d61/d73 0 2024-09-20T20:31:40.944 INFO:tasks.workunit.client.0.smithi070.stdout:4/347: dread d6/d5e/d75/d40/f56 [0,4194304] 0 2024-09-20T20:31:40.946 INFO:tasks.workunit.client.0.smithi070.stdout:1/392: dwrite d4/d6/d11/d2c/d3a/f68 [0,4194304] 0 2024-09-20T20:31:40.946 INFO:tasks.workunit.client.0.smithi070.stdout:4/348: read d6/d43/f5c [1149060,107359] 0 2024-09-20T20:31:40.948 INFO:tasks.workunit.client.0.smithi070.stdout:9/386: dwrite d1/df/d18/d44/d77/f7b [0,4194304] 0 2024-09-20T20:31:40.948 INFO:tasks.workunit.client.0.smithi070.stdout:4/349: getdents d6/d26 0 2024-09-20T20:31:40.948 INFO:tasks.workunit.client.0.smithi070.stdout:1/393: rename d4/d1f/f51 to d4/d6/d11/d7b/d83/f95 0 2024-09-20T20:31:40.949 INFO:tasks.workunit.client.0.smithi070.stdout:9/387: dread - d1/df/d18/d46/f78 zero size 2024-09-20T20:31:40.949 INFO:tasks.workunit.client.0.smithi070.stdout:4/350: fdatasync d6/d7/dc/f4d 0 2024-09-20T20:31:40.949 INFO:tasks.workunit.client.0.smithi070.stdout:1/394: write d4/d6/f29 [2957200,124617] 0 2024-09-20T20:31:40.950 INFO:tasks.workunit.client.0.smithi070.stdout:4/351: fsync d6/d5e/f33 0 2024-09-20T20:31:40.951 INFO:tasks.workunit.client.0.smithi070.stdout:1/395: write d4/d6/f47 [4737799,27177] 0 2024-09-20T20:31:40.951 INFO:tasks.workunit.client.0.smithi070.stdout:4/352: readlink d6/d7/dc/l1b 0 2024-09-20T20:31:40.951 INFO:tasks.workunit.client.0.smithi070.stdout:9/388: rmdir d1/d76/d79 0 2024-09-20T20:31:40.951 INFO:tasks.workunit.client.0.smithi070.stdout:4/353: write d6/d7/dc/f4b [545237,128143] 0 2024-09-20T20:31:40.952 INFO:tasks.workunit.client.0.smithi070.stdout:9/389: write d1/df/d25/d69/f6a [414216,49896] 0 2024-09-20T20:31:40.952 INFO:tasks.workunit.client.0.smithi070.stdout:4/354: chown d6/d5e/d75/f18 53 1 2024-09-20T20:31:40.952 INFO:tasks.workunit.client.0.smithi070.stdout:1/396: rename d4/d6/d26/f39 to d4/f96 0 2024-09-20T20:31:40.953 INFO:tasks.workunit.client.0.smithi070.stdout:1/397: creat d4/d6/d2f/f97 x:0 0 0 2024-09-20T20:31:40.956 INFO:tasks.workunit.client.0.smithi070.stdout:1/398: link d4/d6/d2f/f8c d4/d6/d11/d63/d6c/f98 0 2024-09-20T20:31:40.957 INFO:tasks.workunit.client.0.smithi070.stdout:1/399: write d4/d32/d34/d44/d48/f54 [364352,21484] 0 2024-09-20T20:31:40.957 INFO:tasks.workunit.client.0.smithi070.stdout:6/318: dread d4/d8/d17/d33/d36/f63 [0,4194304] 0 2024-09-20T20:31:40.957 INFO:tasks.workunit.client.0.smithi070.stdout:6/319: chown d4/d8/d17/d33/d36/f37 8039989 1 2024-09-20T20:31:40.958 INFO:tasks.workunit.client.0.smithi070.stdout:6/320: read d4/d8/f28 [2727920,26822] 0 2024-09-20T20:31:40.958 INFO:tasks.workunit.client.0.smithi070.stdout:6/321: symlink d4/d8/d17/d33/d36/l74 0 2024-09-20T20:31:40.959 INFO:tasks.workunit.client.0.smithi070.stdout:6/322: creat d4/d8/d3a/f75 x:0 0 0 2024-09-20T20:31:40.960 INFO:tasks.workunit.client.0.smithi070.stdout:6/323: creat d4/d8/d10/d54/f76 x:0 0 0 2024-09-20T20:31:40.962 INFO:tasks.workunit.client.0.smithi070.stdout:4/355: dread d6/d5e/f25 [0,4194304] 0 2024-09-20T20:31:40.963 INFO:tasks.workunit.client.0.smithi070.stdout:4/356: fsync d6/d7/dc/d20/f55 0 2024-09-20T20:31:40.965 INFO:tasks.workunit.client.0.smithi070.stdout:6/324: dwrite d4/f13 [0,4194304] 0 2024-09-20T20:31:40.966 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:40.967 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:40.982 INFO:tasks.workunit.client.0.smithi070.stdout:6/325: dread d4/d8/d38/f4e [0,4194304] 0 2024-09-20T20:31:40.984 INFO:tasks.workunit.client.0.smithi070.stdout:6/326: link d4/l2e d4/d8/d17/d33/d61/d73/l77 0 2024-09-20T20:31:40.985 INFO:tasks.workunit.client.0.smithi070.stdout:6/327: creat d4/f78 x:0 0 0 2024-09-20T20:31:40.985 INFO:tasks.workunit.client.0.smithi070.stdout:4/357: dread d6/d43/f5c [0,4194304] 0 2024-09-20T20:31:40.992 INFO:tasks.workunit.client.0.smithi070.stdout:6/328: dread d4/d8/d38/f4e [4194304,4194304] 0 2024-09-20T20:31:40.997 INFO:tasks.workunit.client.0.smithi070.stdout:6/329: dwrite d4/d8/d38/f4e [8388608,4194304] 0 2024-09-20T20:31:40.998 INFO:tasks.workunit.client.0.smithi070.stdout:6/330: truncate d4/d8/d1e/f26 269929 0 2024-09-20T20:31:40.999 INFO:tasks.workunit.client.0.smithi070.stdout:6/331: creat d4/d8/d10/d54/d55/d72/f79 x:0 0 0 2024-09-20T20:31:41.006 INFO:tasks.workunit.client.0.smithi070.stdout:4/358: dread d6/d26/d69/d71/f5b [0,4194304] 0 2024-09-20T20:31:41.007 INFO:tasks.workunit.client.0.smithi070.stdout:4/359: write d6/d26/d69/d71/f6d [23160,86406] 0 2024-09-20T20:31:41.008 INFO:tasks.workunit.client.0.smithi070.stdout:4/360: mkdir d6/d5e/d51/d78 0 2024-09-20T20:31:41.009 INFO:tasks.workunit.client.0.smithi070.stdout:4/361: truncate d6/d43/f47 2192397 0 2024-09-20T20:31:41.009 INFO:tasks.workunit.client.0.smithi070.stdout:4/362: stat d6/d7/l49 0 2024-09-20T20:31:41.010 INFO:tasks.workunit.client.0.smithi070.stdout:4/363: creat d6/d26/d69/d71/f79 x:0 0 0 2024-09-20T20:31:41.010 INFO:tasks.workunit.client.0.smithi070.stdout:4/364: fdatasync d6/d26/f27 0 2024-09-20T20:31:41.010 INFO:tasks.workunit.client.0.smithi070.stdout:4/365: stat d6/d7/dc/f4b 0 2024-09-20T20:31:41.016 INFO:tasks.workunit.client.0.smithi070.stdout:4/366: dwrite d6/d5e/d75/d40/f56 [0,4194304] 0 2024-09-20T20:31:41.017 INFO:tasks.workunit.client.0.smithi070.stdout:6/332: dread d4/d8/d3a/f66 [0,4194304] 0 2024-09-20T20:31:41.017 INFO:tasks.workunit.client.0.smithi070.stdout:6/333: rmdir d4/d8 39 2024-09-20T20:31:41.018 INFO:tasks.workunit.client.0.smithi070.stdout:4/367: mknod d6/d43/c7a 0 2024-09-20T20:31:41.018 INFO:tasks.workunit.client.0.smithi070.stdout:6/334: stat d4/d8/d10/d54/d64 0 2024-09-20T20:31:41.020 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:41.020 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:41.020 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:41.020 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:41.021 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:41.021 INFO:tasks.workunit.client.0.smithi070.stdout:4/368: getdents d6 0 2024-09-20T20:31:41.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/335: mkdir d4/d8/d10/d54/d7a 0 2024-09-20T20:31:41.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/336: readlink d4/d8/d38/d50/l71 0 2024-09-20T20:31:41.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/337: symlink d4/d8/d1e/l7b 0 2024-09-20T20:31:41.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/338: creat d4/d8/d1e/f7c x:0 0 0 2024-09-20T20:31:41.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/339: read d4/d8/f1f [731982,124456] 0 2024-09-20T20:31:41.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/340: link d4/d8/d1e/f5b d4/d8/d38/f7d 0 2024-09-20T20:31:41.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/341: mkdir d4/d8/d1e/d7e 0 2024-09-20T20:31:41.023 INFO:tasks.workunit.client.0.smithi070.stdout:6/342: mknod d4/d8/d10/d54/c7f 0 2024-09-20T20:31:41.024 INFO:tasks.workunit.client.0.smithi070.stdout:6/343: symlink d4/d8/d10/d3c/l80 0 2024-09-20T20:31:41.024 INFO:tasks.workunit.client.0.smithi070.stdout:6/344: dread - d4/d8/d38/f7d zero size 2024-09-20T20:31:41.025 INFO:tasks.workunit.client.0.smithi070.stdout:6/345: chown d4/d8/d17/f49 1767414 1 2024-09-20T20:31:41.026 INFO:tasks.workunit.client.0.smithi070.stdout:4/369: dwrite d6/d7/dc/d4a/d58/f6c [0,4194304] 0 2024-09-20T20:31:41.026 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:41.021+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:41.027 INFO:tasks.workunit.client.0.smithi070.stdout:6/346: dread d4/d8/d10/f2d [0,4194304] 0 2024-09-20T20:31:41.028 INFO:tasks.workunit.client.0.smithi070.stdout:3/316: sync 2024-09-20T20:31:41.028 INFO:tasks.workunit.client.0.smithi070.stdout:8/363: sync 2024-09-20T20:31:41.028 INFO:tasks.workunit.client.0.smithi070.stdout:3/317: rename d7/d15/d1a to d7/d15/d1a/d4a/d5e 22 2024-09-20T20:31:41.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/318: fsync d7/d15/d1e/f2f 0 2024-09-20T20:31:41.029 INFO:tasks.workunit.client.0.smithi070.stdout:8/364: link d4/d27/d2a/f20 d4/db/d66/f84 0 2024-09-20T20:31:41.030 INFO:tasks.workunit.client.0.smithi070.stdout:8/365: readlink d4/d27/d2a/d3e/d39/l3b 0 2024-09-20T20:31:41.030 INFO:tasks.workunit.client.0.smithi070.stdout:3/319: chown d7/d8/d13/d1d/c22 821393 1 2024-09-20T20:31:41.030 INFO:tasks.workunit.client.0.smithi070.stdout:8/366: write d4/d27/d2a/f6f [540636,114497] 0 2024-09-20T20:31:41.035 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:41.037 INFO:tasks.workunit.client.0.smithi070.stdout:6/347: truncate d4/d8/d38/f7d 559375 0 2024-09-20T20:31:41.037 INFO:tasks.workunit.client.0.smithi070.stdout:6/348: write d4/d8/d1e/f7c [245756,2865] 0 2024-09-20T20:31:41.039 INFO:tasks.workunit.client.0.smithi070.stdout:6/349: rmdir d4/d8/d10/d54 39 2024-09-20T20:31:41.039 INFO:tasks.workunit.client.0.smithi070.stdout:6/350: symlink d4/d8/d1e/l81 0 2024-09-20T20:31:41.040 INFO:tasks.workunit.client.0.smithi070.stdout:4/370: dwrite d6/f6f [4194304,4194304] 0 2024-09-20T20:31:41.041 INFO:tasks.workunit.client.0.smithi070.stdout:6/351: dread - d4/d8/d17/f6d zero size 2024-09-20T20:31:41.041 INFO:tasks.workunit.client.0.smithi070.stdout:8/367: dwrite d4/db/f4a [0,4194304] 0 2024-09-20T20:31:41.041 INFO:tasks.workunit.client.0.smithi070.stdout:4/371: read d6/d7/dc/d4a/d58/f6c [3575894,109493] 0 2024-09-20T20:31:41.042 INFO:tasks.workunit.client.0.smithi070.stdout:4/372: chown d6/d5e/l31 440397 1 2024-09-20T20:31:41.043 INFO:tasks.workunit.client.0.smithi070.stdout:8/368: creat d4/d27/d2a/d5b/f85 x:0 0 0 2024-09-20T20:31:41.044 INFO:tasks.workunit.client.0.smithi070.stdout:6/352: write d4/d8/d10/f15 [2438423,19437] 0 2024-09-20T20:31:41.044 INFO:tasks.workunit.client.0.smithi070.stdout:4/373: write d6/d7/dc/fe [3065267,79224] 0 2024-09-20T20:31:41.045 INFO:tasks.workunit.client.0.smithi070.stdout:3/320: dread d7/d15/d1e/f2f [4194304,4194304] 0 2024-09-20T20:31:41.046 INFO:tasks.workunit.client.0.smithi070.stdout:4/374: symlink d6/d5e/d6b/d74/l7b 0 2024-09-20T20:31:41.046 INFO:tasks.workunit.client.0.smithi070.stdout:3/321: fsync f4 0 2024-09-20T20:31:41.046 INFO:tasks.workunit.client.0.smithi070.stdout:8/369: write d4/d27/f36 [706369,23844] 0 2024-09-20T20:31:41.047 INFO:tasks.workunit.client.0.smithi070.stdout:3/322: mknod d7/c5f 0 2024-09-20T20:31:41.047 INFO:tasks.workunit.client.0.smithi070.stdout:3/323: write d7/d15/f4f [646094,117995] 0 2024-09-20T20:31:41.048 INFO:tasks.workunit.client.0.smithi070.stdout:3/324: rmdir d7 39 2024-09-20T20:31:41.049 INFO:tasks.workunit.client.0.smithi070.stdout:3/325: rename d7/d15/d1a/d4a/d54 to d7/d15/d1e/d60 0 2024-09-20T20:31:41.050 INFO:tasks.workunit.client.0.smithi070.stdout:3/326: rmdir d7/d15/d1a 39 2024-09-20T20:31:41.051 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:31:41.051 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:31:41.051 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:31:41.051 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:31:41.051 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:31:41.051 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:31:41.051 INFO:teuthology.orchestra.run.smithi070.stdout:oload 1000 2024-09-20T20:31:41.052 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 0.05 2024-09-20T20:31:41.052 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:31:41.052 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0011 2024-09-20T20:31:41.052 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0108 2024-09-20T20:31:41.052 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:31:41.052 INFO:tasks.workunit.client.0.smithi070.stdout:3/327: symlink d7/d15/d1a/d4a/d51/d5b/l61 0 2024-09-20T20:31:41.053 INFO:tasks.workunit.client.0.smithi070.stdout:3/328: readlink d7/d8/d13/d1d/l35 0 2024-09-20T20:31:41.054 INFO:tasks.workunit.client.0.smithi070.stdout:3/329: mknod d7/d15/d1a/d4a/d51/d5b/c62 0 2024-09-20T20:31:41.054 INFO:tasks.workunit.client.0.smithi070.stdout:3/330: chown d7/d8/d13/f2e 53 1 2024-09-20T20:31:41.055 INFO:tasks.workunit.client.0.smithi070.stdout:3/331: unlink d7/d8/d13/d1d/c21 0 2024-09-20T20:31:41.056 INFO:tasks.workunit.client.0.smithi070.stdout:3/332: mknod d7/d15/d1a/d48/d57/c63 0 2024-09-20T20:31:41.056 INFO:tasks.workunit.client.0.smithi070.stdout:3/333: write d7/f14 [147119,75428] 0 2024-09-20T20:31:41.059 INFO:tasks.workunit.client.0.smithi070.stdout:2/344: sync 2024-09-20T20:31:41.060 INFO:tasks.workunit.client.0.smithi070.stdout:6/353: dread d4/d8/d10/f14 [0,4194304] 0 2024-09-20T20:31:41.062 INFO:tasks.workunit.client.0.smithi070.stdout:2/345: link d3/de/d12/d1a/f21 d3/de/d12/f82 0 2024-09-20T20:31:41.062 INFO:tasks.workunit.client.0.smithi070.stdout:6/354: mknod d4/d8/d17/d33/d61/d73/c82 0 2024-09-20T20:31:41.063 INFO:tasks.workunit.client.0.smithi070.stdout:2/346: creat d3/d5/dd/d5a/f83 x:0 0 0 2024-09-20T20:31:41.064 INFO:tasks.workunit.client.0.smithi070.stdout:2/347: fdatasync d3/d5/d9/d42/f59 0 2024-09-20T20:31:41.064 INFO:tasks.workunit.client.0.smithi070.stdout:8/370: dwrite d4/d27/d2a/f20 [0,4194304] 0 2024-09-20T20:31:41.064 INFO:tasks.workunit.client.0.smithi070.stdout:4/375: dwrite d6/d43/f47 [0,4194304] 0 2024-09-20T20:31:41.065 INFO:tasks.workunit.client.0.smithi070.stdout:8/371: stat d4/d27/d2a/d3e 0 2024-09-20T20:31:41.065 INFO:tasks.workunit.client.0.smithi070.stdout:2/348: rmdir d3/de/d12 39 2024-09-20T20:31:41.065 INFO:tasks.workunit.client.0.smithi070.stdout:4/376: mknod d6/d5e/d6b/c7c 0 2024-09-20T20:31:41.066 INFO:tasks.workunit.client.0.smithi070.stdout:2/349: dread - d3/d5/d9/d1c/d1f/f73 zero size 2024-09-20T20:31:41.066 INFO:tasks.workunit.client.0.smithi070.stdout:8/372: write d4/d27/d2a/d43/f45 [3226151,26185] 0 2024-09-20T20:31:41.067 INFO:tasks.workunit.client.0.smithi070.stdout:4/377: creat d6/d26/d69/f7d x:0 0 0 2024-09-20T20:31:41.067 INFO:tasks.workunit.client.0.smithi070.stdout:4/378: stat d6/d26/f27 0 2024-09-20T20:31:41.068 INFO:tasks.workunit.client.0.smithi070.stdout:4/379: fdatasync d6/d7/dc/fe 0 2024-09-20T20:31:41.068 INFO:tasks.workunit.client.0.smithi070.stdout:2/350: rename d3/d5/dd/d5a/f83 to d3/d5/d9/d1c/d47/d7e/f84 0 2024-09-20T20:31:41.068 INFO:tasks.workunit.client.0.smithi070.stdout:8/373: mknod d4/d27/d2a/d7e/c86 0 2024-09-20T20:31:41.069 INFO:tasks.workunit.client.0.smithi070.stdout:3/334: dread d7/d15/f18 [0,4194304] 0 2024-09-20T20:31:41.069 INFO:tasks.workunit.client.0.smithi070.stdout:8/374: write d4/db/f1b [2188015,45506] 0 2024-09-20T20:31:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:2/351: write d3/d5/dd/f63 [925879,18619] 0 2024-09-20T20:31:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:2/352: readlink d3/d5/d9/d42/l68 0 2024-09-20T20:31:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:2/353: mkdir d3/d5/d9/d1c/d47/d85 0 2024-09-20T20:31:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:2/354: unlink d3/d5/d9/d79/f80 0 2024-09-20T20:31:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:4/380: dwrite d6/d5e/f70 [0,4194304] 0 2024-09-20T20:31:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:4/381: write d6/d43/d5a/f68 [2776188,67519] 0 2024-09-20T20:31:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:2/355: unlink d3/d5/d9/d1c/d1f/f73 0 2024-09-20T20:31:41.076 INFO:tasks.workunit.client.0.smithi070.stdout:4/382: readlink d6/d7/dc/l5d 0 2024-09-20T20:31:41.076 INFO:tasks.workunit.client.0.smithi070.stdout:8/375: dwrite d4/d27/d2a/f21 [0,4194304] 0 2024-09-20T20:31:41.080 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-20T20:31:41.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-20T20:31:41.084 INFO:tasks.workunit.client.0.smithi070.stdout:8/376: dwrite d4/d27/d2a/d3e/d31/f3f [0,4194304] 0 2024-09-20T20:31:41.085 INFO:tasks.workunit.client.0.smithi070.stdout:8/377: mkdir d4/d27/d73/d87 0 2024-09-20T20:31:41.087 INFO:tasks.workunit.client.0.smithi070.stdout:4/383: write d6/d7/dc/f4d [666252,30280] 0 2024-09-20T20:31:41.088 INFO:tasks.workunit.client.0.smithi070.stdout:4/384: creat d6/d26/d69/d71/f7e x:0 0 0 2024-09-20T20:31:41.088 INFO:tasks.workunit.client.0.smithi070.stdout:4/385: rmdir d6/d7 39 2024-09-20T20:31:41.089 INFO:tasks.workunit.client.0.smithi070.stdout:4/386: fsync d6/d5e/d75/f18 0 2024-09-20T20:31:41.090 INFO:tasks.workunit.client.0.smithi070.stdout:8/378: dwrite d4/db/d66/f84 [0,4194304] 0 2024-09-20T20:31:41.090 INFO:tasks.workunit.client.0.smithi070.stdout:4/387: dread - d6/d26/d69/f7d zero size 2024-09-20T20:31:41.091 INFO:tasks.workunit.client.0.smithi070.stdout:4/388: rmdir d6/d5e/d6b/d74 39 2024-09-20T20:31:41.092 INFO:tasks.workunit.client.0.smithi070.stdout:4/389: mknod d6/d7/dc/d4a/c7f 0 2024-09-20T20:31:41.092 INFO:tasks.workunit.client.0.smithi070.stdout:4/390: write d6/d7/f3e [986017,82608] 0 2024-09-20T20:31:41.093 INFO:tasks.workunit.client.0.smithi070.stdout:4/391: mknod d6/d26/d69/d71/c80 0 2024-09-20T20:31:41.096 INFO:tasks.workunit.client.0.smithi070.stdout:8/379: dwrite d4/db/f32 [0,4194304] 0 2024-09-20T20:31:41.097 INFO:tasks.workunit.client.0.smithi070.stdout:4/392: dread d6/d5e/f70 [0,4194304] 0 2024-09-20T20:31:41.100 INFO:tasks.workunit.client.0.smithi070.stdout:4/393: unlink d6/d7/dc/d4a/d58/f4f 0 2024-09-20T20:31:41.101 INFO:tasks.workunit.client.0.smithi070.stdout:4/394: rmdir d6/d26 39 2024-09-20T20:31:41.101 INFO:tasks.workunit.client.0.smithi070.stdout:8/380: dwrite d4/d27/f36 [0,4194304] 0 2024-09-20T20:31:41.101 INFO:tasks.workunit.client.0.smithi070.stdout:4/395: mkdir d6/d7/dc/d4a/d81 0 2024-09-20T20:31:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:8/381: link d4/db/l22 d4/d27/d42/l88 0 2024-09-20T20:31:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:8/382: unlink d4/db/l22 0 2024-09-20T20:31:41.107 INFO:tasks.workunit.client.0.smithi070.stdout:8/383: truncate d4/d27/d2a/d3e/d39/f51 1077509 0 2024-09-20T20:31:41.113 INFO:tasks.workunit.client.0.smithi070.stdout:8/384: dwrite d4/d27/d2a/d43/d61/f62 [0,4194304] 0 2024-09-20T20:31:41.115 INFO:tasks.workunit.client.0.smithi070.stdout:8/385: unlink d4/f7 0 2024-09-20T20:31:41.121 INFO:tasks.workunit.client.0.smithi070.stdout:4/396: dread d6/d43/d5a/f68 [0,4194304] 0 2024-09-20T20:31:41.122 INFO:tasks.workunit.client.0.smithi070.stdout:4/397: symlink d6/d7/d77/l82 0 2024-09-20T20:31:41.127 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:41.119+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:41.132 INFO:tasks.workunit.client.0.smithi070.stdout:8/386: rename d4/d27/d42/c60 to d4/d27/d2a/c89 0 2024-09-20T20:31:41.135 INFO:tasks.workunit.client.0.smithi070.stdout:4/398: read d6/d7/dc/f52 [4689451,11843] 0 2024-09-20T20:31:41.136 INFO:tasks.workunit.client.0.smithi070.stdout:4/399: chown d6/d5e/d75/d61 22147919 1 2024-09-20T20:31:41.149 INFO:tasks.workunit.client.0.smithi070.stdout:8/387: dread d4/d27/d2a/d3e/d31/f52 [0,4194304] 0 2024-09-20T20:31:41.150 INFO:tasks.workunit.client.0.smithi070.stdout:8/388: fdatasync d4/d27/d2a/d5b/f85 0 2024-09-20T20:31:41.151 INFO:tasks.workunit.client.0.smithi070.stdout:4/400: dread d6/d26/f27 [4194304,4194304] 0 2024-09-20T20:31:41.152 INFO:tasks.workunit.client.0.smithi070.stdout:4/401: chown d6/d5e/d75/d61 222 1 2024-09-20T20:31:41.153 INFO:tasks.workunit.client.0.smithi070.stdout:4/402: write d6/d26/d69/d71/f79 [580777,50683] 0 2024-09-20T20:31:41.154 INFO:tasks.workunit.client.0.smithi070.stdout:2/356: dread d3/d5/dd/ff [12582912,4194304] 0 2024-09-20T20:31:41.155 INFO:tasks.workunit.client.0.smithi070.stdout:2/357: chown d3/d5/d9/d79/f7b 6 1 2024-09-20T20:31:41.155 INFO:tasks.workunit.client.0.smithi070.stdout:2/358: readlink d3/d5/d9/d42/l50 0 2024-09-20T20:31:41.156 INFO:tasks.workunit.client.0.smithi070.stdout:8/389: dwrite d4/d27/d2a/f21 [4194304,4194304] 0 2024-09-20T20:31:41.157 INFO:tasks.workunit.client.0.smithi070.stdout:2/359: mkdir d3/d4c/d5c/d86 0 2024-09-20T20:31:41.158 INFO:tasks.workunit.client.0.smithi070.stdout:2/360: stat d3/d5/d9/f48 0 2024-09-20T20:31:41.160 INFO:tasks.workunit.client.0.smithi070.stdout:4/403: dwrite d6/ff [0,4194304] 0 2024-09-20T20:31:41.160 INFO:tasks.workunit.client.0.smithi070.stdout:6/355: dread d4/d8/d17/f31 [4194304,4194304] 0 2024-09-20T20:31:41.161 INFO:tasks.workunit.client.0.smithi070.stdout:8/390: truncate d4/d27/d2a/f6f 338278 0 2024-09-20T20:31:41.163 INFO:tasks.workunit.client.0.smithi070.stdout:4/404: dread d6/d5e/d75/f21 [0,4194304] 0 2024-09-20T20:31:41.165 INFO:tasks.workunit.client.0.smithi070.stdout:4/405: symlink d6/d5e/d75/l83 0 2024-09-20T20:31:41.166 INFO:tasks.workunit.client.0.smithi070.stdout:8/391: dread d4/d27/d2a/f21 [0,4194304] 0 2024-09-20T20:31:41.167 INFO:tasks.workunit.client.0.smithi070.stdout:8/392: mkdir d4/d27/d73/d87/d8a 0 2024-09-20T20:31:41.171 INFO:tasks.workunit.client.0.smithi070.stdout:2/361: dread d3/f75 [4194304,4194304] 0 2024-09-20T20:31:41.172 INFO:tasks.workunit.client.0.smithi070.stdout:8/393: dwrite d4/db/f32 [0,4194304] 0 2024-09-20T20:31:41.173 INFO:tasks.workunit.client.0.smithi070.stdout:0/374: sync 2024-09-20T20:31:41.174 INFO:tasks.workunit.client.0.smithi070.stdout:0/375: creat d4/d48/f72 x:0 0 0 2024-09-20T20:31:41.175 INFO:tasks.workunit.client.0.smithi070.stdout:0/376: write d4/d8/d12/d23/d26/f51 [241700,77708] 0 2024-09-20T20:31:41.177 INFO:tasks.workunit.client.0.smithi070.stdout:0/377: creat d4/d8/d12/d23/f73 x:0 0 0 2024-09-20T20:31:41.178 INFO:tasks.workunit.client.0.smithi070.stdout:2/362: write d3/de/d12/f82 [1119843,67015] 0 2024-09-20T20:31:41.178 INFO:tasks.workunit.client.0.smithi070.stdout:0/378: dread - d4/d8/f69 zero size 2024-09-20T20:31:41.179 INFO:tasks.workunit.client.0.smithi070.stdout:2/363: symlink d3/d5/d9/d42/l87 0 2024-09-20T20:31:41.179 INFO:tasks.workunit.client.0.smithi070.stdout:2/364: fsync d3/d5/d9/d79/f7f 0 2024-09-20T20:31:41.181 INFO:tasks.workunit.client.0.smithi070.stdout:8/394: dwrite d4/db/d66/f81 [0,4194304] 0 2024-09-20T20:31:41.181 INFO:tasks.workunit.client.0.smithi070.stdout:8/395: stat d4/l4e 0 2024-09-20T20:31:41.182 INFO:tasks.workunit.client.0.smithi070.stdout:8/396: symlink d4/db/d64/d7b/l8b 0 2024-09-20T20:31:41.186 INFO:tasks.workunit.client.0.smithi070.stdout:6/356: dread d4/d8/d10/f2b [0,4194304] 0 2024-09-20T20:31:41.187 INFO:tasks.workunit.client.0.smithi070.stdout:6/357: mknod d4/d8/d17/d33/d36/c83 0 2024-09-20T20:31:41.188 INFO:tasks.workunit.client.0.smithi070.stdout:0/379: rename d4/d19/f3f to d4/d8/d12/d23/d26/d1d/d37/d38/f74 0 2024-09-20T20:31:41.189 INFO:tasks.workunit.client.0.smithi070.stdout:0/380: creat d4/d8/d12/d43/f75 x:0 0 0 2024-09-20T20:31:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:8/397: truncate d4/db/f16 5200733 0 2024-09-20T20:31:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:2/365: write d3/d5/d9/d10/f13 [3729055,81548] 0 2024-09-20T20:31:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:0/381: creat d4/d13/f76 x:0 0 0 2024-09-20T20:31:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:8/398: creat d4/db/d64/f8c x:0 0 0 2024-09-20T20:31:41.191 INFO:tasks.workunit.client.0.smithi070.stdout:0/382: mknod d4/d13/c77 0 2024-09-20T20:31:41.192 INFO:tasks.workunit.client.0.smithi070.stdout:2/366: write d3/d5/d9/d1c/d1f/f5e [1007621,15277] 0 2024-09-20T20:31:41.192 INFO:tasks.workunit.client.0.smithi070.stdout:8/399: chown d4/d27/d2a/d3e 4 1 2024-09-20T20:31:41.192 INFO:tasks.workunit.client.0.smithi070.stdout:0/383: chown d4/d8/d12/d43 2298993 1 2024-09-20T20:31:41.193 INFO:tasks.workunit.client.0.smithi070.stdout:8/400: mkdir d4/db/d66/d8d 0 2024-09-20T20:31:41.193 INFO:tasks.workunit.client.0.smithi070.stdout:2/367: creat d3/d5/d9/f88 x:0 0 0 2024-09-20T20:31:41.194 INFO:tasks.workunit.client.0.smithi070.stdout:0/384: chown d4/d8/d12/d23/d26/d1d/c39 1 1 2024-09-20T20:31:41.194 INFO:tasks.workunit.client.0.smithi070.stdout:6/358: dwrite d4/d8/d1e/f5f [0,4194304] 0 2024-09-20T20:31:41.194 INFO:tasks.workunit.client.0.smithi070.stdout:2/368: dread - d3/d5/d9/d10/f52 zero size 2024-09-20T20:31:41.195 INFO:tasks.workunit.client.0.smithi070.stdout:6/359: read d4/d8/f1f [424131,55553] 0 2024-09-20T20:31:41.196 INFO:tasks.workunit.client.0.smithi070.stdout:2/369: creat d3/d5/dd/f89 x:0 0 0 2024-09-20T20:31:41.196 INFO:tasks.workunit.client.0.smithi070.stdout:0/385: rename d4/d8/d12/d43/d3b/c46 to d4/d1b/c78 0 2024-09-20T20:31:41.197 INFO:tasks.workunit.client.0.smithi070.stdout:2/370: mknod d3/d5/dd/d5a/c8a 0 2024-09-20T20:31:41.197 INFO:tasks.workunit.client.0.smithi070.stdout:0/386: getdents d4/d8/d12/d23 0 2024-09-20T20:31:41.198 INFO:tasks.workunit.client.0.smithi070.stdout:2/371: rmdir d3/d5/dd 39 2024-09-20T20:31:41.198 INFO:tasks.workunit.client.0.smithi070.stdout:0/387: write d4/d48/f72 [608151,102045] 0 2024-09-20T20:31:41.199 INFO:tasks.workunit.client.0.smithi070.stdout:6/360: dread d4/d8/d17/f31 [4194304,4194304] 0 2024-09-20T20:31:41.199 INFO:tasks.workunit.client.0.smithi070.stdout:0/388: write d4/d8/d12/d23/d26/d1d/d37/d38/f74 [887967,52098] 0 2024-09-20T20:31:41.201 INFO:tasks.workunit.client.0.smithi070.stdout:0/389: mknod d4/d48/d4e/c79 0 2024-09-20T20:31:41.201 INFO:tasks.workunit.client.0.smithi070.stdout:6/361: getdents d4/d8/d17/d33/d36 0 2024-09-20T20:31:41.202 INFO:tasks.workunit.client.0.smithi070.stdout:6/362: creat d4/d8/d10/d54/d64/f84 x:0 0 0 2024-09-20T20:31:41.203 INFO:tasks.workunit.client.0.smithi070.stdout:2/372: dread d3/d5/d9/d1c/d1f/f5e [0,4194304] 0 2024-09-20T20:31:41.204 INFO:tasks.workunit.client.0.smithi070.stdout:6/363: unlink d4/d8/d17/d33/f46 0 2024-09-20T20:31:41.204 INFO:tasks.workunit.client.0.smithi070.stdout:6/364: readlink d4/d8/d17/l21 0 2024-09-20T20:31:41.205 INFO:tasks.workunit.client.0.smithi070.stdout:8/401: dwrite d4/db/f16 [0,4194304] 0 2024-09-20T20:31:41.205 INFO:tasks.workunit.client.0.smithi070.stdout:2/373: mknod d3/d5/d9/d1c/c8b 0 2024-09-20T20:31:41.207 INFO:tasks.workunit.client.0.smithi070.stdout:0/390: dwrite d4/d13/f68 [0,4194304] 0 2024-09-20T20:31:41.208 INFO:tasks.workunit.client.0.smithi070.stdout:6/365: write d4/d8/d10/d3c/f5e [4679246,22773] 0 2024-09-20T20:31:41.208 INFO:tasks.workunit.client.0.smithi070.stdout:2/374: creat d3/d5/d9/d1c/f8c x:0 0 0 2024-09-20T20:31:41.209 INFO:tasks.workunit.client.0.smithi070.stdout:6/366: truncate d4/f78 931999 0 2024-09-20T20:31:41.209 INFO:tasks.workunit.client.0.smithi070.stdout:2/375: fsync d3/d5/d9/f48 0 2024-09-20T20:31:41.209 INFO:tasks.workunit.client.0.smithi070.stdout:0/391: rename d4/d1b/d4b to d4/d8/d12/d23/d26/d1d/d37/d38/d7a 0 2024-09-20T20:31:41.211 INFO:tasks.workunit.client.0.smithi070.stdout:6/367: readlink d4/l2e 0 2024-09-20T20:31:41.211 INFO:tasks.workunit.client.0.smithi070.stdout:2/376: creat d3/de/d12/f8d x:0 0 0 2024-09-20T20:31:41.211 INFO:tasks.workunit.client.0.smithi070.stdout:2/377: fsync d3/de/f6d 0 2024-09-20T20:31:41.216 INFO:tasks.workunit.client.0.smithi070.stdout:6/368: dwrite d4/d8/f2f [0,4194304] 0 2024-09-20T20:31:41.217 INFO:tasks.workunit.client.0.smithi070.stdout:2/378: dwrite d3/d5/f34 [0,4194304] 0 2024-09-20T20:31:41.218 INFO:tasks.workunit.client.0.smithi070.stdout:8/402: dread d4/d27/d2a/d75/f77 [0,4194304] 0 2024-09-20T20:31:41.219 INFO:tasks.workunit.client.0.smithi070.stdout:2/379: unlink d3/lc 0 2024-09-20T20:31:41.220 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:41.220 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:41.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:41.220 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:41.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.220 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:373 3.2 3:4272d415:::200.0000000b:head [write 778889~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.220 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:41.220 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2632902059999997, 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105808761, 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:41.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953113+0000", 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5999999999999999e-06 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953122+0000", 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0729999999999994e-06 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953145+0000", 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3312999999999999e-05 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953162+0000", 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6402999999999999e-05 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054491+0000", 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10132910000000001 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054636+0000", 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014555699999999999 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054826+0000", 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019007299999999999 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058425+0000", 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035988589999999998 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058640+0000", 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021432800000000001 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058775+0000", 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013597500000000001 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058920+0000", 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014448 2024-09-20T20:31:41.225 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:374 3.2 3:4272d415:::200.0000000b:head [write 780291~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2624733099999998, 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.106652574, 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953930+0000", 2024-09-20T20:31:41.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1900000000000002e-06 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953942+0000", 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1355999999999999e-05 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953968+0000", 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6380000000000002e-05 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953983+0000", 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4686e-05 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055691+0000", 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101707783 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055801+0000", 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110568 2024-09-20T20:31:41.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055978+0000", 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000177119 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058598+0000", 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002620196 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060327+0000", 2024-09-20T20:31:41.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017290210000000001 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060476+0000", 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000148527 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060581+0000", 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010474799999999999 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:375 3.2 3:4272d415:::200.0000000b:head [write 781692~2432 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2606282100000001, 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.106557868, 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955776+0000", 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4569999999999999e-06 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955790+0000", 2024-09-20T20:31:41.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4532000000000001e-05 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955845+0000", 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4401999999999999e-05 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955887+0000", 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2648999999999998e-05 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056678+0000", 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100791148 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056801+0000", 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012273399999999999 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056976+0000", 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017484299999999999 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062015+0000", 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050385459999999996 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062053+0000", 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8569000000000003e-05 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062221+0000", 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016815299999999999 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062331+0000", 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010983499999999999 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:376 3.2 3:4272d415:::200.0000000b:head [write 784124~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2603166970000004, 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.108173241, 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.237 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956087+0000", 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0870000000000001e-06 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956116+0000", 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9042000000000001e-05 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956142+0000", 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6452999999999999e-05 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956155+0000", 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2306e-05 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059009+0000", 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10285475199999999 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059206+0000", 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019710300000000001 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059539+0000", 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033236600000000001 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062493+0000", 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029542629999999999 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.063998+0000", 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001504921 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064139+0000", 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000141347 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064258+0000", 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000118601 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:377 3.2 3:4272d415:::200.0000000b:head [write 785531~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2597608559999998, 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.109408697, 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956643+0000", 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1299999999999999e-06 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956654+0000", 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.115e-05 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956681+0000", 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6726000000000001e-05 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956695+0000", 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4893e-05 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060694+0000", 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103998043 2024-09-20T20:31:41.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060878+0000", 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018448499999999999 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.061167+0000", 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000289194 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065734+0000", 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045670190000000003 2024-09-20T20:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065780+0000", 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5658999999999998e-05 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065933+0000", 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015302 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066049+0000", 2024-09-20T20:31:41.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116378 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:378 3.2 3:4272d415:::200.0000000b:head [write 786941~2442 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2596556110000003, 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.111232968, 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956747+0000", 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7999999999999993e-07 2024-09-20T20:31:41.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956760+0000", 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3696000000000001e-05 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956774+0000", 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3266e-05 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956783+0000", 2024-09-20T20:31:41.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8899999999999996e-06 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062642+0000", 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10585894999999999 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062863+0000", 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022100200000000001 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.063215+0000", 2024-09-20T20:31:41.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035195000000000002 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066222+0000", 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003007904 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067697+0000", 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014745629999999999 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067866+0000", 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000168849 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067979+0000", 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011291800000000001 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:379 3.2 3:4272d415:::200.0000000b:head [write 789383~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.253 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2593775779999996, 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11286650500000001, 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957025+0000", 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.33e-06 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957037+0000", 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1936999999999999e-05 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957056+0000", 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8459999999999999e-05 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957066+0000", 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0266e-05 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064381+0000", 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107315483 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064643+0000", 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026130800000000003 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064877+0000", 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023413899999999999 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069614+0000", 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0047370750000000003 2024-09-20T20:31:41.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069654+0000", 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0541999999999999e-05 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069786+0000", 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013186400000000001 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069890+0000", 2024-09-20T20:31:41.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104101 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:380 3.2 3:4272d415:::200.0000000b:head [write 790782~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2592619230000004, 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11330689300000001, 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957141+0000", 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3400000000000001e-06 2024-09-20T20:31:41.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957150+0000", 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8230000000000001e-06 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957171+0000", 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1331999999999998e-05 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957231+0000", 2024-09-20T20:31:41.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9698999999999999e-05 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066361+0000", 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.109130173 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066587+0000", 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022618599999999999 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066926+0000", 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033860299999999998 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069996+0000", 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003070672 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070196+0000", 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019970599999999999 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070339+0000", 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000143067 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070446+0000", 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107292 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.264 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:381 3.2 3:4272d415:::200.0000000b:head [write 792697~6542 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2591225030000004, 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117989833, 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957286+0000", 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0829999999999998e-06 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957305+0000", 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9216e-05 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957321+0000", 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5787e-05 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957331+0000", 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068072+0000", 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11074125899999999 2024-09-20T20:31:41.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068198+0000", 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126007 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068391+0000", 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019251899999999999 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070149+0000", 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017585910000000001 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.074999+0000", 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048502629999999996 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075145+0000", 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014563 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075269+0000", 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123628 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:382 3.2 3:4272d415:::200.0000000b:head [write 799239~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2580090970000004, 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117478417, 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.270 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958395+0000", 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1030000000000002e-06 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958409+0000", 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4059999999999999e-05 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958442+0000", 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2085999999999997e-05 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958466+0000", 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070538+0000", 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11207286399999999 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070770+0000", 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023195799999999999 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.071118+0000", 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034751299999999998 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075415+0000", 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042975080000000002 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075621+0000", 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000205622 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075757+0000", 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608399999999999 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075871+0000", 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113577 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.275 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:383 3.2 3:4272d415:::200.0000000b:head [write 800641~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2578328980000002, 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11757527299999999, 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958575+0000", 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6540000000000002e-06 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958586+0000", 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1293e-05 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958612+0000", 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5792e-05 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958634+0000", 2024-09-20T20:31:41.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1287000000000001e-05 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072108+0000", 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.113474767 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072345+0000", 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000237178 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072615+0000", 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026950800000000001 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075583+0000", 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002967679 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075895+0000", 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031276699999999998 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076020+0000", 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012504700000000001 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076144+0000", 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123301 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:384 3.2 3:4272d415:::200.0000000b:head [write 802559~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2577412060000004, 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.119348309, 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958662+0000", 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3859999999999999e-06 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958678+0000", 2024-09-20T20:31:41.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6779999999999999e-05 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958705+0000", 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6403000000000001e-05 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958732+0000", 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6818999999999999e-05 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073242+0000", 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.114510876 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073474+0000", 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023108499999999999 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073807+0000", 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033322700000000001 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076255+0000", 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024479860000000001 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.077749+0000", 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014944820000000001 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.077892+0000", 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014243700000000001 2024-09-20T20:31:41.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078009+0000", 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116828 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:385 3.2 3:4272d415:::200.0000000b:head [write 804479~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.257266123, 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121337555, 2024-09-20T20:31:41.287 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959137+0000", 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0499999999999999e-06 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959165+0000", 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7256000000000001e-05 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959238+0000", 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2974999999999998e-05 2024-09-20T20:31:41.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959259+0000", 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1005999999999998e-05 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076373+0000", 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117114513 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076598+0000", 2024-09-20T20:31:41.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022489100000000001 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076941+0000", 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034298999999999999 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080222+0000", 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032812589999999999 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080337+0000", 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115148 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080411+0000", 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3891000000000001e-05 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080473+0000", 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1575999999999995e-05 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.292 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:386 3.2 3:4272d415:::200.0000000b:head [write 806408~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2570912070000002, 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12330429499999999, 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959312+0000", 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1129999999999999e-06 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959322+0000", 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5570000000000001e-06 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959386+0000", 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3805000000000003e-05 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959407+0000", 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1583e-05 2024-09-20T20:31:41.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078149+0000", 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11874132900000001 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078289+0000", 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014025999999999999 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078474+0000", 2024-09-20T20:31:41.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018509599999999999 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080317+0000", 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001842752 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082471+0000", 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021539160000000001 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082550+0000", 2024-09-20T20:31:41.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9515e-05 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082615+0000", 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4369000000000007e-05 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:387 3.2 3:4272d415:::200.0000000b:head [write 807809~2445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:41.298 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.25696998, 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12458949499999999, 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:41.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959433+0000", 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-06 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959496+0000", 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2744999999999996e-05 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959525+0000", 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9346e-05 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959541+0000", 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6143000000000001e-05 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079333+0000", 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.119791804 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079451+0000", 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117821 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079630+0000", 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017930999999999999 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082759+0000", 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031291050000000001 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083884+0000", 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011246699999999999 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083957+0000", 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3192e-05 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084021+0000", 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3995e-05 2024-09-20T20:31:41.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:388 3.2 3:4272d415:::200.0000000b:head [write 810254~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.256836249, 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12698309799999999, 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959566+0000", 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.316e-06 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959584+0000", 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7183000000000001e-05 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959603+0000", 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9474e-05 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959618+0000", 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4491999999999999e-05 2024-09-20T20:31:41.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080537+0000", 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120919765 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080655+0000", 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011762 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080836+0000", 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018099699999999999 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083744+0000", 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029083220000000001 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086406+0000", 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026616650000000001 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086484+0000", 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7511999999999999e-05 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086548+0000", 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4752000000000006e-05 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.309 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:389 3.2 3:4272d415:::200.0000000b:head [write 811657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2567411850000001, 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12703187799999999, 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959661+0000", 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7000000000000004e-07 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959678+0000", 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7357e-05 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959691+0000", 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2176e-05 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959699+0000", 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4030000000000007e-06 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081607+0000", 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121908401 2024-09-20T20:31:41.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081736+0000", 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857999999999999 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081922+0000", 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018580300000000001 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083854+0000", 2024-09-20T20:31:41.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019327669999999999 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086573+0000", 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027184370000000002 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086642+0000", 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8841e-05 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086692+0000", 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0343000000000002e-05 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:390 3.2 3:4272d415:::200.0000000b:head [write 813056~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2566903060000003, 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12969470299999999, 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959712+0000", 2024-09-20T20:31:41.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4e-07 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959716+0000", 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2570000000000001e-06 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959733+0000", 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959744+0000", 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.049e-05 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082847+0000", 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123103439 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082956+0000", 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010941400000000001 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083149+0000", 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000192843 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086278+0000", 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031285480000000001 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089265+0000", 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029868920000000001 2024-09-20T20:31:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089341+0000", 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6075000000000006e-05 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089406+0000", 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5001999999999999e-05 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.320 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 814477~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2566480369999997, 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12979708400000001, 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959754+0000", 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4000000000000001e-07 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959766+0000", 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2403e-05 2024-09-20T20:31:41.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959782+0000", 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5224e-05 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959791+0000", 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2760000000000006e-06 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084105+0000", 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.124313734 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084235+0000", 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129877 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084418+0000", 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018307999999999999 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086381+0000", 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019628890000000002 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089429+0000", 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030487800000000001 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089499+0000", 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9791999999999999e-05 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089550+0000", 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1388999999999999e-05 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 816399~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.2479067090000004, 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12436905700000001, 2024-09-20T20:31:41.326 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:41.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968497+0000", 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1859999999999999e-06 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968511+0000", 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3740000000000001e-05 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968540+0000", 2024-09-20T20:31:41.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9039000000000001e-05 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968566+0000", 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6703000000000002e-05 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085239+0000", 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.116672501 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:41.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085380+0000", 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014088999999999999 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085619+0000", 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023910899999999999 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089129+0000", 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003510567 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092708+0000", 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003578566 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092798+0000", 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0241000000000006e-05 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092864+0000", 2024-09-20T20:31:41.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5514999999999999e-05 2024-09-20T20:31:41.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.332 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.332 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:41.332 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:41.332 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:41.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:41.340 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:41.328+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:2/380: mknod d3/d5/d9/d1c/d1f/d3e/c8e 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:8/403: dread d4/d27/d2a/d3e/d31/f52 [0,4194304] 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:8/404: mknod d4/d27/d2a/d3e/d31/c8e 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:0/392: rename d4/d8/d12/d23/d26/d1d/d37/d38/d7a to d4/d48/d7b 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:8/405: write f0 [5537236,71901] 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:2/381: rename d3/d5/d9/d1c/d47/d4b/l58 to d3/de/d12/d1a/l8f 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:0/393: fsync d4/d8/d12/d23/d26/f2a 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:2/382: dread - d3/d5/d9/f88 zero size 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:8/406: creat d4/db/d64/d7b/f8f x:0 0 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:0/394: mkdir d4/d8/d55/d7c 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:0/395: truncate d4/d1b/f3d 4265745 0 2024-09-20T20:31:41.349 INFO:tasks.workunit.client.0.smithi070.stdout:8/407: rename d4/d27/d2a/l57 to d4/db/d66/d8d/l90 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:0/396: mkdir d4/d48/d7d 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:0/397: mkdir d4/d8/d12/d23/d26/d1d/d7e 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/369: write d4/d8/d17/f24 [706280,24205] 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/370: creat d4/d8/d38/f85 x:0 0 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/371: unlink d4/l2e 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:2/383: dwrite d3/d5/dd/f15 [0,4194304] 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:8/408: dwrite f0 [0,4194304] 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/372: getdents d4/d8/d17/d33/d36 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:8/409: write d4/db/d64/d7b/f8f [470370,88007] 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:0/398: dwrite d4/d8/d12/d23/d26/f33 [4194304,4194304] 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:8/410: creat d4/d27/d2a/d75/f91 x:0 0 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:2/384: rename d3/d5/d9/d1c/d4e/l5d to d3/d5/d9/d1c/d1f/d3e/d61/l90 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:8/411: getdents d4/d27 0 2024-09-20T20:31:41.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/373: dwrite d4/d8/d10/d54/f76 [0,4194304] 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:6/374: mknod d4/d8/d3a/c86 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/412: dwrite d4/d27/d2a/d3e/f55 [0,4194304] 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/413: truncate d4/db/d66/f74 181543 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/414: getdents d4/db/d66/d8d 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/415: mknod d4/db/d66/c92 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/416: fdatasync d4/d27/d2a/d5b/f85 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:6/375: truncate f0 1522618 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/417: link d4/db/f11 d4/db/d64/f93 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:6/376: write d4/d8/d3a/f58 [827048,113499] 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:2/385: rename d3/d5/d9/d1c/d47/d4b to d3/d5/d9/d1c/d1f/d3e/d61/d91 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/418: readlink d4/d27/d2a/l3a 0 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:6/377: chown d4/d8/d3a/f58 132652524 1 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:8/419: rmdir d4/d27/d2a 39 2024-09-20T20:31:41.351 INFO:tasks.workunit.client.0.smithi070.stdout:6/378: rename d4/d8/d1e/l81 to d4/d8/d68/l87 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:6/379: readlink d4/d8/d10/d54/d55/l59 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:8/420: truncate d4/f38 353619 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:6/380: write d4/d8/d17/f57 [296820,129654] 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:8/421: fdatasync d4/db/d66/f6a 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:6/381: creat d4/d8/d10/f88 x:0 0 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:6/382: creat d4/d8/d10/f89 x:0 0 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:5/358: sync 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:7/260: sync 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:1/400: sync 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:3/335: sync 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:9/390: sync 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:5/359: mkdir d2/d4/d53/d74 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:7/261: write d2/d19/f27 [4826779,30844] 0 2024-09-20T20:31:41.352 INFO:tasks.workunit.client.0.smithi070.stdout:5/360: fdatasync d2/df/f68 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:9/391: rename d1/df/d25/d69/d80/f87 to d1/f89 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:7/262: dread - d2/d19/d25/f36 zero size 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:1/401: getdents d4/d6/d11 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:5/361: mkdir d2/df/d75 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:9/392: creat d1/df/d25/d69/f8a x:0 0 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:3/336: symlink d7/d15/d1a/l64 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:8/422: truncate d4/d27/d2a/d3e/d39/f41 3982732 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:9/393: chown d1/df/d38/f47 2 1 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:8/423: stat d4/c1f 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:9/394: symlink d1/df/d18/d44/d77/l8b 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:5/362: rename d2/d4/de/d47/d5f/l6d to d2/df/d40/d46/d5b/l76 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:8/424: write d4/d27/d2a/d5b/f85 [141766,38626] 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:3/337: rename d7/d15/d23 to d7/d15/d1e/d65 0 2024-09-20T20:31:41.353 INFO:tasks.workunit.client.0.smithi070.stdout:6/383: dwrite d4/d8/d10/f14 [0,4194304] 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:1/402: write d4/d32/d34/d44/d48/f77 [632305,32464] 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:0/399: dread d4/f9 [0,4194304] 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:7/263: dwrite d2/d19/d25/d2a/f3a [0,4194304] 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:8/425: symlink d4/d27/d2a/d5b/d6c/l94 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:3/338: mkdir d7/d15/d1a/d48/d66 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:8/426: chown d4/db/d66/d8d 161478 1 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:9/395: rename d1/df/d18/l51 to d1/d76/l8c 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:5/363: read d2/df/d40/d46/d5b/f26 [151506,116647] 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:0/400: mknod d4/d8/d12/d23/d26/d1f/c7f 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:9/396: write d1/df/d18/d46/f81 [606472,43963] 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:0/401: fsync d4/f7 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:5/364: fsync d2/df/d40/d46/d4c/f71 0 2024-09-20T20:31:41.354 INFO:tasks.workunit.client.0.smithi070.stdout:6/384: dwrite d4/d8/d10/f6e [0,4194304] 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:8/427: chown d4/db/d66/f81 1070751 1 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/397: write d1/df/d25/d69/f6a [239685,76294] 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:1/403: dwrite d4/d1f/f7a [0,4194304] 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:7/264: write d2/d8/f3b [4376201,71671] 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:6/385: symlink d4/d8/d17/d33/d36/l8a 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:0/402: symlink d4/d8/d12/d23/d26/d1d/l80 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/398: creat d1/df/d25/d69/f8d x:0 0 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:6/386: mkdir d4/d8/d17/d33/d8b 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/399: mknod d1/c8e 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:6/387: symlink d4/d8/d10/d54/d55/l8c 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/400: rmdir d1/df/d2d/d82 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/401: fsync d1/df/d18/d46/f7f 0 2024-09-20T20:31:41.355 INFO:tasks.workunit.client.0.smithi070.stdout:6/388: creat d4/d8/d10/d3c/f8d x:0 0 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:1/404: dwrite d4/d6/d11/f38 [0,4194304] 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/402: fdatasync d1/df/d18/f3c 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/403: readlink d1/df/d18/d44/d77/l86 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:1/405: stat d4/d6/d11/d2c/d3b/l4e 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/404: creat d1/df/d18/d46/f8f x:0 0 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:3/339: dread f2 [0,4194304] 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:0/403: dwrite d4/d8/d12/d23/d26/d1d/d37/f60 [0,4194304] 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/405: mkdir d1/df/d18/d44/d90 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:0/404: mkdir d4/d48/d4e/d81 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:6/389: dread d4/d8/d38/f7d [0,4194304] 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/406: write d1/f89 [2861618,51150] 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:0/405: chown d4/d48/d4e/f5a 30 1 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:6/390: mknod d4/d8/d17/c8e 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/407: creat d1/df/d84/f91 x:0 0 0 2024-09-20T20:31:41.356 INFO:tasks.workunit.client.0.smithi070.stdout:9/408: truncate d1/df/d25/d69/f8d 545447 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:6/391: dread d4/f6 [0,4194304] 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:9/409: unlink d1/df/f5b 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:1/406: truncate d4/d6/d11/f38 3501480 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:9/410: symlink d1/d76/l92 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:0/406: dread d4/f9 [0,4194304] 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:3/340: dwrite f5 [0,4194304] 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:1/407: truncate d4/d6/d11/d2c/d3b/f94 628563 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:3/341: creat d7/d15/f67 x:0 0 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:6/392: dread f0 [0,4194304] 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:0/407: stat d4/d8/d12/d23/d26/d1d/d37/d38/f59 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:1/408: chown d4/d6/d11/d2c/d3b/f3d 0 1 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:9/411: rename d1/df/d18/d44/l4d to d1/df/l93 0 2024-09-20T20:31:41.357 INFO:tasks.workunit.client.0.smithi070.stdout:0/408: fsync d4/d48/f72 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:1/409: write d4/d6/d26/f8d [372484,52028] 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:0/409: mkdir d4/d19/d82 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:9/412: creat d1/df/d2d/f94 x:0 0 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:3/342: mknod d7/d15/d1e/d65/c68 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:9/413: truncate d1/f2a 409080 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:8/428: dread f0 [4194304,4194304] 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:7/265: dread d2/d19/d25/d2a/f44 [0,4194304] 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:6/393: link d4/d8/d17/l35 d4/d8/l8f 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:9/414: chown d1/df/d18/f2f 1 1 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:0/410: creat d4/d8/d12/d23/d26/d1d/d37/d3e/f83 x:0 0 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:8/429: unlink d4/d27/d2a/d7e/f83 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:0/411: rmdir d4/d1b 39 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:8/430: mkdir d4/db/d64/d95 0 2024-09-20T20:31:41.358 INFO:tasks.workunit.client.0.smithi070.stdout:9/415: write d1/df/d18/d46/f81 [440400,105968] 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:0/412: read - d4/d8/d12/f5e zero size 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:9/416: write d1/f11 [2194415,59859] 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:8/431: creat d4/d27/d73/d87/d8a/f96 x:0 0 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:8/432: unlink d4/db/ff 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:9/417: link d1/df/d18/c48 d1/d76/c95 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:6/394: dwrite d4/d8/d17/d33/d36/f53 [4194304,4194304] 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:7/266: dwrite d2/d19/d25/d2a/f44 [4194304,4194304] 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:7/267: fdatasync d2/d30/f3f 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:7/268: write d2/d19/f1a [1105772,70489] 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:4/406: sync 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:6/395: creat d4/d8/f90 x:0 0 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:6/396: chown d4/d8/d10/d3c/f8d 0 1 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:9/418: dwrite d1/df/d18/f66 [0,4194304] 0 2024-09-20T20:31:41.359 INFO:tasks.workunit.client.0.smithi070.stdout:3/343: dread f3 [0,4194304] 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:6/397: chown d4/d8/d10/f6e 211544 1 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:1/410: dwrite d4/d6/d11/d63/d6c/f98 [0,4194304] 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:6/398: dread d4/d8/d10/f2d [0,4194304] 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:3/344: truncate d7/d8/d13/d1d/f47 551437 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:1/411: mknod d4/d6/d11/d2c/d3a/d78/c99 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:4/407: getdents d6/d7/dc/d20 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:9/419: creat d1/df/d25/f96 x:0 0 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:6/399: truncate d4/d8/ff 2752763 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:0/413: dread d4/d8/fc [0,4194304] 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:4/408: mkdir d6/d5e/d51/d84 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:6/400: rmdir d4/d8/d17/d33/d36 39 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:1/412: creat d4/d6/d11/d2c/d3b/f9a x:0 0 0 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:4/409: chown d6/d5e/f70 2408232 1 2024-09-20T20:31:41.360 INFO:tasks.workunit.client.0.smithi070.stdout:3/345: dread d7/d15/f18 [0,4194304] 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:0/414: write d4/f9 [2453450,53362] 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:4/410: readlink d6/d7/l49 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:0/415: chown d4/f7 17615 1 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:4/411: write d6/f8 [5849974,8274] 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:1/413: mknod d4/d32/d34/d44/d4b/d87/c9b 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:0/416: write d4/d8/d12/d23/d26/f51 [805257,130061] 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:1/414: chown d4/d6/d11/d2c/d3b/f9a 5 1 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:4/412: rename d6/d43/c7a to d6/d7/dc/d4a/c85 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:0/417: fsync d4/d8/d12/d23/d26/d1f/d4d/f6e 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:4/413: creat d6/f86 x:0 0 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:0/418: getdents d4/d8/d12/d23/d26/d1f/d4d 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:0/419: write d4/fd [749421,29484] 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:7/269: dread d2/d8/f1d [0,4194304] 0 2024-09-20T20:31:41.361 INFO:tasks.workunit.client.0.smithi070.stdout:4/414: dread d6/d7/f3e [0,4194304] 0 2024-09-20T20:31:41.364 INFO:tasks.workunit.client.0.smithi070.stdout:0/420: rename d4/d8/f69 to d4/d48/d4e/d81/f84 0 2024-09-20T20:31:41.364 INFO:tasks.workunit.client.0.smithi070.stdout:7/270: creat d2/d19/d25/d42/f53 x:0 0 0 2024-09-20T20:31:41.364 INFO:tasks.workunit.client.0.smithi070.stdout:7/271: fdatasync d2/d8/f6 0 2024-09-20T20:31:41.364 INFO:tasks.workunit.client.0.smithi070.stdout:7/272: readlink d2/d19/l28 0 2024-09-20T20:31:41.364 INFO:tasks.workunit.client.0.smithi070.stdout:6/401: dread d4/d8/d3a/f66 [0,4194304] 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:0/421: rename d4/d8/d12/d23/d26/d1f/c42 to d4/d8/d12/d23/d26/d1d/d7e/c85 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:7/273: write d2/f1b [2732355,26275] 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:6/402: creat d4/d8/d1e/d7e/f91 x:0 0 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:4/415: dwrite d6/d26/d69/d71/f6d [0,4194304] 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:0/422: unlink d4/d8/d12/d23/d26/d1d/c3c 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:7/274: creat d2/d52/f54 x:0 0 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:1/415: dread d4/d6/f47 [0,4194304] 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:4/416: write d6/d7/f3e [741805,117473] 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:7/275: read d2/f45 [371315,68078] 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:0/423: link d4/d8/d12/f25 d4/d8/d12/f86 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:4/417: link d6/d7/f3b d6/d26/f87 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:0/424: readlink d4/d8/d12/d23/d26/d1f/d2e/l35 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:0/425: write f2 [962025,112627] 0 2024-09-20T20:31:41.365 INFO:tasks.workunit.client.0.smithi070.stdout:4/418: link d6/f86 d6/d5e/d75/f88 0 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:6/403: chown d4/d8/d17/d33/d61/d73/l77 111817538 1 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:4/419: creat d6/d5e/d51/f89 x:0 0 0 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:0/426: rename d4/d8/d12/d23/d26/d1f/l22 to d4/d8/d55/d7c/l87 0 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:6/404: chown d4/d8/d17/f31 0 1 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:0/427: rmdir d4/d19 39 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:1/416: truncate d4/d6/f47 44235 0 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:4/420: link d6/f6f d6/d7/dc/f8a 0 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:0/428: fsync d4/d8/d12/d23/d26/d2d/f6c 0 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:6/405: getdents d4/d8/d10/d54 0 2024-09-20T20:31:41.366 INFO:tasks.workunit.client.0.smithi070.stdout:7/276: dwrite d2/f26 [4194304,4194304] 0 2024-09-20T20:31:41.367 INFO:tasks.workunit.client.0.smithi070.stdout:4/421: creat d6/d7/dc/d4a/d58/f8b x:0 0 0 2024-09-20T20:31:41.367 INFO:tasks.workunit.client.0.smithi070.stdout:0/429: rmdir d4/d8/d12/d23/d26/d1d/d7e 39 2024-09-20T20:31:41.367 INFO:tasks.workunit.client.0.smithi070.stdout:7/277: mkdir d2/d19/d25/d42/d55 0 2024-09-20T20:31:41.367 INFO:tasks.workunit.client.0.smithi070.stdout:1/417: link d4/d6/d26/f5b d4/d6/d11/d63/d6c/f9c 0 2024-09-20T20:31:41.367 INFO:tasks.workunit.client.0.smithi070.stdout:6/406: creat d4/d8/d10/f92 x:0 0 0 2024-09-20T20:31:41.367 INFO:tasks.workunit.client.0.smithi070.stdout:4/422: write d6/d7/dc/f4b [351728,64648] 0 2024-09-20T20:31:41.368 INFO:tasks.workunit.client.0.smithi070.stdout:0/430: fsync d4/d8/d12/d23/d26/d1d/d37/d3e/f83 0 2024-09-20T20:31:41.368 INFO:tasks.workunit.client.0.smithi070.stdout:1/418: rmdir d4/d6/d11/d2c/d3a 39 2024-09-20T20:31:41.368 INFO:tasks.workunit.client.0.smithi070.stdout:6/407: readlink d4/d8/d17/d33/d36/l8a 0 2024-09-20T20:31:41.368 INFO:tasks.workunit.client.0.smithi070.stdout:4/423: chown d6/d26/d69/d71/f7e 1007 1 2024-09-20T20:31:41.368 INFO:tasks.workunit.client.0.smithi070.stdout:4/424: chown d6/d7/dc/f52 0 1 2024-09-20T20:31:41.369 INFO:tasks.workunit.client.0.smithi070.stdout:0/431: creat d4/f88 x:0 0 0 2024-09-20T20:31:41.370 INFO:tasks.workunit.client.0.smithi070.stdout:4/425: creat d6/d5e/d51/d63/f8c x:0 0 0 2024-09-20T20:31:41.370 INFO:tasks.workunit.client.0.smithi070.stdout:4/426: rmdir d6/d7/d77 39 2024-09-20T20:31:41.374 INFO:tasks.workunit.client.0.smithi070.stdout:1/419: dwrite d4/f15 [0,4194304] 0 2024-09-20T20:31:41.375 INFO:tasks.workunit.client.0.smithi070.stdout:0/432: dwrite d4/d8/d12/d23/d26/d1d/d37/d3e/f83 [0,4194304] 0 2024-09-20T20:31:41.377 INFO:tasks.workunit.client.0.smithi070.stdout:1/420: unlink d4/d6/d2f/f97 0 2024-09-20T20:31:41.378 INFO:tasks.workunit.client.0.smithi070.stdout:0/433: getdents d4/d1b 0 2024-09-20T20:31:41.378 INFO:tasks.workunit.client.0.smithi070.stdout:1/421: mkdir d4/d6/d11/d2c/d3a/d9d 0 2024-09-20T20:31:41.379 INFO:tasks.workunit.client.0.smithi070.stdout:1/422: dread - d4/d6/d11/d2c/f46 zero size 2024-09-20T20:31:41.379 INFO:tasks.workunit.client.0.smithi070.stdout:0/434: creat d4/d8/d12/d23/d26/d2d/f89 x:0 0 0 2024-09-20T20:31:41.383 INFO:tasks.workunit.client.0.smithi070.stdout:0/435: dread d4/d8/d12/d23/d26/f51 [0,4194304] 0 2024-09-20T20:31:41.384 INFO:tasks.workunit.client.0.smithi070.stdout:0/436: symlink d4/d8/d12/d23/d26/d1d/d7e/l8a 0 2024-09-20T20:31:41.385 INFO:tasks.workunit.client.0.smithi070.stdout:0/437: readlink d4/d8/d12/d23/d26/d1d/d41/l64 0 2024-09-20T20:31:41.386 INFO:tasks.workunit.client.0.smithi070.stdout:0/438: rename d4/d48/f70 to d4/d19/d82/f8b 0 2024-09-20T20:31:41.386 INFO:tasks.workunit.client.0.smithi070.stdout:0/439: chown d4/d48/d4e 76 1 2024-09-20T20:31:41.388 INFO:tasks.workunit.client.0.smithi070.stdout:0/440: truncate d4/d8/d12/d23/d26/d1d/d37/f4c 76963 0 2024-09-20T20:31:41.389 INFO:tasks.workunit.client.0.smithi070.stdout:1/423: fsync d4/d6/f47 0 2024-09-20T20:31:41.389 INFO:tasks.workunit.client.0.smithi070.stdout:0/441: mkdir d4/d48/d7b/d8c 0 2024-09-20T20:31:41.390 INFO:tasks.workunit.client.0.smithi070.stdout:1/424: truncate d4/d6/d11/f42 169895 0 2024-09-20T20:31:41.391 INFO:tasks.workunit.client.0.smithi070.stdout:0/442: unlink d4/d8/d12/d23/d26/d1d/d37/d38/f59 0 2024-09-20T20:31:41.392 INFO:tasks.workunit.client.0.smithi070.stdout:0/443: chown d4/d13/c40 5 1 2024-09-20T20:31:41.392 INFO:tasks.workunit.client.0.smithi070.stdout:1/425: rename d4/d1f/d69 to d4/d6/d11/d9e 0 2024-09-20T20:31:41.392 INFO:tasks.workunit.client.0.smithi070.stdout:4/427: dwrite d6/d5e/d75/f2e [0,4194304] 0 2024-09-20T20:31:41.393 INFO:tasks.workunit.client.0.smithi070.stdout:4/428: fdatasync d6/d7/dc/f52 0 2024-09-20T20:31:41.395 INFO:tasks.workunit.client.0.smithi070.stdout:0/444: creat d4/d8/d12/d23/d26/d1d/d7e/f8d x:0 0 0 2024-09-20T20:31:41.396 INFO:tasks.workunit.client.0.smithi070.stdout:4/429: link d6/d7/l49 d6/d26/d69/l8d 0 2024-09-20T20:31:41.396 INFO:tasks.workunit.client.0.smithi070.stdout:7/278: dread d2/f1b [0,4194304] 0 2024-09-20T20:31:41.396 INFO:tasks.workunit.client.0.smithi070.stdout:4/430: creat d6/d43/f8e x:0 0 0 2024-09-20T20:31:41.397 INFO:tasks.workunit.client.0.smithi070.stdout:0/445: truncate d4/f62 87866 0 2024-09-20T20:31:41.398 INFO:tasks.workunit.client.0.smithi070.stdout:4/431: write d6/d7/f3e [348777,79186] 0 2024-09-20T20:31:41.398 INFO:tasks.workunit.client.0.smithi070.stdout:4/432: readlink d6/d43/l64 0 2024-09-20T20:31:41.398 INFO:tasks.workunit.client.0.smithi070.stdout:7/279: link d2/d19/d2e/f41 d2/d19/d25/d2a/f56 0 2024-09-20T20:31:41.398 INFO:tasks.workunit.client.0.smithi070.stdout:4/433: unlink d6/f4e 0 2024-09-20T20:31:41.399 INFO:tasks.workunit.client.0.smithi070.stdout:7/280: truncate d2/d19/d2e/f4e 471309 0 2024-09-20T20:31:41.402 INFO:tasks.workunit.client.0.smithi070.stdout:1/426: fdatasync d4/d6/d11/d2c/d3a/d78/f84 0 2024-09-20T20:31:41.403 INFO:tasks.workunit.client.0.smithi070.stdout:0/446: dwrite d4/fd [0,4194304] 0 2024-09-20T20:31:41.405 INFO:tasks.workunit.client.0.smithi070.stdout:5/365: sync 2024-09-20T20:31:41.405 INFO:tasks.workunit.client.0.smithi070.stdout:8/433: sync 2024-09-20T20:31:41.405 INFO:tasks.workunit.client.0.smithi070.stdout:2/386: sync 2024-09-20T20:31:41.405 INFO:tasks.workunit.client.0.smithi070.stdout:3/346: sync 2024-09-20T20:31:41.405 INFO:tasks.workunit.client.0.smithi070.stdout:9/420: sync 2024-09-20T20:31:41.406 INFO:tasks.workunit.client.0.smithi070.stdout:4/434: dwrite d6/d5e/d75/d40/f56 [0,4194304] 0 2024-09-20T20:31:41.407 INFO:tasks.workunit.client.0.smithi070.stdout:2/387: fsync d3/de/d12/f7d 0 2024-09-20T20:31:41.407 INFO:tasks.workunit.client.0.smithi070.stdout:5/366: mkdir d2/df/d77 0 2024-09-20T20:31:41.407 INFO:tasks.workunit.client.0.smithi070.stdout:9/421: chown d1/d76/c71 146 1 2024-09-20T20:31:41.409 INFO:tasks.workunit.client.0.smithi070.stdout:0/447: rename d4/d8/d12/d23/d26/l6f to d4/d48/d7b/d8c/l8e 0 2024-09-20T20:31:41.410 INFO:tasks.workunit.client.0.smithi070.stdout:9/422: creat d1/df/d38/f97 x:0 0 0 2024-09-20T20:31:41.412 INFO:tasks.workunit.client.0.smithi070.stdout:8/434: rename d4/d27/d2a/d3e/f55 to d4/d27/d2a/d3e/d39/f97 0 2024-09-20T20:31:41.413 INFO:tasks.workunit.client.0.smithi070.stdout:1/427: dwrite d4/d6/d11/d2c/d3b/f74 [0,4194304] 0 2024-09-20T20:31:41.415 INFO:tasks.workunit.client.0.smithi070.stdout:6/408: dread d4/d8/fa [0,4194304] 0 2024-09-20T20:31:41.416 INFO:tasks.workunit.client.0.smithi070.stdout:5/367: dread d2/df/d40/d46/d5b/f42 [0,4194304] 0 2024-09-20T20:31:41.416 INFO:tasks.workunit.client.0.smithi070.stdout:8/435: mkdir d4/d27/d2a/d5b/d98 0 2024-09-20T20:31:41.416 INFO:tasks.workunit.client.0.smithi070.stdout:3/347: dread d7/d8/f19 [0,4194304] 0 2024-09-20T20:31:41.417 INFO:tasks.workunit.client.0.smithi070.stdout:1/428: mknod d4/d32/d60/c9f 0 2024-09-20T20:31:41.417 INFO:tasks.workunit.client.0.smithi070.stdout:6/409: mkdir d4/d8/d68/d93 0 2024-09-20T20:31:41.417 INFO:tasks.workunit.client.0.smithi070.stdout:9/423: link d1/df/d25/d69/f8a d1/df/d18/d44/f98 0 2024-09-20T20:31:41.419 INFO:tasks.workunit.client.0.smithi070.stdout:4/435: dwrite d6/d7/f45 [0,4194304] 0 2024-09-20T20:31:41.419 INFO:tasks.workunit.client.0.smithi070.stdout:2/388: dwrite d3/d5/f34 [0,4194304] 0 2024-09-20T20:31:41.420 INFO:tasks.workunit.client.0.smithi070.stdout:5/368: fsync d2/df/d40/d46/d5b/f37 0 2024-09-20T20:31:41.420 INFO:tasks.workunit.client.0.smithi070.stdout:8/436: creat d4/d27/d73/f99 x:0 0 0 2024-09-20T20:31:41.421 INFO:tasks.workunit.client.0.smithi070.stdout:4/436: write d6/d7/dc/f4b [1138823,124944] 0 2024-09-20T20:31:41.421 INFO:tasks.workunit.client.0.smithi070.stdout:0/448: dwrite d4/d8/d12/d23/d26/f2a [0,4194304] 0 2024-09-20T20:31:41.422 INFO:tasks.workunit.client.0.smithi070.stdout:9/424: creat d1/df/d18/d44/d77/f99 x:0 0 0 2024-09-20T20:31:41.423 INFO:tasks.workunit.client.0.smithi070.stdout:2/389: mkdir d3/d5/d9/d1c/d1f/d3e/d92 0 2024-09-20T20:31:41.423 INFO:tasks.workunit.client.0.smithi070.stdout:5/369: mknod d2/c78 0 2024-09-20T20:31:41.425 INFO:tasks.workunit.client.0.smithi070.stdout:6/410: getdents d4/d8/d17/d33/d36 0 2024-09-20T20:31:41.425 INFO:tasks.workunit.client.0.smithi070.stdout:2/390: dread - d3/de/d12/f7a zero size 2024-09-20T20:31:41.425 INFO:tasks.workunit.client.0.smithi070.stdout:8/437: symlink d4/d27/d2a/d43/d61/l9a 0 2024-09-20T20:31:41.426 INFO:tasks.workunit.client.0.smithi070.stdout:4/437: rmdir d6/d5e/d75 39 2024-09-20T20:31:41.426 INFO:tasks.workunit.client.0.smithi070.stdout:8/438: fsync d4/d27/d2a/d3e/d31/f3f 0 2024-09-20T20:31:41.427 INFO:tasks.workunit.client.0.smithi070.stdout:5/370: creat d2/f79 x:0 0 0 2024-09-20T20:31:41.427 INFO:tasks.workunit.client.0.smithi070.stdout:2/391: unlink d3/d5/d9/d79/f7f 0 2024-09-20T20:31:41.428 INFO:tasks.workunit.client.0.smithi070.stdout:6/411: creat d4/d8/d10/d3c/f94 x:0 0 0 2024-09-20T20:31:41.429 INFO:tasks.workunit.client.0.smithi070.stdout:8/439: link d4/db/d64/f8c d4/db/d64/d95/f9b 0 2024-09-20T20:31:41.429 INFO:tasks.workunit.client.0.smithi070.stdout:4/438: dread - d6/d5e/d75/f88 zero size 2024-09-20T20:31:41.429 INFO:tasks.workunit.client.0.smithi070.stdout:2/392: write d3/f36 [1699574,14512] 0 2024-09-20T20:31:41.429 INFO:tasks.workunit.client.0.smithi070.stdout:6/412: creat d4/d8/d38/f95 x:0 0 0 2024-09-20T20:31:41.429 INFO:tasks.workunit.client.0.smithi070.stdout:5/371: fsync d2/df/d40/d46/d4c/f71 0 2024-09-20T20:31:41.429 INFO:tasks.workunit.client.0.smithi070.stdout:1/429: dwrite d4/d6/d11/d2c/d3b/f3d [0,4194304] 0 2024-09-20T20:31:41.430 INFO:tasks.workunit.client.0.smithi070.stdout:5/372: chown d2/d4/de/d47/d67 320261 1 2024-09-20T20:31:41.430 INFO:tasks.workunit.client.0.smithi070.stdout:2/393: write d3/de/d12/d1a/f46 [1021482,8654] 0 2024-09-20T20:31:41.431 INFO:tasks.workunit.client.0.smithi070.stdout:6/413: unlink d4/d8/d17/d33/c47 0 2024-09-20T20:31:41.433 INFO:tasks.workunit.client.0.smithi070.stdout:1/430: mknod d4/d6/d11/d2c/d3a/d78/ca0 0 2024-09-20T20:31:41.434 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:41.428+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:41.434 INFO:tasks.workunit.client.0.smithi070.stdout:2/394: fsync d3/d5/d9/d1c/d1f/f62 0 2024-09-20T20:31:41.434 INFO:tasks.workunit.client.0.smithi070.stdout:6/414: symlink d4/d8/d17/d33/d8b/l96 0 2024-09-20T20:31:41.434 INFO:tasks.workunit.client.0.smithi070.stdout:5/373: link d2/d7/f31 d2/df/d40/d46/f7a 0 2024-09-20T20:31:41.434 INFO:tasks.workunit.client.0.smithi070.stdout:3/348: dread d7/d8/d13/d1d/f47 [0,4194304] 0 2024-09-20T20:31:41.435 INFO:tasks.workunit.client.0.smithi070.stdout:2/395: creat d3/d5/d9/d42/f93 x:0 0 0 2024-09-20T20:31:41.435 INFO:tasks.workunit.client.0.smithi070.stdout:3/349: fsync d7/d8/f11 0 2024-09-20T20:31:41.435 INFO:tasks.workunit.client.0.smithi070.stdout:5/374: symlink d2/d4/d53/d59/l7b 0 2024-09-20T20:31:41.436 INFO:tasks.workunit.client.0.smithi070.stdout:5/375: fsync d2/f13 0 2024-09-20T20:31:41.436 INFO:tasks.workunit.client.0.smithi070.stdout:3/350: chown d7/d8/d13/d1d/f47 4607 1 2024-09-20T20:31:41.436 INFO:tasks.workunit.client.0.smithi070.stdout:6/415: getdents d4/d8/d3a 0 2024-09-20T20:31:41.437 INFO:tasks.workunit.client.0.smithi070.stdout:2/396: rename d3/de/c54 to d3/de/c94 0 2024-09-20T20:31:41.437 INFO:tasks.workunit.client.0.smithi070.stdout:5/376: creat d2/df/d40/f7c x:0 0 0 2024-09-20T20:31:41.438 INFO:tasks.workunit.client.0.smithi070.stdout:7/281: sync 2024-09-20T20:31:41.438 INFO:tasks.workunit.client.0.smithi070.stdout:3/351: rename d7/d8 to d7/d15/d1a/d48/d66/d69 0 2024-09-20T20:31:41.438 INFO:tasks.workunit.client.0.smithi070.stdout:6/416: write d4/d8/f1f [2318082,15580] 0 2024-09-20T20:31:41.438 INFO:tasks.workunit.client.0.smithi070.stdout:2/397: mknod d3/d4c/c95 0 2024-09-20T20:31:41.439 INFO:tasks.workunit.client.0.smithi070.stdout:4/439: dwrite d6/d5e/f70 [0,4194304] 0 2024-09-20T20:31:41.440 INFO:tasks.workunit.client.0.smithi070.stdout:7/282: rename d2/d19/d2e/c34 to d2/d30/c57 0 2024-09-20T20:31:41.440 INFO:tasks.workunit.client.0.smithi070.stdout:6/417: write d4/d8/d17/d33/f52 [2681848,109509] 0 2024-09-20T20:31:41.441 INFO:tasks.workunit.client.0.smithi070.stdout:7/283: symlink d2/d19/d2e/l58 0 2024-09-20T20:31:41.441 INFO:tasks.workunit.client.0.smithi070.stdout:6/418: readlink d4/d8/d17/d33/d36/l74 0 2024-09-20T20:31:41.441 INFO:tasks.workunit.client.0.smithi070.stdout:4/440: creat d6/d26/d69/d71/d4c/f8f x:0 0 0 2024-09-20T20:31:41.441 INFO:tasks.workunit.client.0.smithi070.stdout:2/398: read d3/d5/dd/d5a/f5f [1541039,122562] 0 2024-09-20T20:31:41.442 INFO:tasks.workunit.client.0.smithi070.stdout:7/284: unlink d2/d8/f12 0 2024-09-20T20:31:41.442 INFO:tasks.workunit.client.0.smithi070.stdout:3/352: link d7/d15/d1a/d48/d66/d69/f24 d7/d15/d1a/d4a/d51/d5b/f6a 0 2024-09-20T20:31:41.443 INFO:tasks.workunit.client.0.smithi070.stdout:2/399: readlink d3/d5/l44 0 2024-09-20T20:31:41.443 INFO:tasks.workunit.client.0.smithi070.stdout:7/285: write d2/d19/d25/d2a/d4a/f4b [4873181,60418] 0 2024-09-20T20:31:41.443 INFO:tasks.workunit.client.0.smithi070.stdout:3/353: symlink d7/d15/d1a/d4a/d51/l6b 0 2024-09-20T20:31:41.444 INFO:tasks.workunit.client.0.smithi070.stdout:2/400: read - d3/d5/d9/d79/f7b zero size 2024-09-20T20:31:41.444 INFO:tasks.workunit.client.0.smithi070.stdout:3/354: write d7/d15/f67 [346770,81459] 0 2024-09-20T20:31:41.445 INFO:tasks.workunit.client.0.smithi070.stdout:2/401: rename d3/d5/d9/d42/l68 to d3/d5/dd/d5a/l96 0 2024-09-20T20:31:41.445 INFO:tasks.workunit.client.0.smithi070.stdout:5/377: dread d2/df/d40/d46/d5b/f26 [0,4194304] 0 2024-09-20T20:31:41.451 INFO:tasks.workunit.client.0.smithi070.stdout:8/440: truncate d4/d27/d2a/d3e/d31/f52 3639754 0 2024-09-20T20:31:41.452 INFO:tasks.workunit.client.0.smithi070.stdout:1/431: write d4/d6/f47 [155619,10551] 0 2024-09-20T20:31:41.452 INFO:tasks.workunit.client.0.smithi070.stdout:3/355: getdents d7 0 2024-09-20T20:31:41.452 INFO:tasks.workunit.client.0.smithi070.stdout:6/419: write d4/d8/d1e/f5b [255628,22382] 0 2024-09-20T20:31:41.453 INFO:tasks.workunit.client.0.smithi070.stdout:7/286: sync 2024-09-20T20:31:41.453 INFO:tasks.workunit.client.0.smithi070.stdout:5/378: sync 2024-09-20T20:31:41.453 INFO:tasks.workunit.client.0.smithi070.stdout:8/441: fdatasync d4/d27/f36 0 2024-09-20T20:31:41.453 INFO:tasks.workunit.client.0.smithi070.stdout:7/287: creat d2/d30/f59 x:0 0 0 2024-09-20T20:31:41.454 INFO:tasks.workunit.client.0.smithi070.stdout:1/432: symlink d4/d32/d34/d44/d5a/la1 0 2024-09-20T20:31:41.454 INFO:tasks.workunit.client.0.smithi070.stdout:6/420: write d4/d8/d10/f44 [86579,83042] 0 2024-09-20T20:31:41.455 INFO:tasks.workunit.client.0.smithi070.stdout:8/442: mknod d4/d27/d2a/d7e/c9c 0 2024-09-20T20:31:41.455 INFO:tasks.workunit.client.0.smithi070.stdout:5/379: rename d2/df/d40/f62 to d2/df/d75/f7d 0 2024-09-20T20:31:41.455 INFO:tasks.workunit.client.0.smithi070.stdout:1/433: readlink d4/d1f/l33 0 2024-09-20T20:31:41.455 INFO:tasks.workunit.client.0.smithi070.stdout:3/356: write d7/d15/d1a/d48/d66/d69/d13/d1d/f34 [510050,108560] 0 2024-09-20T20:31:41.456 INFO:tasks.workunit.client.0.smithi070.stdout:5/380: write d2/d4/f1e [4811709,40940] 0 2024-09-20T20:31:41.456 INFO:tasks.workunit.client.0.smithi070.stdout:6/421: creat d4/d8/d3a/f97 x:0 0 0 2024-09-20T20:31:41.456 INFO:tasks.workunit.client.0.smithi070.stdout:5/381: chown d2/df 905592786 1 2024-09-20T20:31:41.458 INFO:tasks.workunit.client.0.smithi070.stdout:6/422: write d4/d8/d10/d54/d55/d72/f79 [380388,86083] 0 2024-09-20T20:31:41.459 INFO:tasks.workunit.client.0.smithi070.stdout:5/382: symlink d2/d4/d53/l7e 0 2024-09-20T20:31:41.459 INFO:tasks.workunit.client.0.smithi070.stdout:1/434: creat d4/d32/d34/d44/d4b/d87/fa2 x:0 0 0 2024-09-20T20:31:41.460 INFO:tasks.workunit.client.0.smithi070.stdout:3/357: write d7/d15/d1a/d48/d66/d69/f39 [806181,92618] 0 2024-09-20T20:31:41.461 INFO:tasks.workunit.client.0.smithi070.stdout:5/383: mkdir d2/d7/d7f 0 2024-09-20T20:31:41.463 INFO:tasks.workunit.client.0.smithi070.stdout:2/402: dwrite d3/d5/f2e [0,4194304] 0 2024-09-20T20:31:41.463 INFO:tasks.workunit.client.0.smithi070.stdout:1/435: chown d4/d6/l1d 253889 1 2024-09-20T20:31:41.464 INFO:tasks.workunit.client.0.smithi070.stdout:3/358: fsync d7/d15/d1a/f32 0 2024-09-20T20:31:41.464 INFO:tasks.workunit.client.0.smithi070.stdout:3/359: sync 2024-09-20T20:31:41.465 INFO:tasks.workunit.client.0.smithi070.stdout:2/403: symlink d3/d4c/d5c/l97 0 2024-09-20T20:31:41.467 INFO:tasks.workunit.client.0.smithi070.stdout:3/360: stat d7/d15/c40 0 2024-09-20T20:31:41.467 INFO:tasks.workunit.client.0.smithi070.stdout:4/441: dread d6/d7/dc/d4a/d58/f6c [0,4194304] 0 2024-09-20T20:31:41.468 INFO:tasks.workunit.client.0.smithi070.stdout:9/425: dread d1/f7 [4194304,4194304] 0 2024-09-20T20:31:41.468 INFO:tasks.workunit.client.0.smithi070.stdout:1/436: mkdir d4/d6/d11/d63/da3 0 2024-09-20T20:31:41.468 INFO:tasks.workunit.client.0.smithi070.stdout:0/449: dread d4/d8/d12/d23/d26/f33 [0,4194304] 0 2024-09-20T20:31:41.468 INFO:tasks.workunit.client.0.smithi070.stdout:5/384: symlink d2/d4/d53/l80 0 2024-09-20T20:31:41.469 INFO:tasks.workunit.client.0.smithi070.stdout:3/361: chown f5 101023 1 2024-09-20T20:31:41.469 INFO:tasks.workunit.client.0.smithi070.stdout:8/443: dwrite d4/db/d66/f84 [4194304,4194304] 0 2024-09-20T20:31:41.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/288: dwrite d2/d19/d25/d42/f53 [0,4194304] 0 2024-09-20T20:31:41.470 INFO:tasks.workunit.client.0.smithi070.stdout:4/442: creat d6/d26/f90 x:0 0 0 2024-09-20T20:31:41.472 INFO:tasks.workunit.client.0.smithi070.stdout:1/437: mknod d4/d6/d11/d2c/d3a/ca4 0 2024-09-20T20:31:41.472 INFO:tasks.workunit.client.0.smithi070.stdout:5/385: dread - d2/df/d40/f7c zero size 2024-09-20T20:31:41.472 INFO:tasks.workunit.client.0.smithi070.stdout:9/426: rename d1/df to d1/df/d18/d83/d9a 22 2024-09-20T20:31:41.472 INFO:tasks.workunit.client.0.smithi070.stdout:6/423: dwrite d4/d8/d10/f44 [0,4194304] 0 2024-09-20T20:31:41.474 INFO:tasks.workunit.client.0.smithi070.stdout:9/427: creat d1/d76/f9b x:0 0 0 2024-09-20T20:31:41.475 INFO:tasks.workunit.client.0.smithi070.stdout:1/438: mknod d4/d6/d11/d2c/ca5 0 2024-09-20T20:31:41.477 INFO:tasks.workunit.client.0.smithi070.stdout:9/428: symlink d1/df/d84/l9c 0 2024-09-20T20:31:41.477 INFO:tasks.workunit.client.0.smithi070.stdout:5/386: rename d2/df/l66 to d2/df/l81 0 2024-09-20T20:31:41.477 INFO:tasks.workunit.client.0.smithi070.stdout:8/444: creat d4/d27/d42/f9d x:0 0 0 2024-09-20T20:31:41.477 INFO:tasks.workunit.client.0.smithi070.stdout:7/289: getdents d2 0 2024-09-20T20:31:41.477 INFO:tasks.workunit.client.0.smithi070.stdout:2/404: dwrite d3/d5/d9/d42/f93 [0,4194304] 0 2024-09-20T20:31:41.479 INFO:tasks.workunit.client.0.smithi070.stdout:1/439: stat d4/d6/d11/d2c/d3b/f74 0 2024-09-20T20:31:41.479 INFO:tasks.workunit.client.0.smithi070.stdout:0/450: truncate d4/d8/d12/d23/d26/d1d/d37/d38/f63 145740 0 2024-09-20T20:31:41.481 INFO:tasks.workunit.client.0.smithi070.stdout:6/424: symlink d4/d8/d17/d33/d61/d73/l98 0 2024-09-20T20:31:41.481 INFO:tasks.workunit.client.0.smithi070.stdout:0/451: symlink d4/d8/d12/l8f 0 2024-09-20T20:31:41.481 INFO:tasks.workunit.client.0.smithi070.stdout:3/362: rename d7/d15/d1a/d48/d66/d69/d13/d1d/f37 to d7/d15/d1a/d4a/d51/d5b/f6c 0 2024-09-20T20:31:41.481 INFO:tasks.workunit.client.0.smithi070.stdout:1/440: mknod d4/d6/d11/d2c/d3b/ca6 0 2024-09-20T20:31:41.481 INFO:tasks.workunit.client.0.smithi070.stdout:7/290: write d2/d8/f47 [103930,26050] 0 2024-09-20T20:31:41.481 INFO:tasks.workunit.client.0.smithi070.stdout:6/425: mkdir d4/d8/d10/d3c/d99 0 2024-09-20T20:31:41.481 INFO:tasks.workunit.client.0.smithi070.stdout:8/445: link d4/db/l46 d4/d27/d73/d87/l9e 0 2024-09-20T20:31:41.481 INFO:tasks.workunit.client.0.smithi070.stdout:8/446: sync 2024-09-20T20:31:41.482 INFO:tasks.workunit.client.0.smithi070.stdout:2/405: creat d3/d5/d9/d1c/d47/d85/f98 x:0 0 0 2024-09-20T20:31:41.482 INFO:tasks.workunit.client.0.smithi070.stdout:4/443: dwrite d6/d7/dc/f52 [0,4194304] 0 2024-09-20T20:31:41.482 INFO:tasks.workunit.client.0.smithi070.stdout:1/441: mknod d4/d6/d11/d2c/d3b/ca7 0 2024-09-20T20:31:41.482 INFO:tasks.workunit.client.0.smithi070.stdout:6/426: chown d4/d8/f69 10 1 2024-09-20T20:31:41.483 INFO:tasks.workunit.client.0.smithi070.stdout:4/444: chown d6/d26/d69/f7d 359010 1 2024-09-20T20:31:41.483 INFO:tasks.workunit.client.0.smithi070.stdout:6/427: dread - d4/d8/d10/d3c/f94 zero size 2024-09-20T20:31:41.483 INFO:tasks.workunit.client.0.smithi070.stdout:0/452: truncate d4/d13/f76 689487 0 2024-09-20T20:31:41.484 INFO:tasks.workunit.client.0.smithi070.stdout:0/453: readlink d4/lf 0 2024-09-20T20:31:41.484 INFO:tasks.workunit.client.0.smithi070.stdout:0/454: sync 2024-09-20T20:31:41.484 INFO:tasks.workunit.client.0.smithi070.stdout:8/447: creat d4/d27/d2a/d3e/d39/f9f x:0 0 0 2024-09-20T20:31:41.485 INFO:tasks.workunit.client.0.smithi070.stdout:2/406: readlink d3/d5/d9/d10/l57 0 2024-09-20T20:31:41.485 INFO:tasks.workunit.client.0.smithi070.stdout:3/363: link d7/f14 d7/d15/d1a/d48/d57/f6d 0 2024-09-20T20:31:41.485 INFO:tasks.workunit.client.0.smithi070.stdout:4/445: truncate d6/d26/f87 3927507 0 2024-09-20T20:31:41.485 INFO:tasks.workunit.client.0.smithi070.stdout:9/429: link d1/df/d2d/l31 d1/d76/l9d 0 2024-09-20T20:31:41.485 INFO:tasks.workunit.client.0.smithi070.stdout:6/428: rename d4/d8/d10/d54/f76 to d4/d8/d1e/d7e/f9a 0 2024-09-20T20:31:41.485 INFO:tasks.workunit.client.0.smithi070.stdout:9/430: read - d1/df/d38/f97 zero size 2024-09-20T20:31:41.486 INFO:tasks.workunit.client.0.smithi070.stdout:5/387: read d2/df/d40/d46/d4c/f44 [436045,4937] 0 2024-09-20T20:31:41.487 INFO:tasks.workunit.client.0.smithi070.stdout:0/455: creat d4/d48/d4e/f90 x:0 0 0 2024-09-20T20:31:41.488 INFO:tasks.workunit.client.0.smithi070.stdout:4/446: truncate d6/d7/dc/d20/f55 511586 0 2024-09-20T20:31:41.488 INFO:tasks.workunit.client.0.smithi070.stdout:8/448: write d4/d27/d42/f44 [1400224,76708] 0 2024-09-20T20:31:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4469.0:12358 4.1 e54/17 4:8201fa91:::10000003208.00000000:head v 54'178, mlcod=54'176)", 2024-09-20T20:31:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.467983+0000", 2024-09-20T20:31:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.022952862000000001, 2024-09-20T20:31:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022993552, 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.467983+0000", 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.467983+0000", 2024-09-20T20:31:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.467984+0000", 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.09e-07 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.477331+0000", 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093475899999999994 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.477352+0000", 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0441999999999998e-05 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.477365+0000", 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2666e-05 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.477482+0000", 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000117518 2024-09-20T20:31:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.477531+0000", 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9288e-05 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12363 4.34 4:2dca00ce:::100000034db.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.477866+0000", 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.013069353000000001, 2024-09-20T20:31:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013250849, 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12363 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.477866+0000", 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.477866+0000", 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.477868+0000", 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.55e-06 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.485628+0000", 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077605199999999999 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.485645+0000", 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6943999999999999e-05 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.485655+0000", 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7030000000000001e-06 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.485746+0000", 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0378999999999996e-05 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.485911+0000", 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016577700000000001 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.486060+0000", 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000148226 2024-09-20T20:31:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4469.0:12362 4.29 e54/17 4:96c7c60a:::10000003366.00000000:head v 54'186, mlcod=54'184)", 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.481008+0000", 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0099281960000000002, 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010263962, 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.481008+0000", 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.481008+0000", 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.481009+0000", 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3349999999999999e-06 2024-09-20T20:31:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.487772+0000", 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0067631460000000003 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.487796+0000", 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4142999999999999e-05 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.487811+0000", 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4372000000000001e-05 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.487892+0000", 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1711000000000004e-05 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.487918+0000", 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5948999999999998e-05 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12367 4.39 4:9e5cbefe:::10000003184.00000000:head [write 1400224~76708 in=76708b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.489040+0000", 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001895393, 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023541320000000001, 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12367 2024-09-20T20:31:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.489040+0000", 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.489040+0000", 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.489043+0000", 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6900000000000001e-06 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.489113+0000", 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9444999999999997e-05 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.489141+0000", 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8053000000000001e-05 2024-09-20T20:31:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.489155+0000", 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4549000000000001e-05 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.490354+0000", 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011991390000000001 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.490466+0000", 2024-09-20T20:31:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000111302 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.490642+0000", 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017624900000000001 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 4 2024-09-20T20:31:41.509 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:7/291: dwrite d2/fb [0,4194304] 0 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:1/442: dwrite d4/d6/d11/f42 [0,4194304] 0 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:9/431: mkdir d1/df/d25/d9e 0 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:8/449: symlink d4/d27/d2a/d43/d61/la0 0 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:9/432: chown d1/df 614 1 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:2/407: dwrite d3/f4a [0,4194304] 0 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:8/450: dread - d4/db/d66/f78 zero size 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:1/443: write d4/d6/d11/d2c/d3b/f3e [414012,13117] 0 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:7/292: creat d2/d19/d25/d42/f5a x:0 0 0 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:4/447: rename d6/d7/dc/c6a to d6/d7/dc/d20/c91 0 2024-09-20T20:31:41.513 INFO:tasks.workunit.client.0.smithi070.stdout:9/433: rmdir d1/df/d18 39 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:2/408: rmdir d3/d5/d9/d10 39 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:6/429: dwrite d4/d8/d38/f7d [0,4194304] 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:8/451: creat d4/db/d64/d7b/fa1 x:0 0 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:1/444: stat d4/d6 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:5/388: dwrite d2/f79 [0,4194304] 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:4/448: mknod d6/d5e/c92 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:3/364: truncate d7/d15/d1e/f49 2803932 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:2/409: write d3/de/d12/d1a/f30 [654199,41234] 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:9/434: mkdir d1/df/d25/d69/d85/d9f 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:7/293: mknod d2/d19/d25/d42/c5b 0 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:4/449: rmdir d6/d5e 39 2024-09-20T20:31:41.514 INFO:tasks.workunit.client.0.smithi070.stdout:1/445: symlink d4/d6/d11/d2c/d3a/d78/la8 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:6/430: getdents d4/d8 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:9/435: mknod d1/df/d25/d69/d85/d9f/ca0 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:2/410: mkdir d3/d5/dd/d99 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:3/365: mknod d7/d15/d1a/d48/d66/d69/c6e 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:1/446: mkdir d4/d32/d34/d44/d4b/d87/da9 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:7/294: stat d2/d19/d25/d2a/l2f 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:7/295: chown d2/d52 429836397 1 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:3/366: symlink d7/d15/d1a/d4a/d51/l6f 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:7/296: rmdir d2/d19/d25/d2a/d4a 39 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:1/447: rename d4/d6/d11/d2c/d3b/f3d to d4/d6/d11/d63/da3/faa 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:4/450: getdents d6/d7 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:0/456: truncate d4/d8/d12/d23/d26/f33 4099726 0 2024-09-20T20:31:41.515 INFO:tasks.workunit.client.0.smithi070.stdout:6/431: truncate d4/d8/d3a/f58 1817704 0 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:3/367: getdents d7/d15/d1e 0 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:1/448: write d4/d6/d11/f24 [3393458,88722] 0 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:0/457: chown d4/d13/f76 1 1 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:6/432: chown d4/d8/d3a/f75 2392070 1 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:4/451: write d6/ff [2524264,15807] 0 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:7/297: dread d2/fb [0,4194304] 0 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:0/458: creat d4/d8/d12/d23/d26/d1d/d7e/f91 x:0 0 0 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:4/452: chown d6/f11 104152 1 2024-09-20T20:31:41.516 INFO:tasks.workunit.client.0.smithi070.stdout:5/389: write d2/d7/f9 [1659503,25279] 0 2024-09-20T20:31:41.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:6/433: truncate d4/d8/d38/f95 277390 0 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:9/436: dwrite d1/df/d18/f66 [0,4194304] 0 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:7/298: dread - d2/d30/f39 zero size 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:2/411: dwrite d3/d5/d9/d42/f59 [0,4194304] 0 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:5/390: rename d2/df/d40 to d2/df/d40/d46/d5b/d82 22 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:1/449: dread d4/d6/d26/f8d [0,4194304] 0 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:7/299: chown d2/d19/l21 392223372 1 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:8/452: dwrite d4/db/f11 [0,4194304] 0 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:6/434: creat d4/d8/d17/d33/d61/f9b x:0 0 0 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:0/459: symlink d4/d8/d12/d23/d26/d1d/d37/l92 0 2024-09-20T20:31:41.519 INFO:tasks.workunit.client.0.smithi070.stdout:9/437: unlink d1/df/d84/l9c 0 2024-09-20T20:31:41.520 INFO:tasks.workunit.client.0.smithi070.stdout:5/391: creat d2/df/d40/d46/d63/f83 x:0 0 0 2024-09-20T20:31:41.520 INFO:tasks.workunit.client.0.smithi070.stdout:8/453: dread - d4/db/d66/f78 zero size 2024-09-20T20:31:41.520 INFO:tasks.workunit.client.0.smithi070.stdout:1/450: mknod d4/d32/d34/d44/d4b/d87/da9/cab 0 2024-09-20T20:31:41.520 INFO:tasks.workunit.client.0.smithi070.stdout:6/435: creat d4/f9c x:0 0 0 2024-09-20T20:31:41.520 INFO:tasks.workunit.client.0.smithi070.stdout:8/454: chown d4/db/f11 12234353 1 2024-09-20T20:31:41.521 INFO:tasks.workunit.client.0.smithi070.stdout:6/436: sync 2024-09-20T20:31:41.521 INFO:tasks.workunit.client.0.smithi070.stdout:6/437: readlink d4/d8/d38/d50/l71 0 2024-09-20T20:31:41.522 INFO:tasks.workunit.client.0.smithi070.stdout:7/300: dread d2/f1b [0,4194304] 0 2024-09-20T20:31:41.523 INFO:tasks.workunit.client.0.smithi070.stdout:5/392: creat d2/d4/d53/d74/f84 x:0 0 0 2024-09-20T20:31:41.523 INFO:tasks.workunit.client.0.smithi070.stdout:2/412: rename d3/d5/d9/d1c/d1f/d3e/l45 to d3/d5/d9/d1c/d1f/d3e/d92/l9a 0 2024-09-20T20:31:41.523 INFO:tasks.workunit.client.0.smithi070.stdout:4/453: creat d6/d5e/d51/d78/f93 x:0 0 0 2024-09-20T20:31:41.524 INFO:tasks.workunit.client.0.smithi070.stdout:7/301: mkdir d2/d19/d25/d2a/d5c 0 2024-09-20T20:31:41.524 INFO:tasks.workunit.client.0.smithi070.stdout:1/451: unlink d4/d6/d11/d7b/c8b 0 2024-09-20T20:31:41.524 INFO:tasks.workunit.client.0.smithi070.stdout:0/460: getdents d4/d8/d55/d7c 0 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:moved 0 / 210 (0%) 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:avg 70 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:oload 110 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:max_change 1 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:max_change_osds 4 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:average_utilization 0.0011 2024-09-20T20:31:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:overload_utilization 0.0012 2024-09-20T20:31:41.526 INFO:teuthology.orchestra.run.smithi070.stderr:no change 2024-09-20T20:31:41.526 INFO:tasks.workunit.client.0.smithi070.stdout:5/393: dread - d2/df/d40/d46/d63/f83 zero size 2024-09-20T20:31:41.527 INFO:tasks.workunit.client.0.smithi070.stdout:4/454: read - d6/d43/f60 zero size 2024-09-20T20:31:41.527 INFO:tasks.workunit.client.0.smithi070.stdout:7/302: write d2/d8/f1d [771122,117760] 0 2024-09-20T20:31:41.527 INFO:tasks.workunit.client.0.smithi070.stdout:0/461: read d4/d8/d12/d23/d26/d1f/d4d/f6e [327687,40764] 0 2024-09-20T20:31:41.527 INFO:tasks.workunit.client.0.smithi070.stdout:2/413: rename d3/d5/d9/d1c/d1f/d3e to d3/d5/d9/d1c/d1f/d3e/d61/d91/d9b 22 2024-09-20T20:31:41.528 INFO:tasks.workunit.client.0.smithi070.stdout:8/455: dwrite d4/db/d66/f84 [0,4194304] 0 2024-09-20T20:31:41.530 INFO:tasks.workunit.client.0.smithi070.stdout:6/438: dread d4/d8/f1f [0,4194304] 0 2024-09-20T20:31:41.530 INFO:tasks.workunit.client.0.smithi070.stdout:0/462: write d4/d8/d12/d23/d26/f2a [146962,74249] 0 2024-09-20T20:31:41.533 INFO:tasks.workunit.client.0.smithi070.stdout:5/394: creat d2/df/f85 x:0 0 0 2024-09-20T20:31:41.533 INFO:tasks.workunit.client.0.smithi070.stdout:8/456: creat d4/d27/d2a/d3e/d39/fa2 x:0 0 0 2024-09-20T20:31:41.534 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:41.529+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:41.534 INFO:tasks.workunit.client.0.smithi070.stdout:0/463: stat d4/d8/d12/d23/d26/d1d/d37/l92 0 2024-09-20T20:31:41.534 INFO:tasks.workunit.client.0.smithi070.stdout:7/303: getdents d2/d19 0 2024-09-20T20:31:41.534 INFO:tasks.workunit.client.0.smithi070.stdout:5/395: creat d2/d4/d53/d74/f86 x:0 0 0 2024-09-20T20:31:41.536 INFO:tasks.workunit.client.0.smithi070.stdout:7/304: dread - d2/d30/f39 zero size 2024-09-20T20:31:41.536 INFO:tasks.workunit.client.0.smithi070.stdout:1/452: dwrite d4/d6/f14 [0,4194304] 0 2024-09-20T20:31:41.539 INFO:tasks.workunit.client.0.smithi070.stdout:9/438: dwrite d1/df/d18/d46/f63 [0,4194304] 0 2024-09-20T20:31:41.539 INFO:tasks.workunit.client.0.smithi070.stdout:6/439: truncate d4/f13 4523744 0 2024-09-20T20:31:41.539 INFO:tasks.workunit.client.0.smithi070.stdout:5/396: creat d2/df/d40/d46/f87 x:0 0 0 2024-09-20T20:31:41.539 INFO:tasks.workunit.client.0.smithi070.stdout:2/414: dwrite d3/de/d12/d1a/f21 [4194304,4194304] 0 2024-09-20T20:31:41.539 INFO:tasks.workunit.client.0.smithi070.stdout:8/457: fdatasync d4/db/f11 0 2024-09-20T20:31:41.540 INFO:tasks.workunit.client.0.smithi070.stdout:6/440: truncate d4/d8/d10/f88 611537 0 2024-09-20T20:31:41.540 INFO:tasks.workunit.client.0.smithi070.stdout:9/439: truncate d1/df/d18/d44/f98 363011 0 2024-09-20T20:31:41.542 INFO:tasks.workunit.client.0.smithi070.stdout:9/440: readlink d1/d76/l5d 0 2024-09-20T20:31:41.543 INFO:tasks.workunit.client.0.smithi070.stdout:0/464: unlink d4/d8/d12/d23/d26/d1d/d37/f4c 0 2024-09-20T20:31:41.543 INFO:tasks.workunit.client.0.smithi070.stdout:7/305: rmdir d2/d19/d25/d2a 39 2024-09-20T20:31:41.543 INFO:tasks.workunit.client.0.smithi070.stdout:6/441: mknod d4/d8/d3a/c9d 0 2024-09-20T20:31:41.543 INFO:tasks.workunit.client.0.smithi070.stdout:1/453: mknod d4/d6/d11/d2c/cac 0 2024-09-20T20:31:41.544 INFO:tasks.workunit.client.0.smithi070.stdout:8/458: mknod d4/d27/d2a/d3e/ca3 0 2024-09-20T20:31:41.544 INFO:tasks.workunit.client.0.smithi070.stdout:7/306: chown d2/d8/l23 1750210 1 2024-09-20T20:31:41.545 INFO:tasks.workunit.client.0.smithi070.stdout:4/455: dwrite d6/d26/f87 [0,4194304] 0 2024-09-20T20:31:41.545 INFO:tasks.workunit.client.0.smithi070.stdout:2/415: truncate d3/f75 3379913 0 2024-09-20T20:31:41.545 INFO:tasks.workunit.client.0.smithi070.stdout:3/368: dread f0 [0,4194304] 0 2024-09-20T20:31:41.545 INFO:tasks.workunit.client.0.smithi070.stdout:8/459: fdatasync d4/db/d64/f93 0 2024-09-20T20:31:41.546 INFO:tasks.workunit.client.0.smithi070.stdout:3/369: chown d7/d15/d1a/d48/d66/d69/d13/d1d/l35 5323 1 2024-09-20T20:31:41.548 INFO:tasks.workunit.client.0.smithi070.stdout:9/441: getdents d1/df/d38 0 2024-09-20T20:31:41.548 INFO:tasks.workunit.client.0.smithi070.stdout:1/454: symlink d4/d6/d11/d63/da3/lad 0 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:8/460: unlink d4/d27/d2a/f21 0 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:4/456: truncate d6/d5e/d75/f88 542619 0 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:6/442: creat d4/d8/d10/d54/d7a/f9e x:0 0 0 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:9/442: fsync d1/df/d2d/f65 0 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:1/455: chown d4/d32/d34/d44/d48/f58 105270 1 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:6/443: stat d4/d8/d1e/l7b 0 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:3/370: chown d7/d15/d1a/d48/d66/d69/d13/f26 1456 1 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:4/457: symlink d6/d7/dc/d4a/l94 0 2024-09-20T20:31:41.549 INFO:tasks.workunit.client.0.smithi070.stdout:6/444: stat d4/d8/d38/d50/l60 0 2024-09-20T20:31:41.551 INFO:tasks.workunit.client.0.smithi070.stdout:8/461: mknod d4/d27/d42/ca4 0 2024-09-20T20:31:41.551 INFO:tasks.workunit.client.0.smithi070.stdout:7/307: rename d2/d19/d25/d2a/f56 to d2/d19/d25/d2a/d5c/f5d 0 2024-09-20T20:31:41.551 INFO:tasks.workunit.client.0.smithi070.stdout:3/371: creat d7/d15/d1a/d48/d57/f70 x:0 0 0 2024-09-20T20:31:41.552 INFO:tasks.workunit.client.0.smithi070.stdout:1/456: getdents d4/d6 0 2024-09-20T20:31:41.553 INFO:tasks.workunit.client.0.smithi070.stdout:3/372: mkdir d7/d71 0 2024-09-20T20:31:41.553 INFO:tasks.workunit.client.0.smithi070.stdout:8/462: unlink d4/c15 0 2024-09-20T20:31:41.554 INFO:tasks.workunit.client.0.smithi070.stdout:1/457: mkdir d4/d6/dae 0 2024-09-20T20:31:41.555 INFO:tasks.workunit.client.0.smithi070.stdout:3/373: chown d7/d15/l4b 925 1 2024-09-20T20:31:41.556 INFO:tasks.workunit.client.0.smithi070.stdout:1/458: dread - d4/d32/d34/d44/f55 zero size 2024-09-20T20:31:41.557 INFO:tasks.workunit.client.0.smithi070.stdout:9/443: dwrite d1/df/d2d/f94 [0,4194304] 0 2024-09-20T20:31:41.558 INFO:tasks.workunit.client.0.smithi070.stdout:9/444: stat d1/df/l15 0 2024-09-20T20:31:41.559 INFO:tasks.workunit.client.0.smithi070.stdout:4/458: dwrite d6/d5e/d75/f21 [0,4194304] 0 2024-09-20T20:31:41.559 INFO:tasks.workunit.client.0.smithi070.stdout:6/445: dwrite d4/d8/d17/f42 [0,4194304] 0 2024-09-20T20:31:41.560 INFO:tasks.workunit.client.0.smithi070.stdout:9/445: mknod d1/df/d18/d44/ca1 0 2024-09-20T20:31:41.560 INFO:tasks.workunit.client.0.smithi070.stdout:4/459: rmdir d6/d26/d69 39 2024-09-20T20:31:41.561 INFO:tasks.workunit.client.0.smithi070.stdout:6/446: stat d4/d8/d10/d3c/c43 0 2024-09-20T20:31:41.561 INFO:tasks.workunit.client.0.smithi070.stdout:6/447: creat d4/d8/d3a/f9f x:0 0 0 2024-09-20T20:31:41.561 INFO:tasks.workunit.client.0.smithi070.stdout:9/446: mkdir d1/df/d18/d44/da2 0 2024-09-20T20:31:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:6/448: symlink d4/d8/d1e/la0 0 2024-09-20T20:31:41.562 INFO:tasks.workunit.client.0.smithi070.stdout:9/447: write d1/df/d18/d44/d77/f99 [80555,126017] 0 2024-09-20T20:31:41.564 INFO:tasks.workunit.client.0.smithi070.stdout:6/449: getdents d4/d8/d10/d54/d55 0 2024-09-20T20:31:41.565 INFO:tasks.workunit.client.0.smithi070.stdout:5/397: truncate d2/d4/f1e 164491 0 2024-09-20T20:31:41.565 INFO:tasks.workunit.client.0.smithi070.stdout:9/448: truncate d1/df/d18/d44/d77/f99 621101 0 2024-09-20T20:31:41.565 INFO:tasks.workunit.client.0.smithi070.stdout:6/450: symlink d4/d8/d10/d54/la1 0 2024-09-20T20:31:41.566 INFO:tasks.workunit.client.0.smithi070.stdout:9/449: creat d1/df/d38/fa3 x:0 0 0 2024-09-20T20:31:41.566 INFO:tasks.workunit.client.0.smithi070.stdout:2/416: dread d3/d5/dd/f63 [0,4194304] 0 2024-09-20T20:31:41.567 INFO:tasks.workunit.client.0.smithi070.stdout:5/398: getdents d2/df/d77 0 2024-09-20T20:31:41.567 INFO:tasks.workunit.client.0.smithi070.stdout:9/450: truncate d1/df/f6c 1383729 0 2024-09-20T20:31:41.567 INFO:tasks.workunit.client.0.smithi070.stdout:7/308: truncate d2/d19/f27 2336913 0 2024-09-20T20:31:41.567 INFO:tasks.workunit.client.0.smithi070.stdout:6/451: unlink d4/d8/d1e/d7e/f9a 0 2024-09-20T20:31:41.567 INFO:tasks.workunit.client.0.smithi070.stdout:2/417: mknod d3/d5/d9/d1c/d47/d7e/c9c 0 2024-09-20T20:31:41.568 INFO:tasks.workunit.client.0.smithi070.stdout:7/309: creat d2/d52/f5e x:0 0 0 2024-09-20T20:31:41.568 INFO:tasks.workunit.client.0.smithi070.stdout:7/310: readlink d2/d8/l46 0 2024-09-20T20:31:41.569 INFO:tasks.workunit.client.0.smithi070.stdout:1/459: read d4/d6/d11/d9e/f93 [177489,42559] 0 2024-09-20T20:31:41.569 INFO:tasks.workunit.client.0.smithi070.stdout:3/374: dread d7/d15/f4f [0,4194304] 0 2024-09-20T20:31:41.569 INFO:tasks.workunit.client.0.smithi070.stdout:2/418: getdents d3/d5/d9/d1c 0 2024-09-20T20:31:41.570 INFO:tasks.workunit.client.0.smithi070.stdout:7/311: rename d2/d8/f16 to d2/d19/d25/d2a/f5f 0 2024-09-20T20:31:41.571 INFO:tasks.workunit.client.0.smithi070.stdout:6/452: symlink d4/d8/d10/d54/d64/la2 0 2024-09-20T20:31:41.571 INFO:tasks.workunit.client.0.smithi070.stdout:3/375: fsync d7/d15/d1a/d48/d66/d69/d13/d1d/f41 0 2024-09-20T20:31:41.571 INFO:tasks.workunit.client.0.smithi070.stdout:2/419: symlink d3/d5/d9/d1c/d1f/d3e/d61/l9d 0 2024-09-20T20:31:41.571 INFO:tasks.workunit.client.0.smithi070.stdout:7/312: unlink d2/d8/l17 0 2024-09-20T20:31:41.573 INFO:tasks.workunit.client.0.smithi070.stdout:2/420: symlink d3/d4c/d5c/d86/l9e 0 2024-09-20T20:31:41.574 INFO:tasks.workunit.client.0.smithi070.stdout:2/421: unlink d3/de/d12/d1a/c6c 0 2024-09-20T20:31:41.575 INFO:tasks.workunit.client.0.smithi070.stdout:9/451: dwrite d1/df/d18/d46/f6b [0,4194304] 0 2024-09-20T20:31:41.577 INFO:tasks.workunit.client.0.smithi070.stdout:2/422: read - d3/d5/d9/d1c/d47/d7e/f84 zero size 2024-09-20T20:31:41.578 INFO:tasks.workunit.client.0.smithi070.stdout:9/452: creat d1/df/d25/d9e/fa4 x:0 0 0 2024-09-20T20:31:41.578 INFO:tasks.workunit.client.0.smithi070.stdout:1/460: dwrite d4/f15 [0,4194304] 0 2024-09-20T20:31:41.578 INFO:tasks.workunit.client.0.smithi070.stdout:7/313: dread d2/f1b [0,4194304] 0 2024-09-20T20:31:41.579 INFO:tasks.workunit.client.0.smithi070.stdout:4/460: dwrite d6/d5e/d75/f88 [0,4194304] 0 2024-09-20T20:31:41.580 INFO:tasks.workunit.client.0.smithi070.stdout:3/376: dwrite d7/d15/d1e/d65/f3c [0,4194304] 0 2024-09-20T20:31:41.580 INFO:tasks.workunit.client.0.smithi070.stdout:4/461: write d6/d5e/d51/d78/f93 [935620,20543] 0 2024-09-20T20:31:41.583 INFO:tasks.workunit.client.0.smithi070.stdout:6/453: truncate d4/d8/d10/f45 185030 0 2024-09-20T20:31:41.584 INFO:tasks.workunit.client.0.smithi070.stdout:1/461: rename d4/d32/f72 to d4/d32/d34/d44/d5a/faf 0 2024-09-20T20:31:41.584 INFO:tasks.workunit.client.0.smithi070.stdout:7/314: fsync d2/f1b 0 2024-09-20T20:31:41.586 INFO:tasks.workunit.client.0.smithi070.stdout:7/315: readlink d2/d19/l2b 0 2024-09-20T20:31:41.586 INFO:tasks.workunit.client.0.smithi070.stdout:1/462: mkdir d4/d6/d11/d2c/d3a/d78/db0 0 2024-09-20T20:31:41.586 INFO:tasks.workunit.client.0.smithi070.stdout:7/316: chown d2/d8/c5 7792182 1 2024-09-20T20:31:41.587 INFO:tasks.workunit.client.0.smithi070.stdout:2/423: dwrite d3/f4a [0,4194304] 0 2024-09-20T20:31:41.588 INFO:tasks.workunit.client.0.smithi070.stdout:7/317: chown d2/d19/d25/f36 10461 1 2024-09-20T20:31:41.588 INFO:tasks.workunit.client.0.smithi070.stdout:1/463: creat d4/d6/d11/d7b/fb1 x:0 0 0 2024-09-20T20:31:41.589 INFO:tasks.workunit.client.0.smithi070.stdout:7/318: unlink f1 0 2024-09-20T20:31:41.590 INFO:tasks.workunit.client.0.smithi070.stdout:4/462: dread d6/d26/d69/d71/f79 [0,4194304] 0 2024-09-20T20:31:41.590 INFO:tasks.workunit.client.0.smithi070.stdout:9/453: dwrite d1/df/d18/d46/f8f [0,4194304] 0 2024-09-20T20:31:41.592 INFO:tasks.workunit.client.0.smithi070.stdout:1/464: truncate d4/d6/f21 961649 0 2024-09-20T20:31:41.592 INFO:tasks.workunit.client.0.smithi070.stdout:9/454: mknod d1/df/d38/ca5 0 2024-09-20T20:31:41.593 INFO:tasks.workunit.client.0.smithi070.stdout:2/424: dread d3/d5/f34 [0,4194304] 0 2024-09-20T20:31:41.593 INFO:tasks.workunit.client.0.smithi070.stdout:4/463: creat d6/d5e/f95 x:0 0 0 2024-09-20T20:31:41.593 INFO:tasks.workunit.client.0.smithi070.stdout:1/465: stat d4/d6/d11/d2c/d3b/f94 0 2024-09-20T20:31:41.593 INFO:tasks.workunit.client.0.smithi070.stdout:7/319: chown d2/d19/d25/d2a/c50 0 1 2024-09-20T20:31:41.593 INFO:tasks.workunit.client.0.smithi070.stdout:9/455: mknod d1/df/d25/d9e/ca6 0 2024-09-20T20:31:41.595 INFO:tasks.workunit.client.0.smithi070.stdout:2/425: getdents d3/d5/d9/d42 0 2024-09-20T20:31:41.596 INFO:tasks.workunit.client.0.smithi070.stdout:2/426: unlink d3/d5/d9/d1c/d1f/d3e/c40 0 2024-09-20T20:31:41.596 INFO:tasks.workunit.client.0.smithi070.stdout:1/466: dread d4/d6/d11/d63/da3/faa [0,4194304] 0 2024-09-20T20:31:41.597 INFO:tasks.workunit.client.0.smithi070.stdout:7/320: dread d2/f1b [0,4194304] 0 2024-09-20T20:31:41.597 INFO:tasks.workunit.client.0.smithi070.stdout:1/467: creat d4/d1f/fb2 x:0 0 0 2024-09-20T20:31:41.597 INFO:tasks.workunit.client.0.smithi070.stdout:4/464: read d6/d7/dc/f46 [2551896,116061] 0 2024-09-20T20:31:41.598 INFO:tasks.workunit.client.0.smithi070.stdout:1/468: readlink d4/d6/d11/d2c/l50 0 2024-09-20T20:31:41.599 INFO:tasks.workunit.client.0.smithi070.stdout:7/321: rename d2/d19/d25/d2a/d4a/f4b to d2/d19/d2e/f60 0 2024-09-20T20:31:41.600 INFO:tasks.workunit.client.0.smithi070.stdout:7/322: readlink d2/d19/d25/d2a/l2f 0 2024-09-20T20:31:41.600 INFO:tasks.workunit.client.0.smithi070.stdout:1/469: getdents d4 0 2024-09-20T20:31:41.601 INFO:tasks.workunit.client.0.smithi070.stdout:0/465: dread d4/d8/d12/f86 [0,4194304] 0 2024-09-20T20:31:41.601 INFO:tasks.workunit.client.0.smithi070.stdout:1/470: chown d4/d6/l4a 3756 1 2024-09-20T20:31:41.601 INFO:tasks.workunit.client.0.smithi070.stdout:7/323: mkdir d2/d19/d25/d61 0 2024-09-20T20:31:41.602 INFO:tasks.workunit.client.0.smithi070.stdout:0/466: stat d4/d8/d12/d23/d26/d1d/d37/l92 0 2024-09-20T20:31:41.602 INFO:tasks.workunit.client.0.smithi070.stdout:7/324: unlink d2/d8/l3c 0 2024-09-20T20:31:41.603 INFO:tasks.workunit.client.0.smithi070.stdout:1/471: rename d4/d6/d11/d2c/d3a/c43 to d4/d32/cb3 0 2024-09-20T20:31:41.603 INFO:tasks.workunit.client.0.smithi070.stdout:0/467: unlink d4/d19/f71 0 2024-09-20T20:31:41.604 INFO:tasks.workunit.client.0.smithi070.stdout:2/427: dwrite d3/d5/d9/f48 [4194304,4194304] 0 2024-09-20T20:31:41.604 INFO:tasks.workunit.client.0.smithi070.stdout:1/472: chown d4/d32/d34/d44/d4b/d87 276181 1 2024-09-20T20:31:41.605 INFO:tasks.workunit.client.0.smithi070.stdout:7/325: creat d2/d19/d25/d2a/d4a/f62 x:0 0 0 2024-09-20T20:31:41.605 INFO:tasks.workunit.client.0.smithi070.stdout:0/468: write d4/d8/f30 [3136948,57965] 0 2024-09-20T20:31:41.605 INFO:tasks.workunit.client.0.smithi070.stdout:3/377: dwrite d7/d15/d1a/d48/d66/d69/f33 [0,4194304] 0 2024-09-20T20:31:41.605 INFO:tasks.workunit.client.0.smithi070.stdout:2/428: stat d3/d5/d9/d42/f93 0 2024-09-20T20:31:41.606 INFO:tasks.workunit.client.0.smithi070.stdout:2/429: stat d3/de/d12/d1a/f46 0 2024-09-20T20:31:41.607 INFO:tasks.workunit.client.0.smithi070.stdout:2/430: write d3/d5/d9/f29 [400933,97836] 0 2024-09-20T20:31:41.608 INFO:tasks.workunit.client.0.smithi070.stdout:0/469: unlink d4/d8/d12/d23/d26/d1f/d2e/l35 0 2024-09-20T20:31:41.608 INFO:tasks.workunit.client.0.smithi070.stdout:1/473: mkdir d4/d32/d34/d44/d4b/d87/da9/db4 0 2024-09-20T20:31:41.608 INFO:tasks.workunit.client.0.smithi070.stdout:3/378: rename d7/d15/d1a/d48/d66/d69/d13/d5a to d7/d15/d1a/d48/d66/d69/d13/d72 0 2024-09-20T20:31:41.608 INFO:tasks.workunit.client.0.smithi070.stdout:0/470: fsync f2 0 2024-09-20T20:31:41.608 INFO:tasks.workunit.client.0.smithi070.stdout:7/326: fdatasync d2/f26 0 2024-09-20T20:31:41.610 INFO:tasks.workunit.client.0.smithi070.stdout:0/471: stat d4/d8/d12/d23/d26/d1d/d37 0 2024-09-20T20:31:41.610 INFO:tasks.workunit.client.0.smithi070.stdout:3/379: write d7/d15/d1a/d48/d66/d69/f42 [497369,85787] 0 2024-09-20T20:31:41.611 INFO:tasks.workunit.client.0.smithi070.stdout:0/472: dread - d4/d19/d82/f8b zero size 2024-09-20T20:31:41.613 INFO:tasks.workunit.client.0.smithi070.stdout:6/454: dwrite d4/d8/d10/f45 [0,4194304] 0 2024-09-20T20:31:41.613 INFO:tasks.workunit.client.0.smithi070.stdout:4/465: dwrite d6/d7/f59 [0,4194304] 0 2024-09-20T20:31:41.614 INFO:tasks.workunit.client.0.smithi070.stdout:4/466: chown d6/d7/dc/d4a/d81 1451991357 1 2024-09-20T20:31:41.616 INFO:tasks.workunit.client.0.smithi070.stdout:0/473: creat d4/d48/d7b/d8c/f93 x:0 0 0 2024-09-20T20:31:41.618 INFO:tasks.workunit.client.0.smithi070.stdout:1/474: dwrite d4/d6/d2f/f8c [0,4194304] 0 2024-09-20T20:31:41.618 INFO:tasks.workunit.client.0.smithi070.stdout:2/431: dwrite f2 [8388608,4194304] 0 2024-09-20T20:31:41.619 INFO:tasks.workunit.client.0.smithi070.stdout:2/432: write d3/de/f6d [3636314,115366] 0 2024-09-20T20:31:41.620 INFO:tasks.workunit.client.0.smithi070.stdout:3/380: dwrite d7/d15/d1a/d48/d66/d69/f39 [0,4194304] 0 2024-09-20T20:31:41.622 INFO:tasks.workunit.client.0.smithi070.stdout:4/467: creat d6/d5e/d75/d61/f96 x:0 0 0 2024-09-20T20:31:41.623 INFO:tasks.workunit.client.0.smithi070.stdout:6/455: dwrite d4/d8/f4f [0,4194304] 0 2024-09-20T20:31:41.623 INFO:tasks.workunit.client.0.smithi070.stdout:0/474: mknod d4/d8/d12/d23/d26/d1d/c94 0 2024-09-20T20:31:41.623 INFO:tasks.workunit.client.0.smithi070.stdout:3/381: chown d7/d15/d1a/d48/d66/d69/f24 163811 1 2024-09-20T20:31:41.624 INFO:tasks.workunit.client.0.smithi070.stdout:6/456: symlink d4/la3 0 2024-09-20T20:31:41.624 INFO:tasks.workunit.client.0.smithi070.stdout:1/475: link d4/d6/l20 d4/lb5 0 2024-09-20T20:31:41.624 INFO:tasks.workunit.client.0.smithi070.stdout:4/468: truncate d6/d5e/d51/d63/f8c 940979 0 2024-09-20T20:31:41.624 INFO:tasks.workunit.client.0.smithi070.stdout:0/475: write d4/d13/f6b [1004643,119556] 0 2024-09-20T20:31:41.625 INFO:tasks.workunit.client.0.smithi070.stdout:0/476: chown f2 0 1 2024-09-20T20:31:41.625 INFO:tasks.workunit.client.0.smithi070.stdout:3/382: creat d7/d15/d1a/d48/d66/d69/d13/d72/f73 x:0 0 0 2024-09-20T20:31:41.626 INFO:tasks.workunit.client.0.smithi070.stdout:0/477: write d4/d8/d12/d23/d26/d1d/d37/d38/f63 [779924,82594] 0 2024-09-20T20:31:41.626 INFO:tasks.workunit.client.0.smithi070.stdout:3/383: chown d7/d15/d1e/d60 171 1 2024-09-20T20:31:41.628 INFO:tasks.workunit.client.0.smithi070.stdout:3/384: rmdir d7/d15/d1e/d65 39 2024-09-20T20:31:41.629 INFO:tasks.workunit.client.0.smithi070.stdout:3/385: getdents d7/d71 0 2024-09-20T20:31:41.630 INFO:tasks.workunit.client.0.smithi070.stdout:4/469: dwrite d6/d5e/d75/f2e [4194304,4194304] 0 2024-09-20T20:31:41.631 INFO:tasks.workunit.client.0.smithi070.stdout:3/386: symlink d7/d15/d1a/l74 0 2024-09-20T20:31:41.632 INFO:tasks.workunit.client.0.smithi070.stdout:4/470: stat d6/d26/d69/d71/f6d 0 2024-09-20T20:31:41.632 INFO:tasks.workunit.client.0.smithi070.stdout:3/387: write d7/d15/f4f [808857,35461] 0 2024-09-20T20:31:41.634 INFO:tasks.workunit.client.0.smithi070.stdout:0/478: dwrite d4/f88 [0,4194304] 0 2024-09-20T20:31:41.634 INFO:tasks.workunit.client.0.smithi070.stdout:4/471: unlink d6/d5e/d75/f18 0 2024-09-20T20:31:41.634 INFO:tasks.workunit.client.0.smithi070.stdout:3/388: mkdir d7/d15/d1a/d48/d57/d75 0 2024-09-20T20:31:41.635 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:41.627+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:41.635 INFO:tasks.workunit.client.0.smithi070.stdout:4/472: chown d6/d26/d69/d71/d4c/d50 48887989 1 2024-09-20T20:31:41.635 INFO:tasks.workunit.client.0.smithi070.stdout:3/389: stat d7/d15/d1e/f49 0 2024-09-20T20:31:41.636 INFO:tasks.workunit.client.0.smithi070.stdout:0/479: write d4/d8/d12/d23/d26/d1d/d37/d3e/f83 [5151101,15302] 0 2024-09-20T20:31:41.636 INFO:tasks.workunit.client.0.smithi070.stdout:0/480: dread - d4/d19/d5b/f5f zero size 2024-09-20T20:31:41.636 INFO:tasks.workunit.client.0.smithi070.stdout:3/390: write d7/d15/d1a/d48/d66/d69/fc [2414977,100463] 0 2024-09-20T20:31:41.637 INFO:tasks.workunit.client.0.smithi070.stdout:0/481: truncate d4/d48/f72 70641 0 2024-09-20T20:31:41.637 INFO:tasks.workunit.client.0.smithi070.stdout:3/391: dread - d7/d15/d1a/d4a/f4d zero size 2024-09-20T20:31:41.638 INFO:tasks.workunit.client.0.smithi070.stdout:3/392: fsync f4 0 2024-09-20T20:31:41.638 INFO:tasks.workunit.client.0.smithi070.stdout:0/482: chown d4/f62 3 1 2024-09-20T20:31:41.639 INFO:tasks.workunit.client.0.smithi070.stdout:3/393: symlink d7/d15/d1e/l76 0 2024-09-20T20:31:41.640 INFO:tasks.workunit.client.0.smithi070.stdout:2/433: dwrite d3/f75 [0,4194304] 0 2024-09-20T20:31:41.642 INFO:tasks.workunit.client.0.smithi070.stdout:3/394: link d7/d15/d1a/d4a/d51/l6b d7/d15/d1a/d48/d66/d69/d13/d72/l77 0 2024-09-20T20:31:41.642 INFO:tasks.workunit.client.0.smithi070.stdout:2/434: mkdir d3/de/d9f 0 2024-09-20T20:31:41.642 INFO:tasks.workunit.client.0.smithi070.stdout:4/473: write d6/f6f [5478072,34654] 0 2024-09-20T20:31:41.643 INFO:tasks.workunit.client.0.smithi070.stdout:3/395: creat d7/d15/d1a/f78 x:0 0 0 2024-09-20T20:31:41.643 INFO:tasks.workunit.client.0.smithi070.stdout:2/435: write d3/de/d12/d1a/f46 [385290,124733] 0 2024-09-20T20:31:41.644 INFO:tasks.workunit.client.0.smithi070.stdout:4/474: mkdir d6/d26/d97 0 2024-09-20T20:31:41.644 INFO:tasks.workunit.client.0.smithi070.stdout:4/475: fdatasync d6/d7/dc/f4b 0 2024-09-20T20:31:41.645 INFO:tasks.workunit.client.0.smithi070.stdout:2/436: symlink d3/d5/dd/la0 0 2024-09-20T20:31:41.645 INFO:tasks.workunit.client.0.smithi070.stdout:3/396: symlink d7/d15/d1e/d65/l79 0 2024-09-20T20:31:41.645 INFO:tasks.workunit.client.0.smithi070.stdout:0/483: dwrite d4/d13/f6b [0,4194304] 0 2024-09-20T20:31:41.646 INFO:tasks.workunit.client.0.smithi070.stdout:8/463: sync 2024-09-20T20:31:41.646 INFO:tasks.workunit.client.0.smithi070.stdout:0/484: creat d4/d19/f95 x:0 0 0 2024-09-20T20:31:41.647 INFO:tasks.workunit.client.0.smithi070.stdout:0/485: creat d4/d8/d12/d23/d26/d2d/f96 x:0 0 0 2024-09-20T20:31:41.648 INFO:tasks.workunit.client.0.smithi070.stdout:8/464: rename d4/d27/d73/d87/d8a to d4/db/d64/d95/da5 0 2024-09-20T20:31:41.649 INFO:tasks.workunit.client.0.smithi070.stdout:0/486: rename d4/d19/d82/f8b to d4/d8/d12/d23/d26/d1d/d41/f97 0 2024-09-20T20:31:41.649 INFO:tasks.workunit.client.0.smithi070.stdout:8/465: write d4/d27/d2a/f1c [1361752,123635] 0 2024-09-20T20:31:41.650 INFO:tasks.workunit.client.0.smithi070.stdout:8/466: mkdir d4/d27/d2a/d5b/d6c/da6 0 2024-09-20T20:31:41.651 INFO:tasks.workunit.client.0.smithi070.stdout:8/467: chown d4/d27/d2a/d43/d61/la0 66 1 2024-09-20T20:31:41.651 INFO:tasks.workunit.client.0.smithi070.stdout:2/437: dwrite d3/d5/d9/d10/f11 [0,4194304] 0 2024-09-20T20:31:41.652 INFO:tasks.workunit.client.0.smithi070.stdout:8/468: symlink d4/la7 0 2024-09-20T20:31:41.653 INFO:tasks.workunit.client.0.smithi070.stdout:8/469: creat d4/d27/d2a/d5b/d98/fa8 x:0 0 0 2024-09-20T20:31:41.654 INFO:tasks.workunit.client.0.smithi070.stdout:2/438: link d3/c72 d3/d5/d9/d1c/d1f/ca1 0 2024-09-20T20:31:41.654 INFO:tasks.workunit.client.0.smithi070.stdout:3/397: getdents d7/d15/d1a 0 2024-09-20T20:31:41.654 INFO:tasks.workunit.client.0.smithi070.stdout:8/470: write d4/db/d66/f84 [6409253,94149] 0 2024-09-20T20:31:41.655 INFO:tasks.workunit.client.0.smithi070.stdout:2/439: creat d3/d4c/d5c/fa2 x:0 0 0 2024-09-20T20:31:41.655 INFO:tasks.workunit.client.0.smithi070.stdout:0/487: dwrite d4/d13/f61 [0,4194304] 0 2024-09-20T20:31:41.655 INFO:tasks.workunit.client.0.smithi070.stdout:3/398: mkdir d7/d15/d1a/d48/d66/d69/d13/d7a 0 2024-09-20T20:31:41.656 INFO:tasks.workunit.client.0.smithi070.stdout:2/440: chown d3/de/d12/d1a/l8f 21 1 2024-09-20T20:31:41.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/471: truncate d4/db/d64/f93 8234436 0 2024-09-20T20:31:41.657 INFO:tasks.workunit.client.0.smithi070.stdout:3/399: chown d7/d15/d1a/d48/d66/d69/d13/d1d/c22 127773270 1 2024-09-20T20:31:41.657 INFO:tasks.workunit.client.0.smithi070.stdout:8/472: write d4/db/f1b [1404508,29178] 0 2024-09-20T20:31:41.657 INFO:tasks.workunit.client.0.smithi070.stdout:2/441: write d3/d5/dd/d5a/f5f [964317,94135] 0 2024-09-20T20:31:41.658 INFO:tasks.workunit.client.0.smithi070.stdout:8/473: chown f0 1418 1 2024-09-20T20:31:41.658 INFO:tasks.workunit.client.0.smithi070.stdout:8/474: unlink d4/c3c 0 2024-09-20T20:31:41.659 INFO:tasks.workunit.client.0.smithi070.stdout:3/400: truncate d7/d15/d1a/d48/f50 1015010 0 2024-09-20T20:31:41.659 INFO:tasks.workunit.client.0.smithi070.stdout:3/401: chown d7/d15/d1a/d48/d66 55858787 1 2024-09-20T20:31:41.661 INFO:tasks.workunit.client.0.smithi070.stdout:3/402: readlink d7/d15/d1a/d4a/d51/l6b 0 2024-09-20T20:31:41.662 INFO:tasks.workunit.client.0.smithi070.stdout:0/488: dwrite d4/d8/d12/d23/d26/d1d/d37/d38/f74 [0,4194304] 0 2024-09-20T20:31:41.662 INFO:tasks.workunit.client.0.smithi070.stdout:3/403: creat d7/d15/d1a/d48/d66/d69/d13/d1d/f7b x:0 0 0 2024-09-20T20:31:41.663 INFO:tasks.workunit.client.0.smithi070.stdout:0/489: write d4/d48/d7b/d8c/f93 [343426,1401] 0 2024-09-20T20:31:41.663 INFO:tasks.workunit.client.0.smithi070.stdout:2/442: dread d3/de/f39 [0,4194304] 0 2024-09-20T20:31:41.664 INFO:tasks.workunit.client.0.smithi070.stdout:0/490: creat d4/d1b/f98 x:0 0 0 2024-09-20T20:31:41.664 INFO:tasks.workunit.client.0.smithi070.stdout:2/443: chown d3/de/d12/d1a/f30 78 1 2024-09-20T20:31:41.665 INFO:tasks.workunit.client.0.smithi070.stdout:2/444: mknod d3/de/d12/d1a/ca3 0 2024-09-20T20:31:41.666 INFO:tasks.workunit.client.0.smithi070.stdout:2/445: stat d3/d5/d9/d10/f52 0 2024-09-20T20:31:41.666 INFO:tasks.workunit.client.0.smithi070.stdout:0/491: link d4/d8/d12/l1a d4/d8/d12/d23/d26/d1d/d37/l99 0 2024-09-20T20:31:41.667 INFO:tasks.workunit.client.0.smithi070.stdout:0/492: link d4/d8/d12/d23/d26/c2f d4/d13/c9a 0 2024-09-20T20:31:41.668 INFO:tasks.workunit.client.0.smithi070.stdout:0/493: chown d4/d8/d12/d23/d26/f33 218094 1 2024-09-20T20:31:41.669 INFO:tasks.workunit.client.0.smithi070.stdout:0/494: mkdir d4/d8/d12/d43/d9b 0 2024-09-20T20:31:41.674 INFO:tasks.workunit.client.0.smithi070.stdout:0/495: dwrite d4/d19/f45 [0,4194304] 0 2024-09-20T20:31:41.674 INFO:tasks.workunit.client.0.smithi070.stdout:8/475: dread d4/d27/d2a/d3e/f56 [0,4194304] 0 2024-09-20T20:31:41.676 INFO:tasks.workunit.client.0.smithi070.stdout:2/446: read d3/d5/d9/f29 [976529,31731] 0 2024-09-20T20:31:41.677 INFO:tasks.workunit.client.0.smithi070.stdout:2/447: rename d3/d5/d9/d1c/d1f/d3e/d61/d91 to d3/d5/d9/d1c/d4e/da4 0 2024-09-20T20:31:41.678 INFO:tasks.workunit.client.0.smithi070.stdout:2/448: symlink d3/d5/d9/d79/la5 0 2024-09-20T20:31:41.681 INFO:tasks.workunit.client.0.smithi070.stdout:0/496: dwrite d4/d8/d12/d23/d26/d2d/f6c [0,4194304] 0 2024-09-20T20:31:41.683 INFO:tasks.workunit.client.0.smithi070.stdout:8/476: dwrite d4/db/f11 [0,4194304] 0 2024-09-20T20:31:41.684 INFO:tasks.workunit.client.0.smithi070.stdout:0/497: link d4/d48/d4e/d81/f84 d4/d8/d12/d43/d9b/f9c 0 2024-09-20T20:31:41.684 INFO:tasks.workunit.client.0.smithi070.stdout:8/477: chown d4/db/d64/d7b/fa1 73 1 2024-09-20T20:31:41.685 INFO:tasks.workunit.client.0.smithi070.stdout:8/478: mkdir d4/d27/d2a/d5b/d98/da9 0 2024-09-20T20:31:41.686 INFO:tasks.workunit.client.0.smithi070.stdout:2/449: dwrite d3/d5/d9/f29 [0,4194304] 0 2024-09-20T20:31:41.687 INFO:tasks.workunit.client.0.smithi070.stdout:8/479: link d4/db/c5f d4/db/d64/d95/da5/caa 0 2024-09-20T20:31:41.687 INFO:tasks.workunit.client.0.smithi070.stdout:2/450: stat d3/de/d12/l27 0 2024-09-20T20:31:41.687 INFO:tasks.workunit.client.0.smithi070.stdout:8/480: unlink d4/d27/d2a/d5b/f85 0 2024-09-20T20:31:41.687 INFO:tasks.workunit.client.0.smithi070.stdout:2/451: rmdir d3/d4c/d5c/d86 39 2024-09-20T20:31:41.688 INFO:tasks.workunit.client.0.smithi070.stdout:2/452: symlink d3/d5/d9/la6 0 2024-09-20T20:31:41.688 INFO:tasks.workunit.client.0.smithi070.stdout:8/481: creat d4/db/d64/d95/da5/fab x:0 0 0 2024-09-20T20:31:41.689 INFO:tasks.workunit.client.0.smithi070.stdout:8/482: readlink d4/lc 0 2024-09-20T20:31:41.690 INFO:tasks.workunit.client.0.smithi070.stdout:2/453: link d3/d4c/d5c/d86/l9e d3/de/d9f/la7 0 2024-09-20T20:31:41.692 INFO:tasks.workunit.client.0.smithi070.stdout:2/454: link d3/d5/d9/d42/l50 d3/d5/d9/d79/la8 0 2024-09-20T20:31:41.694 INFO:tasks.workunit.client.0.smithi070.stdout:0/498: dwrite d4/d8/d12/d23/d26/d1d/d37/d38/f5c [0,4194304] 0 2024-09-20T20:31:41.696 INFO:tasks.workunit.client.0.smithi070.stdout:0/499: creat d4/d13/f9d x:0 0 0 2024-09-20T20:31:41.697 INFO:tasks.workunit.client.0.smithi070.stdout:0/500: chown d4/d8/d12/d23/d26/d1d/d7e/c85 181 1 2024-09-20T20:31:41.697 INFO:tasks.workunit.client.0.smithi070.stdout:0/501: mknod d4/d8/d12/d23/d26/d2d/c9e 0 2024-09-20T20:31:41.698 INFO:tasks.workunit.client.0.smithi070.stdout:0/502: chown d4/d8/d12/d23/d26/c54 42493 1 2024-09-20T20:31:41.698 INFO:tasks.workunit.client.0.smithi070.stdout:2/455: write d3/f38 [2607676,118979] 0 2024-09-20T20:31:41.699 INFO:tasks.workunit.client.0.smithi070.stdout:0/503: stat d4/f62 0 2024-09-20T20:31:41.699 INFO:tasks.workunit.client.0.smithi070.stdout:0/504: creat d4/d1b/f9f x:0 0 0 2024-09-20T20:31:41.699 INFO:tasks.workunit.client.0.smithi070.stdout:2/456: write d3/d5/dd/d5a/f5f [1995027,75404] 0 2024-09-20T20:31:41.700 INFO:tasks.workunit.client.0.smithi070.stdout:0/505: mknod d4/d8/d55/ca0 0 2024-09-20T20:31:41.700 INFO:tasks.workunit.client.0.smithi070.stdout:2/457: write d3/d5/dd/f89 [66458,63108] 0 2024-09-20T20:31:41.701 INFO:tasks.workunit.client.0.smithi070.stdout:2/458: read - d3/de/d12/f8d zero size 2024-09-20T20:31:41.701 INFO:tasks.workunit.client.0.smithi070.stdout:2/459: mknod d3/d4c/d5c/d86/ca9 0 2024-09-20T20:31:41.702 INFO:tasks.workunit.client.0.smithi070.stdout:8/483: dread f0 [4194304,4194304] 0 2024-09-20T20:31:41.702 INFO:tasks.workunit.client.0.smithi070.stdout:2/460: unlink d3/d5/d9/d1c/d1f/f3c 0 2024-09-20T20:31:41.703 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:41.704 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:41.704 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:41.704 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:41.704 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:8/484: creat d4/d27/d2a/d3e/d31/d63/fac x:0 0 0 2024-09-20T20:31:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:2/461: rename d3/d5/l44 to d3/d5/d9/d1c/d47/d85/laa 0 2024-09-20T20:31:41.704 INFO:tasks.workunit.client.0.smithi070.stdout:2/462: fsync d3/f4a 0 2024-09-20T20:31:41.709 INFO:tasks.workunit.client.0.smithi070.stdout:8/485: truncate d4/db/f11 6597679 0 2024-09-20T20:31:41.710 INFO:tasks.workunit.client.0.smithi070.stdout:2/463: rename d3/d5/d9/d42/l71 to d3/de/d9f/lab 0 2024-09-20T20:31:41.710 INFO:tasks.workunit.client.0.smithi070.stdout:8/486: getdents d4/d27/d2a/d75 0 2024-09-20T20:31:41.710 INFO:tasks.workunit.client.0.smithi070.stdout:2/464: creat d3/d5/d9/d10/fac x:0 0 0 2024-09-20T20:31:41.711 INFO:tasks.workunit.client.0.smithi070.stdout:2/465: readlink d3/l2f 0 2024-09-20T20:31:41.711 INFO:tasks.workunit.client.0.smithi070.stdout:8/487: getdents d4/db/d64/d7b 0 2024-09-20T20:31:41.711 INFO:tasks.workunit.client.0.smithi070.stdout:2/466: write d3/de/f39 [566275,8639] 0 2024-09-20T20:31:41.712 INFO:tasks.workunit.client.0.smithi070.stdout:8/488: write d4/d27/d2a/d3e/f67 [199478,76588] 0 2024-09-20T20:31:41.712 INFO:tasks.workunit.client.0.smithi070.stdout:2/467: dread - d3/d5/d9/d10/f6a zero size 2024-09-20T20:31:41.713 INFO:tasks.workunit.client.0.smithi070.stdout:2/468: creat d3/d5/d9/d10/fad x:0 0 0 2024-09-20T20:31:41.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:41.725 INFO:tasks.workunit.client.0.smithi070.stdout:8/489: dread d4/db/f16 [0,4194304] 0 2024-09-20T20:31:41.726 INFO:tasks.workunit.client.0.smithi070.stdout:8/490: write d4/d27/d2a/d75/f77 [579652,130474] 0 2024-09-20T20:31:41.726 INFO:tasks.workunit.client.0.smithi070.stdout:8/491: fdatasync d4/d27/f36 0 2024-09-20T20:31:41.727 INFO:tasks.workunit.client.0.smithi070.stdout:8/492: link f0 d4/d27/d2a/d5b/d98/fad 0 2024-09-20T20:31:41.728 INFO:tasks.workunit.client.0.smithi070.stdout:8/493: write d4/d27/d2a/d43/d61/f62 [2579171,20403] 0 2024-09-20T20:31:41.728 INFO:tasks.workunit.client.0.smithi070.stdout:8/494: chown d4/d27/d2a/d43/d61 120384 1 2024-09-20T20:31:41.729 INFO:tasks.workunit.client.0.smithi070.stdout:8/495: mknod d4/d27/d2a/d3e/d39/cae 0 2024-09-20T20:31:41.731 INFO:tasks.workunit.client.0.smithi070.stdout:1/476: sync 2024-09-20T20:31:41.731 INFO:tasks.workunit.client.0.smithi070.stdout:4/476: sync 2024-09-20T20:31:41.731 INFO:tasks.workunit.client.0.smithi070.stdout:6/457: sync 2024-09-20T20:31:41.731 INFO:tasks.workunit.client.0.smithi070.stdout:7/327: sync 2024-09-20T20:31:41.731 INFO:tasks.workunit.client.0.smithi070.stdout:9/456: sync 2024-09-20T20:31:41.731 INFO:tasks.workunit.client.0.smithi070.stdout:5/399: sync 2024-09-20T20:31:41.732 INFO:tasks.workunit.client.0.smithi070.stdout:7/328: mkdir d2/d30/d63 0 2024-09-20T20:31:41.733 INFO:tasks.workunit.client.0.smithi070.stdout:6/458: write d4/d8/d10/d3c/f94 [69578,122065] 0 2024-09-20T20:31:41.733 INFO:tasks.workunit.client.0.smithi070.stdout:4/477: creat d6/d5e/d6b/d74/f98 x:0 0 0 2024-09-20T20:31:41.733 INFO:tasks.workunit.client.0.smithi070.stdout:5/400: rename d2/df/d40/d46/d63 to d2/d7/d88 0 2024-09-20T20:31:41.733 INFO:tasks.workunit.client.0.smithi070.stdout:1/477: write d4/d6/f29 [5351156,4344] 0 2024-09-20T20:31:41.734 INFO:tasks.workunit.client.0.smithi070.stdout:9/457: creat d1/df/d25/fa7 x:0 0 0 2024-09-20T20:31:41.735 INFO:tasks.workunit.client.0.smithi070.stdout:6/459: mknod d4/d8/d10/d54/ca4 0 2024-09-20T20:31:41.735 INFO:tasks.workunit.client.0.smithi070.stdout:7/329: creat d2/d8/f64 x:0 0 0 2024-09-20T20:31:41.735 INFO:tasks.workunit.client.0.smithi070.stdout:1/478: mknod d4/d6/dae/cb6 0 2024-09-20T20:31:41.735 INFO:tasks.workunit.client.0.smithi070.stdout:9/458: chown d1/df/d18/f66 24721777 1 2024-09-20T20:31:41.736 INFO:tasks.workunit.client.0.smithi070.stdout:7/330: stat d2/d19/l32 0 2024-09-20T20:31:41.736 INFO:tasks.workunit.client.0.smithi070.stdout:8/496: dwrite d4/d27/d2a/d3e/d39/f9f [0,4194304] 0 2024-09-20T20:31:41.736 INFO:tasks.workunit.client.0.smithi070.stdout:6/460: write d4/d8/d3a/f97 [3619,56705] 0 2024-09-20T20:31:41.736 INFO:tasks.workunit.client.0.smithi070.stdout:6/461: readlink d4/d8/d1e/l3d 0 2024-09-20T20:31:41.737 INFO:tasks.workunit.client.0.smithi070.stdout:5/401: rename d2/df/d40/f54 to d2/df/f89 0 2024-09-20T20:31:41.738 INFO:tasks.workunit.client.0.smithi070.stdout:7/331: unlink d2/fb 0 2024-09-20T20:31:41.738 INFO:tasks.workunit.client.0.smithi070.stdout:6/462: mknod d4/d8/d10/d54/d7a/ca5 0 2024-09-20T20:31:41.738 INFO:tasks.workunit.client.0.smithi070.stdout:8/497: fdatasync d4/d27/d2a/d3e/f30 0 2024-09-20T20:31:41.738 INFO:tasks.workunit.client.0.smithi070.stdout:1/479: rename d4/d6/d11/d9e to d4/d6/d11/d2c/d3a/d9d/db7 0 2024-09-20T20:31:41.739 INFO:tasks.workunit.client.0.smithi070.stdout:5/402: truncate d2/df/d40/d46/f5a 180747 0 2024-09-20T20:31:41.740 INFO:tasks.workunit.client.0.smithi070.stdout:1/480: read d4/d6/d2f/f5f [923670,26470] 0 2024-09-20T20:31:41.740 INFO:tasks.workunit.client.0.smithi070.stdout:5/403: symlink d2/d4/l8a 0 2024-09-20T20:31:41.741 INFO:tasks.workunit.client.0.smithi070.stdout:5/404: unlink d2/d7/d88/l30 0 2024-09-20T20:31:41.741 INFO:tasks.workunit.client.0.smithi070.stdout:1/481: write d4/f96 [2355655,12664] 0 2024-09-20T20:31:41.742 INFO:tasks.workunit.client.0.smithi070.stdout:5/405: write d2/d7/d88/f83 [801421,39659] 0 2024-09-20T20:31:41.744 INFO:tasks.workunit.client.0.smithi070.stdout:1/482: truncate d4/d32/d34/d44/d5a/faf 362055 0 2024-09-20T20:31:41.744 INFO:tasks.workunit.client.0.smithi070.stdout:7/332: dwrite d2/d52/f5e [0,4194304] 0 2024-09-20T20:31:41.745 INFO:tasks.workunit.client.0.smithi070.stdout:6/463: dwrite d4/d8/d10/f65 [4194304,4194304] 0 2024-09-20T20:31:41.745 INFO:tasks.workunit.client.0.smithi070.stdout:6/464: write d4/d8/f4f [4428751,71449] 0 2024-09-20T20:31:41.747 INFO:tasks.workunit.client.0.smithi070.stdout:5/406: read d2/d7/f11 [330604,120280] 0 2024-09-20T20:31:41.747 INFO:tasks.workunit.client.0.smithi070.stdout:7/333: mkdir d2/d65 0 2024-09-20T20:31:41.747 INFO:tasks.workunit.client.0.smithi070.stdout:1/483: rmdir d4/d6/d11/d2c/d3a/d9d 39 2024-09-20T20:31:41.747 INFO:tasks.workunit.client.0.smithi070.stdout:5/407: readlink d2/d4/l8a 0 2024-09-20T20:31:41.748 INFO:tasks.workunit.client.0.smithi070.stdout:5/408: dread - d2/df/d40/f5d zero size 2024-09-20T20:31:41.748 INFO:tasks.workunit.client.0.smithi070.stdout:5/409: dread - d2/d4/f39 zero size 2024-09-20T20:31:41.748 INFO:tasks.workunit.client.0.smithi070.stdout:6/465: rename d4/d8/d3a/f9f to d4/d8/d10/fa6 0 2024-09-20T20:31:41.748 INFO:tasks.workunit.client.0.smithi070.stdout:1/484: symlink d4/d6/dae/lb8 0 2024-09-20T20:31:41.749 INFO:tasks.workunit.client.0.smithi070.stdout:5/410: write d2/df/d40/d46/d5b/f45 [330936,19651] 0 2024-09-20T20:31:41.749 INFO:tasks.workunit.client.0.smithi070.stdout:6/466: mkdir d4/d8/d3a/da7 0 2024-09-20T20:31:41.749 INFO:tasks.workunit.client.0.smithi070.stdout:9/459: read d1/fe [3397367,103079] 0 2024-09-20T20:31:41.750 INFO:tasks.workunit.client.0.smithi070.stdout:1/485: mknod d4/d6/d11/d63/da3/cb9 0 2024-09-20T20:31:41.751 INFO:tasks.workunit.client.0.smithi070.stdout:5/411: symlink d2/d4/d53/d74/l8b 0 2024-09-20T20:31:41.751 INFO:tasks.workunit.client.0.smithi070.stdout:6/467: mknod d4/d8/d10/d3c/ca8 0 2024-09-20T20:31:41.751 INFO:tasks.workunit.client.0.smithi070.stdout:8/498: write d4/d27/d2a/d3e/d39/f51 [983239,117498] 0 2024-09-20T20:31:41.751 INFO:tasks.workunit.client.0.smithi070.stdout:9/460: mknod d1/df/d18/d44/d90/ca8 0 2024-09-20T20:31:41.752 INFO:tasks.workunit.client.0.smithi070.stdout:6/468: chown d4/d8/f4f 360472729 1 2024-09-20T20:31:41.752 INFO:tasks.workunit.client.0.smithi070.stdout:8/499: stat d4/d27/d2a/d3e/f2e 0 2024-09-20T20:31:41.753 INFO:tasks.workunit.client.0.smithi070.stdout:9/461: unlink d1/df/d25/f2e 0 2024-09-20T20:31:41.753 INFO:tasks.workunit.client.0.smithi070.stdout:1/486: link d4/d6/d2f/f5f d4/d6/d11/d7b/d83/fba 0 2024-09-20T20:31:41.754 INFO:tasks.workunit.client.0.smithi070.stdout:6/469: write d4/d8/f90 [597638,122457] 0 2024-09-20T20:31:41.754 INFO:tasks.workunit.client.0.smithi070.stdout:8/500: readlink d4/l1d 0 2024-09-20T20:31:41.755 INFO:tasks.workunit.client.0.smithi070.stdout:7/334: dwrite d2/d30/f59 [0,4194304] 0 2024-09-20T20:31:41.755 INFO:tasks.workunit.client.0.smithi070.stdout:1/487: read - d4/d32/d34/d44/d48/f58 zero size 2024-09-20T20:31:41.755 INFO:tasks.workunit.client.0.smithi070.stdout:8/501: unlink d4/d27/d2a/c5d 0 2024-09-20T20:31:41.756 INFO:tasks.workunit.client.0.smithi070.stdout:7/335: fsync d2/d19/f27 0 2024-09-20T20:31:41.756 INFO:tasks.workunit.client.0.smithi070.stdout:6/470: rename d4/d8/d17/l35 to d4/d8/d10/d54/d55/d72/la9 0 2024-09-20T20:31:41.756 INFO:tasks.workunit.client.0.smithi070.stdout:8/502: creat d4/d27/faf x:0 0 0 2024-09-20T20:31:41.757 INFO:tasks.workunit.client.0.smithi070.stdout:7/336: write d2/d19/d25/d42/f53 [1838188,29419] 0 2024-09-20T20:31:41.757 INFO:tasks.workunit.client.0.smithi070.stdout:8/503: rmdir d4/d27/d2a/d43/d61 39 2024-09-20T20:31:41.757 INFO:tasks.workunit.client.0.smithi070.stdout:7/337: creat d2/d30/d63/f66 x:0 0 0 2024-09-20T20:31:41.759 INFO:tasks.workunit.client.0.smithi070.stdout:5/412: write d2/d7/f31 [1025766,29410] 0 2024-09-20T20:31:41.760 INFO:tasks.workunit.client.0.smithi070.stdout:9/462: dwrite d1/df/d18/f66 [0,4194304] 0 2024-09-20T20:31:41.761 INFO:tasks.workunit.client.0.smithi070.stdout:9/463: chown d1/df/d25/d69 1296 1 2024-09-20T20:31:41.761 INFO:tasks.workunit.client.0.smithi070.stdout:6/471: dread d4/d8/d17/d33/d36/f37 [0,4194304] 0 2024-09-20T20:31:41.762 INFO:tasks.workunit.client.0.smithi070.stdout:9/464: getdents d1/df/d38 0 2024-09-20T20:31:41.762 INFO:tasks.workunit.client.0.smithi070.stdout:9/465: readlink d1/df/d18/l5f 0 2024-09-20T20:31:41.764 INFO:tasks.workunit.client.0.smithi070.stdout:7/338: dwrite d2/d52/f54 [0,4194304] 0 2024-09-20T20:31:41.764 INFO:tasks.workunit.client.0.smithi070.stdout:9/466: read d1/df/d18/d46/f81 [350120,26567] 0 2024-09-20T20:31:41.765 INFO:tasks.workunit.client.0.smithi070.stdout:1/488: rename d4/d6/d2f to d4/d32/d34/d44/d4b/d87/dbb 0 2024-09-20T20:31:41.767 INFO:tasks.workunit.client.0.smithi070.stdout:7/339: symlink d2/d19/d25/d61/l67 0 2024-09-20T20:31:41.767 INFO:tasks.workunit.client.0.smithi070.stdout:1/489: write d4/d6/d11/d7b/fb1 [865474,119029] 0 2024-09-20T20:31:41.768 INFO:tasks.workunit.client.0.smithi070.stdout:5/413: dwrite d2/d4/de/d47/f51 [0,4194304] 0 2024-09-20T20:31:41.769 INFO:tasks.workunit.client.0.smithi070.stdout:1/490: mkdir d4/d6/d11/dbc 0 2024-09-20T20:31:41.770 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:41.768+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:41.771 INFO:tasks.workunit.client.0.smithi070.stdout:6/472: dwrite d4/f9 [4194304,4194304] 0 2024-09-20T20:31:41.778 INFO:tasks.workunit.client.0.smithi070.stdout:7/340: dwrite d2/f1b [0,4194304] 0 2024-09-20T20:31:41.778 INFO:tasks.workunit.client.0.smithi070.stdout:9/467: dwrite d1/df/d2d/f4e [0,4194304] 0 2024-09-20T20:31:41.779 INFO:tasks.workunit.client.0.smithi070.stdout:8/504: write d4/d27/d2a/d3e/d39/f41 [2489386,92773] 0 2024-09-20T20:31:41.779 INFO:tasks.workunit.client.0.smithi070.stdout:7/341: creat d2/f68 x:0 0 0 2024-09-20T20:31:41.779 INFO:tasks.workunit.client.0.smithi070.stdout:9/468: write d1/d76/f9b [219301,25371] 0 2024-09-20T20:31:41.779 INFO:tasks.workunit.client.0.smithi070.stdout:7/342: rmdir d2/d19/d25/d61 39 2024-09-20T20:31:41.780 INFO:tasks.workunit.client.0.smithi070.stdout:9/469: write d1/df/d38/f7c [1710341,74770] 0 2024-09-20T20:31:41.782 INFO:tasks.workunit.client.0.smithi070.stdout:9/470: link d1/df/l5e d1/df/d18/d44/da2/la9 0 2024-09-20T20:31:41.782 INFO:tasks.workunit.client.0.smithi070.stdout:7/343: getdents d2/d19 0 2024-09-20T20:31:41.782 INFO:tasks.workunit.client.0.smithi070.stdout:6/473: dwrite d4/d8/f69 [0,4194304] 0 2024-09-20T20:31:41.782 INFO:tasks.workunit.client.0.smithi070.stdout:9/471: mkdir d1/d76/daa 0 2024-09-20T20:31:41.783 INFO:tasks.workunit.client.0.smithi070.stdout:7/344: write d2/d19/d25/d42/f53 [3745075,108846] 0 2024-09-20T20:31:41.784 INFO:tasks.workunit.client.0.smithi070.stdout:7/345: mkdir d2/d30/d63/d69 0 2024-09-20T20:31:41.786 INFO:tasks.workunit.client.0.smithi070.stdout:7/346: mknod d2/d19/d25/c6a 0 2024-09-20T20:31:41.787 INFO:tasks.workunit.client.0.smithi070.stdout:7/347: unlink d2/d19/d2e/f4e 0 2024-09-20T20:31:41.788 INFO:tasks.workunit.client.0.smithi070.stdout:7/348: read - d2/f68 zero size 2024-09-20T20:31:41.790 INFO:tasks.workunit.client.0.smithi070.stdout:6/474: dwrite d4/d8/d1e/f26 [0,4194304] 0 2024-09-20T20:31:41.790 INFO:tasks.workunit.client.0.smithi070.stdout:9/472: dwrite d1/df/d18/d44/d77/f99 [0,4194304] 0 2024-09-20T20:31:41.791 INFO:tasks.workunit.client.0.smithi070.stdout:7/349: link d2/d19/d25/d2a/d4a/f62 d2/d19/d25/d2a/f6b 0 2024-09-20T20:31:41.792 INFO:tasks.workunit.client.0.smithi070.stdout:9/473: mkdir d1/df/d18/d44/da2/dab 0 2024-09-20T20:31:41.792 INFO:tasks.workunit.client.0.smithi070.stdout:9/474: chown d1/d76/c95 3701312 1 2024-09-20T20:31:41.793 INFO:tasks.workunit.client.0.smithi070.stdout:9/475: mkdir d1/df/d38/dac 0 2024-09-20T20:31:41.794 INFO:tasks.workunit.client.0.smithi070.stdout:6/475: dread - d4/d8/d10/d54/d7a/f9e zero size 2024-09-20T20:31:41.795 INFO:tasks.workunit.client.0.smithi070.stdout:9/476: rename d1/df/d2d to d1/df/d25/d69/d85/dad 0 2024-09-20T20:31:41.795 INFO:tasks.workunit.client.0.smithi070.stdout:6/476: readlink d4/d8/d10/d54/d55/l8c 0 2024-09-20T20:31:41.796 INFO:tasks.workunit.client.0.smithi070.stdout:9/477: read d1/df/d18/d46/f55 [511738,8341] 0 2024-09-20T20:31:41.796 INFO:tasks.workunit.client.0.smithi070.stdout:6/477: symlink d4/d8/d68/laa 0 2024-09-20T20:31:41.797 INFO:tasks.workunit.client.0.smithi070.stdout:9/478: symlink d1/lae 0 2024-09-20T20:31:41.798 INFO:tasks.workunit.client.0.smithi070.stdout:2/469: sync 2024-09-20T20:31:41.798 INFO:tasks.workunit.client.0.smithi070.stdout:3/404: sync 2024-09-20T20:31:41.798 INFO:tasks.workunit.client.0.smithi070.stdout:0/506: sync 2024-09-20T20:31:41.798 INFO:tasks.workunit.client.0.smithi070.stdout:6/478: creat d4/d8/d10/d54/d7a/fab x:0 0 0 2024-09-20T20:31:41.798 INFO:tasks.workunit.client.0.smithi070.stdout:9/479: mkdir d1/df/d25/d69/daf 0 2024-09-20T20:31:41.799 INFO:tasks.workunit.client.0.smithi070.stdout:2/470: unlink d3/d5/d9/d10/fac 0 2024-09-20T20:31:41.799 INFO:tasks.workunit.client.0.smithi070.stdout:7/350: dwrite d2/d19/d25/d2a/f6b [0,4194304] 0 2024-09-20T20:31:41.799 INFO:tasks.workunit.client.0.smithi070.stdout:3/405: write d7/d15/d1a/f78 [273737,106793] 0 2024-09-20T20:31:41.800 INFO:tasks.workunit.client.0.smithi070.stdout:0/507: write d4/d8/d12/d23/d26/d1d/d41/f97 [875334,83515] 0 2024-09-20T20:31:41.801 INFO:tasks.workunit.client.0.smithi070.stdout:3/406: mknod d7/d15/d1a/d48/c7c 0 2024-09-20T20:31:41.801 INFO:tasks.workunit.client.0.smithi070.stdout:0/508: chown d4/d8/d12/f14 13 1 2024-09-20T20:31:41.801 INFO:tasks.workunit.client.0.smithi070.stdout:3/407: chown d7/d71 769 1 2024-09-20T20:31:41.801 INFO:tasks.workunit.client.0.smithi070.stdout:2/471: mkdir d3/d5/dd/d99/dae 0 2024-09-20T20:31:41.803 INFO:tasks.workunit.client.0.smithi070.stdout:0/509: mknod d4/d48/d67/ca1 0 2024-09-20T20:31:41.803 INFO:tasks.workunit.client.0.smithi070.stdout:0/510: stat d4/d8/ce 0 2024-09-20T20:31:41.804 INFO:tasks.workunit.client.0.smithi070.stdout:2/472: link d3/de/f39 d3/d5/d9/d1c/d1f/d3e/d92/faf 0 2024-09-20T20:31:41.804 INFO:tasks.workunit.client.0.smithi070.stdout:0/511: readlink d4/d8/d12/d23/d26/d1d/l80 0 2024-09-20T20:31:41.805 INFO:tasks.workunit.client.0.smithi070.stdout:9/480: dread d1/df/d18/d44/d77/f99 [0,4194304] 0 2024-09-20T20:31:41.806 INFO:tasks.workunit.client.0.smithi070.stdout:9/481: chown d1/d76 3764 1 2024-09-20T20:31:41.809 INFO:tasks.workunit.client.0.smithi070.stdout:6/479: dwrite d4/d8/d10/d54/d55/d72/f79 [0,4194304] 0 2024-09-20T20:31:41.809 INFO:tasks.workunit.client.0.smithi070.stdout:2/473: getdents d3/d5/d9/d1c 0 2024-09-20T20:31:41.810 INFO:tasks.workunit.client.0.smithi070.stdout:3/408: dwrite d7/d15/d1a/d4a/f4d [0,4194304] 0 2024-09-20T20:31:41.810 INFO:tasks.workunit.client.0.smithi070.stdout:1/491: dread d4/d6/f52 [0,4194304] 0 2024-09-20T20:31:41.812 INFO:tasks.workunit.client.0.smithi070.stdout:3/409: chown d7/d15/d1a/d48/d66/d69/d13/d1d/l30 665822 1 2024-09-20T20:31:41.812 INFO:tasks.workunit.client.0.smithi070.stdout:6/480: getdents d4/d8/d17/d33/d36 0 2024-09-20T20:31:41.812 INFO:tasks.workunit.client.0.smithi070.stdout:1/492: creat d4/d6/fbd x:0 0 0 2024-09-20T20:31:41.812 INFO:tasks.workunit.client.0.smithi070.stdout:2/474: write d3/d5/dd/f63 [814244,96393] 0 2024-09-20T20:31:41.813 INFO:tasks.workunit.client.0.smithi070.stdout:3/410: stat d7/d15/d1e/l28 0 2024-09-20T20:31:41.814 INFO:tasks.workunit.client.0.smithi070.stdout:6/481: rename d4/d8/d10/f88 to d4/d8/d1e/d7e/fac 0 2024-09-20T20:31:41.814 INFO:tasks.workunit.client.0.smithi070.stdout:3/411: mkdir d7/d15/d1a/d4a/d7d 0 2024-09-20T20:31:41.814 INFO:tasks.workunit.client.0.smithi070.stdout:2/475: write d3/d5/dd/d5a/f66 [3675616,3026] 0 2024-09-20T20:31:41.815 INFO:tasks.workunit.client.0.smithi070.stdout:1/493: getdents d4/d32/d34/d44/d5a 0 2024-09-20T20:31:41.815 INFO:tasks.workunit.client.0.smithi070.stdout:6/482: write d4/d8/f4c [4485639,130699] 0 2024-09-20T20:31:41.816 INFO:tasks.workunit.client.0.smithi070.stdout:0/512: dread d4/d8/d12/d23/d26/d1d/d37/d38/f63 [0,4194304] 0 2024-09-20T20:31:41.817 INFO:tasks.workunit.client.0.smithi070.stdout:6/483: readlink d4/d8/d17/l21 0 2024-09-20T20:31:41.817 INFO:tasks.workunit.client.0.smithi070.stdout:2/476: fsync d3/d5/d9/d1c/d47/d7e/f84 0 2024-09-20T20:31:41.818 INFO:tasks.workunit.client.0.smithi070.stdout:1/494: getdents d4/d6/d11/d2c 0 2024-09-20T20:31:41.818 INFO:tasks.workunit.client.0.smithi070.stdout:6/484: fdatasync d4/d8/d10/f2b 0 2024-09-20T20:31:41.818 INFO:tasks.workunit.client.0.smithi070.stdout:9/482: dwrite d1/df/d18/d46/f78 [0,4194304] 0 2024-09-20T20:31:41.819 INFO:tasks.workunit.client.0.smithi070.stdout:6/485: rmdir d4/d8/d10 39 2024-09-20T20:31:41.819 INFO:tasks.workunit.client.0.smithi070.stdout:1/495: creat d4/d6/d11/d63/d6c/fbe x:0 0 0 2024-09-20T20:31:41.821 INFO:tasks.workunit.client.0.smithi070.stdout:2/477: getdents d3/d5/d9/d1c/d4e 0 2024-09-20T20:31:41.821 INFO:tasks.workunit.client.0.smithi070.stdout:6/486: chown d4/d8/d10/d3c/d99 2449653 1 2024-09-20T20:31:41.822 INFO:tasks.workunit.client.0.smithi070.stdout:1/496: write d4/d6/d11/d2c/d3b/f74 [1979150,19618] 0 2024-09-20T20:31:41.823 INFO:tasks.workunit.client.0.smithi070.stdout:9/483: dread - d1/df/d18/d46/f7f zero size 2024-09-20T20:31:41.823 INFO:tasks.workunit.client.0.smithi070.stdout:3/412: dwrite d7/d15/d1a/d48/d57/f70 [0,4194304] 0 2024-09-20T20:31:41.824 INFO:tasks.workunit.client.0.smithi070.stdout:4/478: sync 2024-09-20T20:31:41.824 INFO:tasks.workunit.client.0.smithi070.stdout:5/414: sync 2024-09-20T20:31:41.824 INFO:tasks.workunit.client.0.smithi070.stdout:8/505: sync 2024-09-20T20:31:41.824 INFO:tasks.workunit.client.0.smithi070.stdout:5/415: stat d2/d7/c73 0 2024-09-20T20:31:41.825 INFO:tasks.workunit.client.0.smithi070.stdout:7/351: dread d2/d8/f33 [0,4194304] 0 2024-09-20T20:31:41.825 INFO:tasks.workunit.client.0.smithi070.stdout:1/497: rmdir d4/d6/d11 39 2024-09-20T20:31:41.825 INFO:tasks.workunit.client.0.smithi070.stdout:4/479: truncate d6/d5e/f95 857918 0 2024-09-20T20:31:41.827 INFO:tasks.workunit.client.0.smithi070.stdout:6/487: creat d4/d8/d17/d33/d8b/fad x:0 0 0 2024-09-20T20:31:41.827 INFO:tasks.workunit.client.0.smithi070.stdout:2/478: creat d3/d5/dd/d99/dae/fb0 x:0 0 0 2024-09-20T20:31:41.827 INFO:tasks.workunit.client.0.smithi070.stdout:9/484: rename d1/df/d25/f6e to d1/df/d25/d69/fb0 0 2024-09-20T20:31:41.827 INFO:tasks.workunit.client.0.smithi070.stdout:8/506: mkdir d4/d27/d2a/d5b/db0 0 2024-09-20T20:31:41.827 INFO:tasks.workunit.client.0.smithi070.stdout:5/416: rmdir d2/df/d75 39 2024-09-20T20:31:41.828 INFO:tasks.workunit.client.0.smithi070.stdout:4/480: creat d6/d7/dc/d20/f99 x:0 0 0 2024-09-20T20:31:41.828 INFO:tasks.workunit.client.0.smithi070.stdout:7/352: mknod d2/d19/d25/d42/d55/c6c 0 2024-09-20T20:31:41.829 INFO:tasks.workunit.client.0.smithi070.stdout:1/498: creat d4/d6/d11/d63/d6c/fbf x:0 0 0 2024-09-20T20:31:41.829 INFO:tasks.workunit.client.0.smithi070.stdout:0/513: dwrite d4/d8/d12/d23/d26/d2d/f6c [0,4194304] 0 2024-09-20T20:31:41.830 INFO:tasks.workunit.client.0.smithi070.stdout:5/417: dread - d2/d4/d53/d59/f61 zero size 2024-09-20T20:31:41.830 INFO:tasks.workunit.client.0.smithi070.stdout:8/507: creat d4/d27/d42/fb1 x:0 0 0 2024-09-20T20:31:41.830 INFO:tasks.workunit.client.0.smithi070.stdout:4/481: chown d6/d7/dc/l72 18 1 2024-09-20T20:31:41.830 INFO:tasks.workunit.client.0.smithi070.stdout:7/353: link d2/d52/f54 d2/d52/f6d 0 2024-09-20T20:31:41.832 INFO:tasks.workunit.client.0.smithi070.stdout:1/499: mknod d4/d32/d34/d44/d5a/cc0 0 2024-09-20T20:31:41.832 INFO:tasks.workunit.client.0.smithi070.stdout:4/482: creat d6/d5e/d75/d61/f9a x:0 0 0 2024-09-20T20:31:41.833 INFO:tasks.workunit.client.0.smithi070.stdout:2/479: getdents d3/d5/d9/d1c/d1f/d3e/d92 0 2024-09-20T20:31:41.835 INFO:tasks.workunit.client.0.smithi070.stdout:8/508: symlink d4/d27/d2a/d5b/d6c/da6/lb2 0 2024-09-20T20:31:41.835 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:41.832+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:41.836 INFO:tasks.workunit.client.0.smithi070.stdout:5/418: read d2/df/d40/d46/f7a [714820,103423] 0 2024-09-20T20:31:41.836 INFO:tasks.workunit.client.0.smithi070.stdout:1/500: chown d4/d6/d11/d2c/d3b 355437 1 2024-09-20T20:31:41.836 INFO:tasks.workunit.client.0.smithi070.stdout:2/480: chown d3/d5/dd/l43 25575070 1 2024-09-20T20:31:41.838 INFO:tasks.workunit.client.0.smithi070.stdout:3/413: dwrite d7/d15/d1e/d65/f27 [0,4194304] 0 2024-09-20T20:31:41.838 INFO:tasks.workunit.client.0.smithi070.stdout:9/485: dwrite d1/df/d18/d46/f63 [0,4194304] 0 2024-09-20T20:31:41.839 INFO:tasks.workunit.client.0.smithi070.stdout:8/509: creat d4/d27/d73/d87/fb3 x:0 0 0 2024-09-20T20:31:41.840 INFO:tasks.workunit.client.0.smithi070.stdout:1/501: write d4/d32/d34/d44/d4b/d87/fa2 [451143,36522] 0 2024-09-20T20:31:41.840 INFO:tasks.workunit.client.0.smithi070.stdout:9/486: chown d1/df/d38/f97 3305048 1 2024-09-20T20:31:41.841 INFO:tasks.workunit.client.0.smithi070.stdout:3/414: chown d7/d15/d1a/d4a/d51/d5b/c62 82617468 1 2024-09-20T20:31:41.841 INFO:tasks.workunit.client.0.smithi070.stdout:5/419: dread d2/d4/f1e [0,4194304] 0 2024-09-20T20:31:41.841 INFO:tasks.workunit.client.0.smithi070.stdout:0/514: dwrite d4/d19/f52 [0,4194304] 0 2024-09-20T20:31:41.841 INFO:tasks.workunit.client.0.smithi070.stdout:1/502: write f2 [3246954,44934] 0 2024-09-20T20:31:41.841 INFO:tasks.workunit.client.0.smithi070.stdout:7/354: dwrite d2/d52/f5e [0,4194304] 0 2024-09-20T20:31:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:0/515: readlink d4/d8/d12/d23/d26/d1d/d37/l92 0 2024-09-20T20:31:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:8/510: link d4/d27/f40 d4/d27/d2a/d5b/d98/fb4 0 2024-09-20T20:31:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:7/355: dread - d2/d19/d25/d42/f5a zero size 2024-09-20T20:31:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:9/487: rename d1/df/d25/d69/l74 to d1/df/d25/d69/lb1 0 2024-09-20T20:31:41.843 INFO:tasks.workunit.client.0.smithi070.stdout:5/420: getdents d2/df/d40/d46 0 2024-09-20T20:31:41.844 INFO:tasks.workunit.client.0.smithi070.stdout:7/356: readlink d2/d19/d25/l49 0 2024-09-20T20:31:41.845 INFO:tasks.workunit.client.0.smithi070.stdout:8/511: write d4/d27/d2a/d43/f45 [4012940,11889] 0 2024-09-20T20:31:41.846 INFO:tasks.workunit.client.0.smithi070.stdout:0/516: truncate d4/d8/d12/d23/d26/d2d/f89 360430 0 2024-09-20T20:31:41.846 INFO:tasks.workunit.client.0.smithi070.stdout:1/503: link d4/d6/d11/f18 d4/d32/d34/d44/d5a/fc1 0 2024-09-20T20:31:41.846 INFO:tasks.workunit.client.0.smithi070.stdout:8/512: chown d4/db/f16 13431202 1 2024-09-20T20:31:41.846 INFO:tasks.workunit.client.0.smithi070.stdout:9/488: write d1/df/d18/d46/f55 [351566,11997] 0 2024-09-20T20:31:41.848 INFO:tasks.workunit.client.0.smithi070.stdout:8/513: chown d4/d27/d2a/d3e/d31/f52 27271136 1 2024-09-20T20:31:41.849 INFO:tasks.workunit.client.0.smithi070.stdout:3/415: dread d7/d15/d1a/d48/d66/d69/f39 [0,4194304] 0 2024-09-20T20:31:41.850 INFO:tasks.workunit.client.0.smithi070.stdout:3/416: chown d7/d15/f67 3189564 1 2024-09-20T20:31:41.851 INFO:tasks.workunit.client.0.smithi070.stdout:1/504: mknod d4/d6/d11/d2c/d3a/d9d/db7/cc2 0 2024-09-20T20:31:41.852 INFO:tasks.workunit.client.0.smithi070.stdout:8/514: write d4/d27/d2a/d3e/f56 [1271158,18260] 0 2024-09-20T20:31:41.852 INFO:tasks.workunit.client.0.smithi070.stdout:3/417: write d7/f9 [4913665,115825] 0 2024-09-20T20:31:41.854 INFO:tasks.workunit.client.0.smithi070.stdout:8/515: fdatasync d4/f28 0 2024-09-20T20:31:41.855 INFO:tasks.workunit.client.0.smithi070.stdout:5/421: dwrite d2/d4/de/f29 [0,4194304] 0 2024-09-20T20:31:41.855 INFO:tasks.workunit.client.0.smithi070.stdout:7/357: dwrite d2/d8/f33 [0,4194304] 0 2024-09-20T20:31:41.856 INFO:tasks.workunit.client.0.smithi070.stdout:6/488: dread d4/d8/d1e/f5b [0,4194304] 0 2024-09-20T20:31:41.858 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 106.866772087, 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 106.866395133, 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 106.86629109099999, 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 106.865189852, 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036218537000000002, 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988437+0000", 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988440+0000", 2024-09-20T20:31:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1430000000000001e-06 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988452+0000", 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2092999999999999e-05 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988479+0000", 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7293000000000001e-05 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988500+0000", 2024-09-20T20:31:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0922999999999999e-05 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007593+0000", 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019093512999999999 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007921+0000", 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032709699999999999 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008280+0000", 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035923699999999999 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014017+0000", 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057370030000000001 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024528+0000", 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010511408999999999 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024605+0000", 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7312999999999997e-05 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024656+0000", 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0513000000000002e-05 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 106.86496457699999, 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036290936000000003, 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988663+0000", 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988664+0000", 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.173e-06 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988672+0000", 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6769999999999995e-06 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988689+0000", 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7575999999999999e-05 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988706+0000", 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6889999999999999e-05 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.008924+0000", 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020218197 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009122+0000", 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019798799999999999 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009415+0000", 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029293100000000002 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014033+0000", 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046173780000000001 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024748+0000", 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010715202 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024857+0000", 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109194 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024954+0000", 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6730000000000004e-05 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 106.864901828, 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.891 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 106.864793285, 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:41.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:41.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 106.864727999, 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:41.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:9757 4.3a 4:5e14edba:::10000002cd2.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T20:31:41.902 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0177636220000004, 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039178256000000002, 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9757 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835867+0000", 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8899999999999999e-06 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840142+0000", 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042754359999999996 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840177+0000", 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5045000000000001e-05 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840192+0000", 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4922e-05 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840396+0000", 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840663+0000", 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026629300000000002 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840888+0000", 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022530200000000001 2024-09-20T20:31:41.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.872083+0000", 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031194700999999998 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.874767+0000", 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002683904 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.874918+0000", 2024-09-20T20:31:41.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015160600000000001 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.875042+0000", 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012374 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:10757 4.34 4:2c63a741:::100000030c9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:38.437074+0000", 2024-09-20T20:31:41.908 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.4165534480000002, 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036283635000000002, 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10757 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.437074+0000", 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.437074+0000", 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.437076+0000", 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2060000000000001e-06 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.446029+0000", 2024-09-20T20:31:41.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089530679999999998 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.446069+0000", 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0132000000000001e-05 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.446104+0000", 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4958e-05 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.446273+0000", 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000168522 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.446544+0000", 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027124199999999999 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.446929+0000", 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038475500000000003 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.472794+0000", 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025864978 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.472920+0000", 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012670100000000001 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.473136+0000", 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021509599999999999 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.473357+0000", 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022197699999999999 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:10774 4.3a 4:5e0e6c10:::100000030da.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:38.501065+0000", 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.352562566, 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036791427000000002, 2024-09-20T20:31:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10774 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.501065+0000", 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.501065+0000", 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.501066+0000", 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3060000000000001e-06 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.508780+0000", 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077137960000000002 2024-09-20T20:31:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.508803+0000", 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3030000000000001e-05 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.508815+0000", 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.188e-05 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.508904+0000", 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9128000000000005e-05 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.509055+0000", 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015088600000000001 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.509261+0000", 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020597899999999999 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522839+0000", 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013577804000000001 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.537679+0000", 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014840549999999999 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.537770+0000", 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0797999999999994e-05 2024-09-20T20:31:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.537856+0000", 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6269999999999999e-05 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:10780 4.a 4:5357c130:::10000003141.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:38.516952+0000", 2024-09-20T20:31:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.336674844, 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040564015000000002, 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10780 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.516952+0000", 2024-09-20T20:31:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.516952+0000", 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.516954+0000", 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8020000000000001e-06 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522706+0000", 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057515190000000001 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522727+0000", 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1151000000000001e-05 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522741+0000", 2024-09-20T20:31:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3794e-05 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522855+0000", 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000114449 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.523017+0000", 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016183500000000001 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.523162+0000", 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014510900000000001 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.525970+0000", 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002807763 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.557422+0000", 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031452200999999999 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.557475+0000", 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3266000000000001e-05 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.557516+0000", 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1125999999999999e-05 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12089 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304 [2@2192397]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.073453+0000", 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.78017418699999996, 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039102537, 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12089 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.073453+0000", 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.073453+0000", 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.073454+0000", 2024-09-20T20:31:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2860000000000001e-06 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085223+0000", 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011768096 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085263+0000", 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0924999999999999e-05 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085287+0000", 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3334999999999999e-05 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085391+0000", 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103834 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085469+0000", 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8837000000000004e-05 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085594+0000", 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124578 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.094370+0000", 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087759629999999995 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.112455+0000", 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018084939000000001 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.112504+0000", 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9512000000000003e-05 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.112556+0000", 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1232e-05 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12095 4.2b 4:d69ce1d4:::1000000342f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.086762+0000", 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.76686544000000001, 2024-09-20T20:31:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036362173999999997, 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12095 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.086762+0000", 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.086762+0000", 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.086763+0000", 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.104709+0000", 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017945875999999999 2024-09-20T20:31:41.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.104736+0000", 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7364000000000001e-05 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.104748+0000", 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2112e-05 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.104936+0000", 2024-09-20T20:31:41.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018784699999999999 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.105306+0000", 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037007199999999999 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.105589+0000", 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028299299999999999 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.120503+0000", 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014913768000000001 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.122998+0000", 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024948499999999998 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.123060+0000", 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2612000000000003e-05 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.123124+0000", 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3723e-05 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12451 4.e 4:72c16fae:::100000030b2.00000002:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.621629+0000", 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.23199784200000001, 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036712871000000001, 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12451 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.621629+0000", 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.621629+0000", 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.621631+0000", 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.105e-06 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629780+0000", 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081492600000000002 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629809+0000", 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9084000000000001e-05 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629822+0000", 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3533000000000001e-05 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629981+0000", 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015873499999999999 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.630264+0000", 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028236800000000002 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.630675+0000", 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00041126599999999998 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658174+0000", 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027499440999999999 2024-09-20T20:31:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658191+0000", 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6728e-05 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658266+0000", 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5091000000000003e-05 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658342+0000", 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6260000000000005e-05 2024-09-20T20:31:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4469.0:12449 4.16 e54/17 4:6beb77ce:::10000003426.00000000:head v 54'186, mlcod=54'184)", 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.626777+0000", 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.22685021399999999, 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038996825999999998, 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.626777+0000", 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.626777+0000", 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.626779+0000", 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5600000000000001e-06 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.632778+0000", 2024-09-20T20:31:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059994480000000001 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.632793+0000", 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4399999999999999e-05 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.632805+0000", 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2676e-05 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.651961+0000", 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019156197 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.652015+0000", 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3159999999999999e-05 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665742+0000", 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013727694 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665774+0000", 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1690999999999999e-05 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12455 4.e 4:7306e7dd:::10000003420.00000000:head [write 1004643~119556] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.629857+0000", 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.223770108, 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035878212, 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12455 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629857+0000", 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629857+0000", 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629858+0000", 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1230000000000001e-06 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629935+0000", 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6540999999999998e-05 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629945+0000", 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0271e-05 2024-09-20T20:31:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629950+0000", 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3699999999999997e-06 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.651959+0000", 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022009114999999999 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.652094+0000", 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013549600000000001 2024-09-20T20:31:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.652226+0000", 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000131512 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658356+0000", 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061307710000000001 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665625+0000", 2024-09-20T20:31:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072681170000000002 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665686+0000", 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0988e-05 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665735+0000", 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9907999999999997e-05 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4469.0:12454 4.26 e54/17 4:671baa72:::100000033c0.00000000:head v 54'219, mlcod=54'217)", 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.639653+0000", 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.213974203, 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035731802, 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.639653+0000", 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.639653+0000", 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.639654+0000", 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2200000000000003e-07 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.644914+0000", 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052603069999999997 2024-09-20T20:31:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.644927+0000", 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3342e-05 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.644937+0000", 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8069999999999994e-06 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658393+0000", 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013455543 2024-09-20T20:31:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658430+0000", 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7156000000000001e-05 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.675331+0000", 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016900643 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.675385+0000", 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4282e-05 2024-09-20T20:31:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12465 4.e 4:7306e7dd:::10000003420.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.645682+0000", 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.20794496300000001, 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034927482000000003, 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12465 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.645682+0000", 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.645682+0000", 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.645684+0000", 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2219999999999999e-06 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.651362+0000", 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056782389999999999 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.651376+0000", 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4306e-05 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.651382+0000", 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7880000000000003e-06 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665837+0000", 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014455064 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665923+0000", 2024-09-20T20:31:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6323999999999995e-05 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.666081+0000", 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000157808 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.675452+0000", 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093708779999999992 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.680500+0000", 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050483409999999996 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.680553+0000", 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2790000000000001e-05 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.680610+0000", 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6721999999999997e-05 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12540 4.25 4:a72d0a59:::10000003358.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.777271+0000", 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.076356246000000003, 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051660642999999999, 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12540 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.777271+0000", 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.777271+0000", 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.777272+0000", 2024-09-20T20:31:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7599999999999996e-07 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.788936+0000", 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011664529 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.788958+0000", 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1325999999999999e-05 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.788969+0000", 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1677e-05 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.789035+0000", 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5736999999999998e-05 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.789136+0000", 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101143 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.789279+0000", 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014254200000000001 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.800199+0000", 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010920533 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.828871+0000", 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028671594000000002 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.828910+0000", 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8596000000000001e-05 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.828932+0000", 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.209e-05 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:41.969 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:41.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:41.977 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:41.969+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:7/358: rmdir d2 39 2024-09-20T20:31:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:8/516: chown d4/d27/d2a/c89 1806 1 2024-09-20T20:31:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:0/517: dwrite d4/d8/d12/d23/d26/d1f/d2e/f6d [0,4194304] 0 2024-09-20T20:31:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:8/517: write d4/db/f5e [964740,9933] 0 2024-09-20T20:31:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:6/489: creat d4/d8/d17/d33/d61/d73/fae x:0 0 0 2024-09-20T20:31:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:7/359: mknod d2/d19/c6e 0 2024-09-20T20:31:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:0/518: rmdir d4/d8/d12/d23/d26/d1d/d37 39 2024-09-20T20:31:41.987 INFO:tasks.workunit.client.0.smithi070.stdout:5/422: fsync d2/df/d75/f7d 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:8/518: write d4/d27/d2a/d3e/d31/d63/fac [319776,62512] 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:5/423: fsync d2/df/d40/f5d 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:5/424: write d2/df/d40/d46/f7a [1928371,88898] 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:0/519: read d4/d8/d12/d23/d26/f2a [4597163,71013] 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:5/425: fsync d2/d7/d60/f6f 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:7/360: dread d2/d19/d25/d2a/f6b [0,4194304] 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:5/426: creat d2/d4/de/d47/d5f/f8c x:0 0 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:7/361: rmdir d2/d19/d2e 39 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:5/427: write d2/d7/f49 [1449657,80169] 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:3/418: dread d7/d15/d1a/f78 [0,4194304] 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:6/490: dwrite d4/d8/fa [0,4194304] 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:1/505: write d4/d6/d11/d63/d6c/f9c [1742518,35183] 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:5/428: creat d2/d4/d53/d59/f8d x:0 0 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:6/491: creat d4/d8/d10/d54/d55/d72/faf x:0 0 0 2024-09-20T20:31:41.988 INFO:tasks.workunit.client.0.smithi070.stdout:3/419: truncate f4 367013 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:5/429: creat d2/d4/de/d47/d67/f8e x:0 0 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:3/420: mknod d7/d15/d1a/d48/d66/d69/d13/d72/c7e 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:6/492: fsync d4/d8/d3a/f66 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:3/421: dread - d7/d15/f45 zero size 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:6/493: write d4/d8/f69 [4852133,55761] 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:7/362: dwrite d2/d8/f3b [0,4194304] 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:6/494: truncate d4/d8/d10/d3c/f6a 5090953 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:0/520: write d4/d8/d12/f14 [1679535,17401] 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:3/422: creat d7/d15/d1a/d48/d57/d75/f7f x:0 0 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:7/363: creat d2/d19/d25/d61/f6f x:0 0 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:9/489: dread d1/f5 [4194304,4194304] 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:6/495: write d4/d8/f1f [2736903,117738] 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:3/423: mkdir d7/d15/d1a/d80 0 2024-09-20T20:31:41.989 INFO:tasks.workunit.client.0.smithi070.stdout:6/496: readlink d4/d8/l51 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:9/490: write d1/df/d25/d69/d85/dad/f94 [3551106,111791] 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:3/424: readlink d7/l31 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:9/491: fsync d1/f14 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:7/364: write d2/d19/d2e/f60 [2413557,100055] 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:6/497: write d4/d8/d10/d3c/f8d [206036,36504] 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:9/492: write d1/df/f28 [542434,83534] 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:7/365: creat d2/d30/d63/d69/f70 x:0 0 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:3/425: symlink d7/d15/d1a/d48/d66/d69/d13/d1d/l81 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:6/498: chown d4/d8/d10/d54/d7a/f9e 1594854394 1 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:8/519: dread d4/d27/d2a/d75/f77 [0,4194304] 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:9/493: mkdir d1/df/d25/db2 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:7/366: creat d2/d19/d25/d42/d55/f71 x:0 0 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:3/426: mknod d7/d15/d1a/d4a/c82 0 2024-09-20T20:31:41.990 INFO:tasks.workunit.client.0.smithi070.stdout:6/499: symlink d4/d8/d17/lb0 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:7/367: creat d2/d19/d25/d2a/d5c/f72 x:0 0 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:6/500: mkdir d4/d8/d10/d54/db1 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:3/427: write d7/d15/f3f [1654069,32361] 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:9/494: link d1/l37 d1/df/d25/d69/daf/lb3 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:0/521: dwrite d4/d8/d12/d23/d26/d1f/d2e/f6d [0,4194304] 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:6/501: write d4/f23 [699573,130526] 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:9/495: fdatasync d1/df/d18/d46/f73 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:1/506: dread d4/d32/d34/d44/d5a/fc1 [0,4194304] 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:1/507: stat d4/d32/d34/d44/d4b/d87 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:0/522: rename d4/d13/f61 to d4/d19/fa2 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:6/502: mkdir d4/d8/d17/db2 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:9/496: symlink d1/df/d18/d44/da2/lb4 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:7/368: getdents d2/d30/d63 0 2024-09-20T20:31:41.991 INFO:tasks.workunit.client.0.smithi070.stdout:9/497: symlink d1/d76/lb5 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:1/508: symlink d4/d6/d11/d2c/d3a/lc3 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:0/523: chown d4/d8/d12/d23/d26/f51 9080 1 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:6/503: chown d4/d8/d10/d54/d64/f84 559471964 1 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:9/498: mkdir d1/df/d18/d44/da2/db6 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:1/509: write d4/d32/d34/d44/d48/f54 [1191933,25836] 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:0/524: dread - d4/d8/d12/d23/d26/d1d/d7e/f8d zero size 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:8/520: write d4/d27/d2a/d3e/f2e [956465,30006] 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:5/430: dread d2/df/d40/d46/d5b/f42 [0,4194304] 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:1/510: rename d4/d32/d34/d44/d5a/faf to d4/d6/fc4 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:5/431: chown d2/d7/d88/f83 20153863 1 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:8/521: mkdir d4/d27/d2a/d5b/d98/da9/db5 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:0/525: rename d4/d8/d12/d23/d26/d1d/l80 to d4/d8/d12/d43/la3 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:5/432: creat d2/d4/d53/d59/f8f x:0 0 0 2024-09-20T20:31:41.992 INFO:tasks.workunit.client.0.smithi070.stdout:1/511: getdents d4/d6/d11/d63/da3 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:0/526: mknod d4/d19/d5b/ca4 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:3/428: write d7/d15/d1a/d48/d66/d69/f24 [959254,60912] 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:8/522: dread d4/d27/d2a/d75/f77 [0,4194304] 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:5/433: rmdir d2/df/d40/d46/d4c 39 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:7/369: dwrite d2/d8/f47 [0,4194304] 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:8/523: chown d4/d27/d2a/d7e/c9c 15 1 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:3/429: truncate d7/d15/d1e/f49 3155213 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:8/524: mknod d4/cb6 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:8/525: write d4/db/f5e [1307966,57687] 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:2/481: dread d3/de/d12/d1a/f21 [0,4194304] 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:2/482: chown d3/de/d12/f7d 9647615 1 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:1/512: dwrite d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:8/526: rmdir d4/db/d64/d95/da5 39 2024-09-20T20:31:41.993 INFO:tasks.workunit.client.0.smithi070.stdout:8/527: creat d4/d27/d2a/fb7 x:0 0 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:2/483: rmdir d3/d5/d9/d10 39 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:5/434: dwrite d2/d4/de/d47/f51 [0,4194304] 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:2/484: fdatasync d3/d5/dd/d5a/f66 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:8/528: mknod d4/d27/d2a/d75/cb8 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:1/513: rename d4/d6/d11/d2c/d3b/f9a to d4/d6/fc5 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:3/430: dwrite d7/d15/d1a/d48/d66/d69/d13/d1d/f7b [0,4194304] 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:4/483: sync 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:9/499: sync 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:6/504: sync 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:3/431: read - d7/d15/d1e/d65/f5c zero size 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:5/435: dwrite d2/df/d40/d46/f56 [0,4194304] 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:2/485: dwrite d3/de/f1b [0,4194304] 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:0/527: dread d4/d8/fc [0,4194304] 0 2024-09-20T20:31:41.994 INFO:tasks.workunit.client.0.smithi070.stdout:6/505: chown d4/d8/d17/f57 91470500 1 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:3/432: write d7/d15/d1a/d48/d66/d69/f42 [239504,64306] 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:9/500: unlink d1/df/d18/d46/f78 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:1/514: link d4/d6/d11/d2c/d3b/f3e d4/d6/d26/fc6 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:0/528: fsync d4/d8/d12/d23/d26/f51 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:7/370: dread d2/f26 [0,4194304] 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:7/371: chown d2/d52 1914 1 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:3/433: chown d7/d15/d1a/d4a/d51/d5b/f6c 1 1 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:6/506: rename d4/d8/d17/d33/d8b to d4/d8/d10/db3 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:5/436: truncate d2/df/d40/d46/d4c/f44 1228534 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:9/501: mkdir d1/df/d18/d44/da2/db7 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:1/515: fdatasync d4/f62 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:0/529: mkdir d4/d48/d67/da5 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:7/372: chown d2/d52/f6d 1248980 1 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:6/507: mkdir d4/d8/db4 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:5/437: write d2/d7/d88/f4d [87966,63365] 0 2024-09-20T20:31:41.995 INFO:tasks.workunit.client.0.smithi070.stdout:9/502: fdatasync d1/df/f59 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:1/516: chown d4/d6/f21 3460885 1 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:6/508: stat d4/d8/d10/db3/fad 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:5/438: fdatasync d2/d4/d53/d59/f8f 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:7/373: rename d2/d19/d25/d2a/f5f to d2/d19/f73 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:1/517: write d4/d6/d11/d7b/fb1 [1561820,56520] 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:6/509: mkdir d4/d8/d17/db2/db5 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:1/518: chown d4/d6/d11/d2c/d3a/ca4 36 1 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:0/530: dread d4/d19/d5b/f5f [0,4194304] 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:1/519: symlink d4/d32/d60/lc7 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:5/439: truncate d2/d7/d60/f6f 1957886 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:6/510: getdents d4/d8/d10/d54 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:1/520: write d4/d6/d26/f70 [977115,39160] 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:5/440: mkdir d2/df/d40/d46/d5b/d90 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:4/484: truncate d6/f86 4187469 0 2024-09-20T20:31:41.996 INFO:tasks.workunit.client.0.smithi070.stdout:4/485: mknod d6/d7/dc/d4a/c9b 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:7/374: dwrite d2/d19/d25/d61/f6f [0,4194304] 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:0/531: dwrite d4/d8/d12/f50 [0,4194304] 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:4/486: creat d6/d26/f9c x:0 0 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:0/532: mknod d4/d48/d7b/d8c/ca6 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:0/533: unlink d4/d48/d7b/d8c/ca6 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:0/534: rmdir d4/d8 39 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:5/441: dwrite d2/d4/d53/d59/f8d [0,4194304] 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:1/521: dwrite d4/d6/d11/d63/d6c/f9c [4194304,4194304] 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:9/503: write d1/df/f59 [783573,12908] 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:5/442: rmdir d2/df/d40 39 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:1/522: creat d4/d32/d34/d44/fc8 x:0 0 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:0/535: symlink d4/d48/d67/da5/la7 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:1/523: fdatasync d4/f15 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:9/504: mkdir d1/df/d18/d44/d77/db8 0 2024-09-20T20:31:41.997 INFO:tasks.workunit.client.0.smithi070.stdout:0/536: mknod d4/d19/d82/ca8 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:1/524: stat d4/l22 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:1/525: write d4/d6/f47 [235928,57722] 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:5/443: dwrite d2/d7/f49 [4194304,4194304] 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:9/505: dwrite d1/df/f7e [0,4194304] 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:0/537: dwrite d4/d8/d12/d23/d26/d1d/d7e/f91 [0,4194304] 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:9/506: rename d1/df/d18/d83 to d1/df/d25/d69/d85/d9f/db9 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:9/507: creat d1/df/d18/d44/fba x:0 0 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:0/538: chown d4/d8/d12/d23/d26/d1d/d41/f97 3 1 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:0/539: fsync d4/d8/d12/d23/d26/d1d/d37/d38/f5c 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:1/526: dwrite d4/d6/d11/d2c/d3b/f3e [0,4194304] 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:0/540: write f2 [2245606,92482] 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:1/527: creat d4/d32/d34/d44/d4b/d87/dbb/fc9 x:0 0 0 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:0/541: chown d4/d8/d12/d23/d26/f51 2295 1 2024-09-20T20:31:41.998 INFO:tasks.workunit.client.0.smithi070.stdout:5/444: dwrite d2/df/d40/d46/d5b/f45 [0,4194304] 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:9/508: dwrite d1/df/d18/d46/f7f [0,4194304] 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:5/445: stat d2/c78 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:5/446: write d2/df/d40/d46/f87 [390104,5312] 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:5/447: creat d2/d7/d60/f91 x:0 0 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:9/509: dwrite f0 [4194304,4194304] 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:5/448: write d2/d4/d53/d59/f61 [309190,60529] 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:9/510: truncate d1/f5 3759431 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:5/449: readlink d2/d4/d53/d74/l8b 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:5/450: stat d2/df/d40/d46/d5b/f26 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:9/511: dwrite d1/df/d38/f97 [0,4194304] 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:2/486: dread d3/de/f6d [0,4194304] 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:9/512: dwrite d1/f2a [0,4194304] 0 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:6/511: sync 2024-09-20T20:31:41.999 INFO:tasks.workunit.client.0.smithi070.stdout:5/451: sync 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/513: rename d1/fe to d1/df/d18/d46/fbb 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:2/487: chown d3/d5/l6f 1124842 1 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:6/512: mkdir d4/d8/db4/db6 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:3/434: dread d7/f9 [0,4194304] 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/514: mknod d1/df/cbc 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:6/513: mkdir d4/d8/d1e/db7 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:5/452: rename d2/d4/d53/d74 to d2/d4/de/d47/d67/d92 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:2/488: write d3/d5/d9/d10/f6a [748528,59781] 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:9/515: mknod d1/df/d18/d44/cbd 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:3/435: rename d7/d15/d1a/f2c to d7/d15/d1a/d4a/f83 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:7/375: dread d2/d19/d25/d42/f53 [0,4194304] 0 2024-09-20T20:31:42.000 INFO:tasks.workunit.client.0.smithi070.stdout:6/514: truncate d4/d8/d10/d54/d55/d72/faf 992574 0 2024-09-20T20:31:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:3/436: write d7/d15/d1a/f32 [5759954,61040] 0 2024-09-20T20:31:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:9/516: creat d1/df/d18/d46/fbe x:0 0 0 2024-09-20T20:31:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:2/489: link d3/d5/d9/d10/l57 d3/d5/d9/d79/lb1 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:3/437: readlink d7/d15/d1e/d65/l79 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:3/438: fdatasync d7/d15/d1e/d65/f27 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:2/490: chown d3/d5/d9/d1c/d47/d85/f98 0 1 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:3/439: rename d7/d15/d1a/l74 to d7/d71/l84 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:2/491: mkdir d3/d5/d9/d1c/d1f/d3e/d61/db2 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:5/453: dwrite d2/df/d40/d46/f7a [0,4194304] 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:1/528: sync 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:4/487: sync 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:6/515: dwrite d4/d8/d1e/d7e/f91 [0,4194304] 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:4/488: chown d6/d26/d69/d71/f5b 117637 1 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:2/492: creat d3/d5/d9/d1c/d1f/fb3 x:0 0 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:1/529: write d4/d6/fc5 [517336,19726] 0 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:6/516: rmdir d4/d8/d3a 39 2024-09-20T20:31:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:0/542: dread d4/d13/f6b [0,4194304] 0 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:0/543: mkdir d4/d8/d12/d43/d3b/da9 0 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:6/517: rename d4/d8/d10/d3c/l80 to d4/d8/d17/d33/lb8 0 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:4/489: link d6/d7/dc/d4a/l94 d6/d7/dc/l9d 0 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:0/544: symlink d4/d48/d4e/laa 0 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:4/490: chown d6/d26/f87 2646090 1 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:5/454: dwrite d2/d4/f39 [0,4194304] 0 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:6/518: chown d4/d8/c2c 37 1 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:0/545: creat d4/d48/d67/fab x:0 0 0 2024-09-20T20:31:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:6/519: creat d4/d8/d10/d3c/fb9 x:0 0 0 2024-09-20T20:31:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:0/546: mknod d4/d8/d12/d23/d26/d1d/d37/cac 0 2024-09-20T20:31:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:4/491: rename d6/d7/dc/d20/c91 to d6/d7/dc/d4a/d81/c9e 0 2024-09-20T20:31:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:6/520: write d4/d8/d1e/f5f [2665097,56664] 0 2024-09-20T20:31:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:0/547: fsync d4/d8/d12/d23/d26/d2d/f6c 0 2024-09-20T20:31:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:4/492: write d6/d26/d69/d71/f7e [281313,119398] 0 2024-09-20T20:31:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:4/493: link d6/d26/d69/d71/c80 d6/d26/d97/c9f 0 2024-09-20T20:31:42.008 INFO:tasks.workunit.client.0.smithi070.stdout:5/455: dwrite d2/d7/d88/f83 [0,4194304] 0 2024-09-20T20:31:42.012 INFO:tasks.workunit.client.0.smithi070.stdout:5/456: getdents d2/df/d40/d46 0 2024-09-20T20:31:42.012 INFO:tasks.workunit.client.0.smithi070.stdout:6/521: dwrite d4/d8/d17/f57 [0,4194304] 0 2024-09-20T20:31:42.014 INFO:tasks.workunit.client.0.smithi070.stdout:3/440: dread d7/d15/d1a/d48/d57/f6d [0,4194304] 0 2024-09-20T20:31:42.014 INFO:tasks.workunit.client.0.smithi070.stdout:5/457: read - d2/d7/d60/f91 zero size 2024-09-20T20:31:42.014 INFO:tasks.workunit.client.0.smithi070.stdout:0/548: dwrite d4/d13/f9d [0,4194304] 0 2024-09-20T20:31:42.015 INFO:tasks.workunit.client.0.smithi070.stdout:5/458: readlink d2/df/d40/d46/d4c/l1b 0 2024-09-20T20:31:42.015 INFO:tasks.workunit.client.0.smithi070.stdout:3/441: rmdir d7/d15/d1a/d48/d57 39 2024-09-20T20:31:42.016 INFO:tasks.workunit.client.0.smithi070.stdout:4/494: dwrite d6/d7/dc/fe [4194304,4194304] 0 2024-09-20T20:31:42.017 INFO:tasks.workunit.client.0.smithi070.stdout:4/495: chown d6/d7/dc/l72 1725591 1 2024-09-20T20:31:42.017 INFO:tasks.workunit.client.0.smithi070.stdout:3/442: truncate d7/d15/d1a/d48/d66/d69/d13/d1d/f34 809022 0 2024-09-20T20:31:42.018 INFO:tasks.workunit.client.0.smithi070.stdout:1/530: dread d4/d32/d34/d44/d48/f5e [0,4194304] 0 2024-09-20T20:31:42.019 INFO:tasks.workunit.client.0.smithi070.stdout:1/531: chown d4/d32/d34/d44/d4b/f8f 2222 1 2024-09-20T20:31:42.020 INFO:tasks.workunit.client.0.smithi070.stdout:6/522: mkdir d4/d8/d68/d93/dba 0 2024-09-20T20:31:42.020 INFO:tasks.workunit.client.0.smithi070.stdout:8/529: dread d4/d27/f2f [0,4194304] 0 2024-09-20T20:31:42.021 INFO:tasks.workunit.client.0.smithi070.stdout:1/532: mkdir d4/d32/d60/dca 0 2024-09-20T20:31:42.021 INFO:tasks.workunit.client.0.smithi070.stdout:0/549: symlink d4/d8/d12/d43/d3b/da9/lad 0 2024-09-20T20:31:42.022 INFO:tasks.workunit.client.0.smithi070.stdout:1/533: mknod d4/d32/d60/ccb 0 2024-09-20T20:31:42.023 INFO:tasks.workunit.client.0.smithi070.stdout:8/530: rmdir d4/d27/d2a/d5b/d6c 39 2024-09-20T20:31:42.023 INFO:tasks.workunit.client.0.smithi070.stdout:1/534: fsync d4/d32/d34/d44/f55 0 2024-09-20T20:31:42.025 INFO:tasks.workunit.client.0.smithi070.stdout:8/531: stat d4/d27/d2a/d43/d61 0 2024-09-20T20:31:42.026 INFO:tasks.workunit.client.0.smithi070.stdout:4/496: dwrite d6/d7/dc/f4d [0,4194304] 0 2024-09-20T20:31:42.027 INFO:tasks.workunit.client.0.smithi070.stdout:8/532: chown d4/d27/d2a/d3e/d31/d63 174739472 1 2024-09-20T20:31:42.029 INFO:tasks.workunit.client.0.smithi070.stdout:5/459: dwrite d2/df/d40/d46/d4c/f44 [0,4194304] 0 2024-09-20T20:31:42.030 INFO:tasks.workunit.client.0.smithi070.stdout:8/533: creat d4/d27/d2a/d5b/d6c/da6/fb9 x:0 0 0 2024-09-20T20:31:42.031 INFO:tasks.workunit.client.0.smithi070.stdout:0/550: dwrite d4/d19/fa2 [0,4194304] 0 2024-09-20T20:31:42.032 INFO:tasks.workunit.client.0.smithi070.stdout:6/523: dwrite d4/d8/d17/f34 [0,4194304] 0 2024-09-20T20:31:42.032 INFO:tasks.workunit.client.0.smithi070.stdout:0/551: creat d4/d8/d12/d23/d26/d1f/fae x:0 0 0 2024-09-20T20:31:42.035 INFO:tasks.workunit.client.0.smithi070.stdout:6/524: unlink d4/d8/d38/f95 0 2024-09-20T20:31:42.035 INFO:tasks.workunit.client.0.smithi070.stdout:8/534: dread - d4/db/d64/d95/da5/fab zero size 2024-09-20T20:31:42.037 INFO:tasks.workunit.client.0.smithi070.stdout:8/535: stat d4/d27/d2a/d3e/f56 0 2024-09-20T20:31:42.037 INFO:tasks.workunit.client.0.smithi070.stdout:5/460: dwrite d2/d7/d88/f4d [0,4194304] 0 2024-09-20T20:31:42.039 INFO:tasks.workunit.client.0.smithi070.stdout:6/525: symlink d4/d8/d17/d33/d36/lbb 0 2024-09-20T20:31:42.040 INFO:tasks.workunit.client.0.smithi070.stdout:5/461: creat d2/d7/d60/f93 x:0 0 0 2024-09-20T20:31:42.042 INFO:tasks.workunit.client.0.smithi070.stdout:0/552: dwrite d4/d48/d67/fab [0,4194304] 0 2024-09-20T20:31:42.042 INFO:tasks.workunit.client.0.smithi070.stdout:6/526: creat d4/d8/d10/d54/d7a/fbc x:0 0 0 2024-09-20T20:31:42.043 INFO:tasks.workunit.client.0.smithi070.stdout:7/376: dwrite d2/d19/d2e/f41 [0,4194304] 0 2024-09-20T20:31:42.043 INFO:tasks.workunit.client.0.smithi070.stdout:8/536: getdents d4/d27/d2a/d3e/d39 0 2024-09-20T20:31:42.044 INFO:tasks.workunit.client.0.smithi070.stdout:2/493: dread d3/d5/d9/f48 [0,4194304] 0 2024-09-20T20:31:42.044 INFO:tasks.workunit.client.0.smithi070.stdout:0/553: read - d4/d8/d12/d23/d26/d2d/f96 zero size 2024-09-20T20:31:42.044 INFO:tasks.workunit.client.0.smithi070.stdout:7/377: write d2/f1b [2339448,27342] 0 2024-09-20T20:31:42.044 INFO:tasks.workunit.client.0.smithi070.stdout:6/527: mkdir d4/d8/db4/dbd 0 2024-09-20T20:31:42.045 INFO:tasks.workunit.client.0.smithi070.stdout:8/537: fsync d4/db/d64/f93 0 2024-09-20T20:31:42.045 INFO:tasks.workunit.client.0.smithi070.stdout:0/554: chown d4/d8/ce 1215 1 2024-09-20T20:31:42.046 INFO:tasks.workunit.client.0.smithi070.stdout:6/528: symlink d4/d8/d17/lbe 0 2024-09-20T20:31:42.047 INFO:tasks.workunit.client.0.smithi070.stdout:3/443: sync 2024-09-20T20:31:42.047 INFO:tasks.workunit.client.0.smithi070.stdout:8/538: creat d4/db/d66/d8d/fba x:0 0 0 2024-09-20T20:31:42.048 INFO:tasks.workunit.client.0.smithi070.stdout:0/555: symlink d4/d8/d12/d23/laf 0 2024-09-20T20:31:42.048 INFO:tasks.workunit.client.0.smithi070.stdout:6/529: write d4/d8/d10/f65 [9031824,126627] 0 2024-09-20T20:31:42.048 INFO:tasks.workunit.client.0.smithi070.stdout:5/462: dread d2/df/d40/d46/f5a [0,4194304] 0 2024-09-20T20:31:42.051 INFO:tasks.workunit.client.0.smithi070.stdout:5/463: chown d2/df/d40/l6e 0 1 2024-09-20T20:31:42.051 INFO:tasks.workunit.client.0.smithi070.stdout:1/535: dwrite d4/d6/d11/d7b/d83/fba [0,4194304] 0 2024-09-20T20:31:42.051 INFO:tasks.workunit.client.0.smithi070.stdout:8/539: rmdir d4/d27/d2a/d5b/d6c 39 2024-09-20T20:31:42.051 INFO:tasks.workunit.client.0.smithi070.stdout:3/444: creat d7/d15/d1a/d48/d57/f85 x:0 0 0 2024-09-20T20:31:42.052 INFO:tasks.workunit.client.0.smithi070.stdout:4/497: dread d6/d7/f16 [0,4194304] 0 2024-09-20T20:31:42.052 INFO:tasks.workunit.client.0.smithi070.stdout:6/530: write d4/d8/d10/f6f [6591,92553] 0 2024-09-20T20:31:42.052 INFO:tasks.workunit.client.0.smithi070.stdout:9/517: dread d1/f1f [0,4194304] 0 2024-09-20T20:31:42.052 INFO:tasks.workunit.client.0.smithi070.stdout:0/556: creat d4/d8/fb0 x:0 0 0 2024-09-20T20:31:42.054 INFO:tasks.workunit.client.0.smithi070.stdout:1/536: rename d4/f15 to d4/d32/d60/dca/fcc 0 2024-09-20T20:31:42.054 INFO:tasks.workunit.client.0.smithi070.stdout:4/498: write d6/d26/f9c [694149,66492] 0 2024-09-20T20:31:42.054 INFO:tasks.workunit.client.0.smithi070.stdout:8/540: symlink d4/db/d64/d95/da5/lbb 0 2024-09-20T20:31:42.056 INFO:tasks.workunit.client.0.smithi070.stdout:2/494: dwrite d3/d4c/d5c/fa2 [0,4194304] 0 2024-09-20T20:31:42.056 INFO:tasks.workunit.client.0.smithi070.stdout:5/464: write d2/df/d40/d46/d4c/f3a [856277,102266] 0 2024-09-20T20:31:42.056 INFO:tasks.workunit.client.0.smithi070.stdout:6/531: fsync d4/d8/d10/f2d 0 2024-09-20T20:31:42.056 INFO:tasks.workunit.client.0.smithi070.stdout:9/518: creat d1/df/d38/dac/fbf x:0 0 0 2024-09-20T20:31:42.056 INFO:tasks.workunit.client.0.smithi070.stdout:1/537: symlink d4/d6/d11/d2c/d3a/d9d/lcd 0 2024-09-20T20:31:42.059 INFO:tasks.workunit.client.0.smithi070.stdout:6/532: write d4/d8/d1e/d7e/f91 [811454,110393] 0 2024-09-20T20:31:42.059 INFO:tasks.workunit.client.0.smithi070.stdout:9/519: mkdir d1/df/d84/dc0 0 2024-09-20T20:31:42.059 INFO:tasks.workunit.client.0.smithi070.stdout:3/445: link d7/d15/l4b d7/d15/d1a/d48/d66/d69/d13/l86 0 2024-09-20T20:31:42.059 INFO:tasks.workunit.client.0.smithi070.stdout:5/465: readlink d2/df/d40/d46/d5b/l2c 0 2024-09-20T20:31:42.060 INFO:tasks.workunit.client.0.smithi070.stdout:8/541: rename d4/db/d64/d95/da5/lbb to d4/db/d64/d7b/lbc 0 2024-09-20T20:31:42.061 INFO:tasks.workunit.client.0.smithi070.stdout:3/446: rmdir d7/d15/d1a 39 2024-09-20T20:31:42.061 INFO:tasks.workunit.client.0.smithi070.stdout:1/538: link d4/d6/dae/lb8 d4/d32/d60/lce 0 2024-09-20T20:31:42.062 INFO:tasks.workunit.client.0.smithi070.stdout:5/466: symlink d2/d7/d88/l94 0 2024-09-20T20:31:42.063 INFO:tasks.workunit.client.0.smithi070.stdout:2/495: link d3/d5/d9/d79/la5 d3/d5/d9/d1c/lb4 0 2024-09-20T20:31:42.063 INFO:tasks.workunit.client.0.smithi070.stdout:6/533: rename d4/d8/d1e/c40 to d4/d8/d17/d33/d61/d73/cbf 0 2024-09-20T20:31:42.066 INFO:tasks.workunit.client.0.smithi070.stdout:0/557: dwrite d4/d48/d7b/d8c/f93 [0,4194304] 0 2024-09-20T20:31:42.066 INFO:tasks.workunit.client.0.smithi070.stdout:5/467: creat d2/d4/d53/f95 x:0 0 0 2024-09-20T20:31:42.066 INFO:tasks.workunit.client.0.smithi070.stdout:4/499: dwrite d6/d7/dc/f4b [0,4194304] 0 2024-09-20T20:31:42.066 INFO:tasks.workunit.client.0.smithi070.stdout:6/534: creat d4/d8/d17/fc0 x:0 0 0 2024-09-20T20:31:42.068 INFO:tasks.workunit.client.0.smithi070.stdout:7/378: dread d2/f1b [0,4194304] 0 2024-09-20T20:31:42.070 INFO:tasks.workunit.client.0.smithi070.stdout:3/447: link d7/d15/d1a/l64 d7/d15/d1a/d48/d66/d69/d13/d1d/l87 0 2024-09-20T20:31:42.072 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:42.068+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:42.072 INFO:tasks.workunit.client.0.smithi070.stdout:6/535: symlink d4/d8/d1e/db7/lc1 0 2024-09-20T20:31:42.073 INFO:tasks.workunit.client.0.smithi070.stdout:1/539: dwrite d4/d6/d11/f18 [0,4194304] 0 2024-09-20T20:31:42.074 INFO:tasks.workunit.client.0.smithi070.stdout:5/468: dread d2/d4/d53/d59/f8d [0,4194304] 0 2024-09-20T20:31:42.074 INFO:tasks.workunit.client.0.smithi070.stdout:2/496: dwrite d3/d5/dd/f63 [0,4194304] 0 2024-09-20T20:31:42.074 INFO:tasks.workunit.client.0.smithi070.stdout:9/520: truncate d1/df/d18/d46/fbb 598346 0 2024-09-20T20:31:42.074 INFO:tasks.workunit.client.0.smithi070.stdout:0/558: creat d4/d8/d12/d23/d26/d2d/fb1 x:0 0 0 2024-09-20T20:31:42.075 INFO:tasks.workunit.client.0.smithi070.stdout:3/448: mkdir d7/d15/d1a/d4a/d51/d5b/d88 0 2024-09-20T20:31:42.075 INFO:tasks.workunit.client.0.smithi070.stdout:6/536: symlink d4/d8/db4/lc2 0 2024-09-20T20:31:42.075 INFO:tasks.workunit.client.0.smithi070.stdout:1/540: write d4/d6/d11/d63/d6c/f85 [4787558,25114] 0 2024-09-20T20:31:42.076 INFO:tasks.workunit.client.0.smithi070.stdout:2/497: creat d3/d5/d9/d10/fb5 x:0 0 0 2024-09-20T20:31:42.076 INFO:tasks.workunit.client.0.smithi070.stdout:5/469: mknod d2/df/c96 0 2024-09-20T20:31:42.077 INFO:tasks.workunit.client.0.smithi070.stdout:9/521: fdatasync d1/df/d25/d69/f8d 0 2024-09-20T20:31:42.077 INFO:tasks.workunit.client.0.smithi070.stdout:3/449: write d7/d15/d1a/f4e [3059348,29816] 0 2024-09-20T20:31:42.077 INFO:tasks.workunit.client.0.smithi070.stdout:5/470: chown d2/d7/d60/c72 98721065 1 2024-09-20T20:31:42.078 INFO:tasks.workunit.client.0.smithi070.stdout:0/559: rename d4/d48/d7d to d4/d8/d12/d23/db2 0 2024-09-20T20:31:42.078 INFO:tasks.workunit.client.0.smithi070.stdout:4/500: dwrite d6/f8 [0,4194304] 0 2024-09-20T20:31:42.078 INFO:tasks.workunit.client.0.smithi070.stdout:1/541: readlink d4/d6/d11/d2c/d3a/d9d/db7/l79 0 2024-09-20T20:31:42.079 INFO:tasks.workunit.client.0.smithi070.stdout:5/471: stat d2/df/d40/d46/d4c/f64 0 2024-09-20T20:31:42.080 INFO:tasks.workunit.client.0.smithi070.stdout:7/379: dwrite d2/d19/d25/d2a/d5c/f5d [0,4194304] 0 2024-09-20T20:31:42.082 INFO:tasks.workunit.client.0.smithi070.stdout:1/542: creat d4/d32/fcf x:0 0 0 2024-09-20T20:31:42.082 INFO:tasks.workunit.client.0.smithi070.stdout:0/560: creat d4/d8/d55/fb3 x:0 0 0 2024-09-20T20:31:42.082 INFO:tasks.workunit.client.0.smithi070.stdout:3/450: rename f0 to d7/d15/d1a/d48/d57/f89 0 2024-09-20T20:31:42.082 INFO:tasks.workunit.client.0.smithi070.stdout:5/472: mknod d2/d4/d53/c97 0 2024-09-20T20:31:42.082 INFO:tasks.workunit.client.0.smithi070.stdout:7/380: symlink d2/l74 0 2024-09-20T20:31:42.083 INFO:tasks.workunit.client.0.smithi070.stdout:5/473: write d2/d7/d88/f83 [2670959,64077] 0 2024-09-20T20:31:42.083 INFO:tasks.workunit.client.0.smithi070.stdout:3/451: truncate d7/d15/d1a/d48/f50 1947508 0 2024-09-20T20:31:42.083 INFO:tasks.workunit.client.0.smithi070.stdout:2/498: link d3/d5/d9/d1c/d1f/d3e/c8e d3/de/d12/d1a/cb6 0 2024-09-20T20:31:42.083 INFO:tasks.workunit.client.0.smithi070.stdout:0/561: symlink d4/d48/d4e/lb4 0 2024-09-20T20:31:42.084 INFO:tasks.workunit.client.0.smithi070.stdout:1/543: symlink d4/d6/d11/d7b/ld0 0 2024-09-20T20:31:42.084 INFO:tasks.workunit.client.0.smithi070.stdout:0/562: sync 2024-09-20T20:31:42.084 INFO:tasks.workunit.client.0.smithi070.stdout:7/381: unlink d2/d8/l46 0 2024-09-20T20:31:42.084 INFO:tasks.workunit.client.0.smithi070.stdout:9/522: dread d1/df/d18/d46/f7f [0,4194304] 0 2024-09-20T20:31:42.085 INFO:tasks.workunit.client.0.smithi070.stdout:9/523: sync 2024-09-20T20:31:42.085 INFO:tasks.workunit.client.0.smithi070.stdout:3/452: fdatasync d7/d15/d1a/f32 0 2024-09-20T20:31:42.086 INFO:tasks.workunit.client.0.smithi070.stdout:7/382: rmdir d2/d30 39 2024-09-20T20:31:42.086 INFO:tasks.workunit.client.0.smithi070.stdout:1/544: creat d4/d32/fd1 x:0 0 0 2024-09-20T20:31:42.086 INFO:tasks.workunit.client.0.smithi070.stdout:5/474: rename d2/df/d40/d46 to d2/d4/d98 0 2024-09-20T20:31:42.086 INFO:tasks.workunit.client.0.smithi070.stdout:9/524: creat d1/df/d38/fc1 x:0 0 0 2024-09-20T20:31:42.086 INFO:tasks.workunit.client.0.smithi070.stdout:0/563: creat d4/d8/d12/d23/d26/d1d/d37/fb5 x:0 0 0 2024-09-20T20:31:42.087 INFO:tasks.workunit.client.0.smithi070.stdout:2/499: mkdir d3/d4c/d5c/db7 0 2024-09-20T20:31:42.087 INFO:tasks.workunit.client.0.smithi070.stdout:0/564: stat d4/d8/d12/f14 0 2024-09-20T20:31:42.089 INFO:tasks.workunit.client.0.smithi070.stdout:9/525: mknod d1/df/d25/d9e/cc2 0 2024-09-20T20:31:42.089 INFO:tasks.workunit.client.0.smithi070.stdout:0/565: mkdir d4/d8/db6 0 2024-09-20T20:31:42.089 INFO:tasks.workunit.client.0.smithi070.stdout:2/500: fsync d3/d5/d9/d1c/d1f/d3e/d92/faf 0 2024-09-20T20:31:42.092 INFO:tasks.workunit.client.0.smithi070.stdout:7/383: dwrite d2/d19/d25/d61/f6f [4194304,4194304] 0 2024-09-20T20:31:42.093 INFO:tasks.workunit.client.0.smithi070.stdout:4/501: truncate d6/d43/d5a/f68 2202949 0 2024-09-20T20:31:42.094 INFO:tasks.workunit.client.0.smithi070.stdout:9/526: dread d1/df/d25/d69/f8d [0,4194304] 0 2024-09-20T20:31:42.094 INFO:tasks.workunit.client.0.smithi070.stdout:0/566: read d4/f16 [1667836,70773] 0 2024-09-20T20:31:42.094 INFO:tasks.workunit.client.0.smithi070.stdout:3/453: write d7/d15/d1e/f49 [3377433,43298] 0 2024-09-20T20:31:42.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/527: creat d1/df/d38/fc3 x:0 0 0 2024-09-20T20:31:42.096 INFO:tasks.workunit.client.0.smithi070.stdout:1/545: dread d4/d6/d26/f70 [0,4194304] 0 2024-09-20T20:31:42.098 INFO:tasks.workunit.client.0.smithi070.stdout:1/546: mkdir d4/d32/d60/dca/dd2 0 2024-09-20T20:31:42.099 INFO:tasks.workunit.client.0.smithi070.stdout:9/528: mkdir d1/df/d25/dc4 0 2024-09-20T20:31:42.099 INFO:tasks.workunit.client.0.smithi070.stdout:5/475: dwrite d2/d7/d88/f4d [4194304,4194304] 0 2024-09-20T20:31:42.099 INFO:tasks.workunit.client.0.smithi070.stdout:3/454: truncate d7/d15/d1a/d48/d57/f59 5724592 0 2024-09-20T20:31:42.100 INFO:tasks.workunit.client.0.smithi070.stdout:3/455: sync 2024-09-20T20:31:42.100 INFO:tasks.workunit.client.0.smithi070.stdout:7/384: dread d2/d19/f73 [0,4194304] 0 2024-09-20T20:31:42.100 INFO:tasks.workunit.client.0.smithi070.stdout:1/547: mkdir d4/d32/d34/dd3 0 2024-09-20T20:31:42.100 INFO:tasks.workunit.client.0.smithi070.stdout:1/548: sync 2024-09-20T20:31:42.101 INFO:tasks.workunit.client.0.smithi070.stdout:9/529: mknod d1/d76/daa/cc5 0 2024-09-20T20:31:42.101 INFO:tasks.workunit.client.0.smithi070.stdout:5/476: getdents d2/d4/d53/d59 0 2024-09-20T20:31:42.103 INFO:tasks.workunit.client.0.smithi070.stdout:7/385: mknod d2/d30/d63/c75 0 2024-09-20T20:31:42.104 INFO:tasks.workunit.client.0.smithi070.stdout:3/456: read d7/d15/d1a/d48/d66/d69/f11 [1450653,111053] 0 2024-09-20T20:31:42.104 INFO:tasks.workunit.client.0.smithi070.stdout:5/477: mknod d2/d4/c99 0 2024-09-20T20:31:42.105 INFO:tasks.workunit.client.0.smithi070.stdout:6/537: dread d4/d8/f1f [0,4194304] 0 2024-09-20T20:31:42.105 INFO:tasks.workunit.client.0.smithi070.stdout:7/386: creat d2/d19/d25/d42/f76 x:0 0 0 2024-09-20T20:31:42.105 INFO:tasks.workunit.client.0.smithi070.stdout:3/457: chown d7/d15/d1a/d48/d57/f89 724286 1 2024-09-20T20:31:42.107 INFO:tasks.workunit.client.0.smithi070.stdout:0/567: dwrite d4/d13/f9d [0,4194304] 0 2024-09-20T20:31:42.107 INFO:tasks.workunit.client.0.smithi070.stdout:6/538: readlink d4/d8/d17/d33/d61/d73/l77 0 2024-09-20T20:31:42.107 INFO:tasks.workunit.client.0.smithi070.stdout:7/387: mkdir d2/d19/d25/d42/d77 0 2024-09-20T20:31:42.107 INFO:tasks.workunit.client.0.smithi070.stdout:9/530: write d1/df/d18/d46/fbb [161377,31183] 0 2024-09-20T20:31:42.107 INFO:tasks.workunit.client.0.smithi070.stdout:5/478: write d2/d4/d98/d5b/f26 [1738411,33697] 0 2024-09-20T20:31:42.108 INFO:tasks.workunit.client.0.smithi070.stdout:7/388: mkdir d2/d30/d78 0 2024-09-20T20:31:42.108 INFO:tasks.workunit.client.0.smithi070.stdout:3/458: creat d7/d15/d1a/d48/d66/d69/d13/d72/f8a x:0 0 0 2024-09-20T20:31:42.108 INFO:tasks.workunit.client.0.smithi070.stdout:6/539: write d4/d8/d38/f7d [3004193,35138] 0 2024-09-20T20:31:42.109 INFO:tasks.workunit.client.0.smithi070.stdout:5/479: creat d2/d4/de/d47/d67/f9a x:0 0 0 2024-09-20T20:31:42.109 INFO:tasks.workunit.client.0.smithi070.stdout:7/389: chown d2/d19/d25/d42 3340 1 2024-09-20T20:31:42.109 INFO:tasks.workunit.client.0.smithi070.stdout:0/568: creat d4/d8/d12/d23/d26/d1d/d37/d38/fb7 x:0 0 0 2024-09-20T20:31:42.110 INFO:tasks.workunit.client.0.smithi070.stdout:9/531: creat d1/df/d18/d44/fc6 x:0 0 0 2024-09-20T20:31:42.111 INFO:tasks.workunit.client.0.smithi070.stdout:9/532: stat d1/f61 0 2024-09-20T20:31:42.111 INFO:tasks.workunit.client.0.smithi070.stdout:3/459: mknod d7/d15/d1a/d48/d66/d69/d13/c8b 0 2024-09-20T20:31:42.111 INFO:tasks.workunit.client.0.smithi070.stdout:5/480: symlink d2/d7/d60/l9b 0 2024-09-20T20:31:42.111 INFO:tasks.workunit.client.0.smithi070.stdout:0/569: mknod d4/d8/d12/d43/d3b/da9/cb8 0 2024-09-20T20:31:42.112 INFO:tasks.workunit.client.0.smithi070.stdout:6/540: write d4/d8/d10/d54/d64/f84 [158918,101177] 0 2024-09-20T20:31:42.112 INFO:tasks.workunit.client.0.smithi070.stdout:7/390: rename d2/d30/f39 to d2/d19/d25/d42/f79 0 2024-09-20T20:31:42.112 INFO:tasks.workunit.client.0.smithi070.stdout:9/533: truncate d1/d76/f9b 1037733 0 2024-09-20T20:31:42.113 INFO:tasks.workunit.client.0.smithi070.stdout:7/391: symlink d2/d30/l7a 0 2024-09-20T20:31:42.113 INFO:tasks.workunit.client.0.smithi070.stdout:1/549: dwrite d4/d6/d11/d7b/d83/f95 [0,4194304] 0 2024-09-20T20:31:42.113 INFO:tasks.workunit.client.0.smithi070.stdout:3/460: write d7/d15/d1a/d48/d66/d69/d13/d72/f8a [878168,27579] 0 2024-09-20T20:31:42.114 INFO:tasks.workunit.client.0.smithi070.stdout:9/534: fdatasync d1/df/d38/fc1 0 2024-09-20T20:31:42.114 INFO:tasks.workunit.client.0.smithi070.stdout:6/541: creat d4/d8/d1e/fc3 x:0 0 0 2024-09-20T20:31:42.114 INFO:tasks.workunit.client.0.smithi070.stdout:0/570: write d4/d8/d12/d23/d26/d2d/fb1 [196778,14860] 0 2024-09-20T20:31:42.115 INFO:tasks.workunit.client.0.smithi070.stdout:5/481: link d2/df/c96 d2/d4/d53/c9c 0 2024-09-20T20:31:42.115 INFO:tasks.workunit.client.0.smithi070.stdout:6/542: readlink d4/d8/d17/lbe 0 2024-09-20T20:31:42.116 INFO:tasks.workunit.client.0.smithi070.stdout:0/571: chown d4/d8/d55/fb3 48307 1 2024-09-20T20:31:42.116 INFO:tasks.workunit.client.0.smithi070.stdout:3/461: creat d7/d15/d1a/d80/f8c x:0 0 0 2024-09-20T20:31:42.116 INFO:tasks.workunit.client.0.smithi070.stdout:6/543: truncate d4/d8/d17/f49 594518 0 2024-09-20T20:31:42.116 INFO:tasks.workunit.client.0.smithi070.stdout:9/535: symlink d1/df/d18/d44/d77/db8/lc7 0 2024-09-20T20:31:42.116 INFO:tasks.workunit.client.0.smithi070.stdout:3/462: read - d7/d15/d1a/d4a/f55 zero size 2024-09-20T20:31:42.117 INFO:tasks.workunit.client.0.smithi070.stdout:9/536: chown d1/f2a 489419 1 2024-09-20T20:31:42.117 INFO:tasks.workunit.client.0.smithi070.stdout:0/572: readlink d4/d8/d12/d23/d26/d1d/d37/l92 0 2024-09-20T20:31:42.117 INFO:tasks.workunit.client.0.smithi070.stdout:9/537: stat d1/df/d38/dac 0 2024-09-20T20:31:42.119 INFO:tasks.workunit.client.0.smithi070.stdout:3/463: rename d7/d15/f67 to d7/d15/d1a/d48/d66/d69/f8d 0 2024-09-20T20:31:42.119 INFO:tasks.workunit.client.0.smithi070.stdout:1/550: dread d4/d6/d11/d63/d6c/f9c [4194304,4194304] 0 2024-09-20T20:31:42.120 INFO:tasks.workunit.client.0.smithi070.stdout:3/464: mkdir d7/d15/d1a/d80/d8e 0 2024-09-20T20:31:42.120 INFO:tasks.workunit.client.0.smithi070.stdout:1/551: fsync d4/d6/d11/d63/f76 0 2024-09-20T20:31:42.120 INFO:tasks.workunit.client.0.smithi070.stdout:9/538: rename d1/df/d25/d69/d85/dad/c72 to d1/df/d25/cc8 0 2024-09-20T20:31:42.120 INFO:tasks.workunit.client.0.smithi070.stdout:1/552: dread - d4/d32/fd1 zero size 2024-09-20T20:31:42.122 INFO:tasks.workunit.client.0.smithi070.stdout:9/539: creat d1/df/d18/fc9 x:0 0 0 2024-09-20T20:31:42.122 INFO:tasks.workunit.client.0.smithi070.stdout:0/573: dread d4/d48/d67/fab [0,4194304] 0 2024-09-20T20:31:42.123 INFO:tasks.workunit.client.0.smithi070.stdout:5/482: dwrite d2/df/f55 [0,4194304] 0 2024-09-20T20:31:42.123 INFO:tasks.workunit.client.0.smithi070.stdout:9/540: write d1/df/d25/d69/f8d [1235283,89865] 0 2024-09-20T20:31:42.123 INFO:tasks.workunit.client.0.smithi070.stdout:0/574: creat d4/d19/fb9 x:0 0 0 2024-09-20T20:31:42.124 INFO:tasks.workunit.client.0.smithi070.stdout:1/553: link d4/d32/d60/dca/fcc d4/d32/d34/d44/d4b/d87/fd4 0 2024-09-20T20:31:42.124 INFO:tasks.workunit.client.0.smithi070.stdout:9/541: stat d1/df/d18 0 2024-09-20T20:31:42.126 INFO:tasks.workunit.client.0.smithi070.stdout:5/483: rmdir d2/d4/d98/d5b 39 2024-09-20T20:31:42.126 INFO:tasks.workunit.client.0.smithi070.stdout:6/544: truncate d4/d8/d38/f5d 3895144 0 2024-09-20T20:31:42.126 INFO:tasks.workunit.client.0.smithi070.stdout:9/542: unlink d1/df/l10 0 2024-09-20T20:31:42.126 INFO:tasks.workunit.client.0.smithi070.stdout:9/543: sync 2024-09-20T20:31:42.127 INFO:tasks.workunit.client.0.smithi070.stdout:6/545: chown d4/d8/d10/d54/la1 79770 1 2024-09-20T20:31:42.128 INFO:tasks.workunit.client.0.smithi070.stdout:0/575: dread d4/d48/d67/fab [0,4194304] 0 2024-09-20T20:31:42.128 INFO:tasks.workunit.client.0.smithi070.stdout:0/576: sync 2024-09-20T20:31:42.129 INFO:tasks.workunit.client.0.smithi070.stdout:5/484: mkdir d2/df/d9d 0 2024-09-20T20:31:42.129 INFO:tasks.workunit.client.0.smithi070.stdout:8/542: dread d4/d27/d2a/d43/d61/f62 [0,4194304] 0 2024-09-20T20:31:42.130 INFO:tasks.workunit.client.0.smithi070.stdout:4/502: fdatasync d6/d7/dc/f8a 0 2024-09-20T20:31:42.130 INFO:tasks.workunit.client.0.smithi070.stdout:9/544: dread d1/df/f22 [4194304,4194304] 0 2024-09-20T20:31:42.130 INFO:tasks.workunit.client.0.smithi070.stdout:9/545: sync 2024-09-20T20:31:42.131 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:42.131 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:42.131 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:42.131 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:42.132 INFO:tasks.workunit.client.0.smithi070.stdout:5/485: fsync d2/d4/d98/d4c/f64 0 2024-09-20T20:31:42.132 INFO:tasks.workunit.client.0.smithi070.stdout:2/501: dread f2 [8388608,4194304] 0 2024-09-20T20:31:42.132 INFO:tasks.workunit.client.0.smithi070.stdout:0/577: creat d4/d8/d12/d23/d26/d1d/d41/fba x:0 0 0 2024-09-20T20:31:42.132 INFO:tasks.workunit.client.0.smithi070.stdout:8/543: write d4/d27/d2a/f20 [9147787,23799] 0 2024-09-20T20:31:42.133 INFO:tasks.workunit.client.0.smithi070.stdout:5/486: rmdir d2/d4/de/d47/d67/d92 39 2024-09-20T20:31:42.134 INFO:tasks.workunit.client.0.smithi070.stdout:9/546: link d1/df/d18/d46/fbe d1/df/d25/d69/fca 0 2024-09-20T20:31:42.134 INFO:tasks.workunit.client.0.smithi070.stdout:0/578: fdatasync d4/d8/d12/d23/d26/d1d/d37/d38/f63 0 2024-09-20T20:31:42.135 INFO:tasks.workunit.client.0.smithi070.stdout:2/502: getdents d3/d5/d9/d1c 0 2024-09-20T20:31:42.135 INFO:tasks.workunit.client.0.smithi070.stdout:1/554: dwrite d4/d6/f14 [4194304,4194304] 0 2024-09-20T20:31:42.138 INFO:tasks.workunit.client.0.smithi070.stdout:8/544: rename d4/d27/d42/c7f to d4/d27/d2a/d5b/d6c/cbd 0 2024-09-20T20:31:42.138 INFO:tasks.workunit.client.0.smithi070.stdout:2/503: readlink d3/d5/d9/d42/l50 0 2024-09-20T20:31:42.139 INFO:tasks.workunit.client.0.smithi070.stdout:5/487: creat d2/d4/d98/f9e x:0 0 0 2024-09-20T20:31:42.140 INFO:tasks.workunit.client.0.smithi070.stdout:0/579: mknod d4/d8/d12/d23/d26/d1d/d37/cbb 0 2024-09-20T20:31:42.140 INFO:tasks.workunit.client.0.smithi070.stdout:8/545: write d4/d27/d2a/d3e/f56 [5175835,30066] 0 2024-09-20T20:31:42.141 INFO:tasks.workunit.client.0.smithi070.stdout:6/546: truncate d4/f7 195942 0 2024-09-20T20:31:42.141 INFO:tasks.workunit.client.0.smithi070.stdout:9/547: dwrite d1/f14 [0,4194304] 0 2024-09-20T20:31:42.142 INFO:tasks.workunit.client.0.smithi070.stdout:9/548: readlink d1/d76/l5d 0 2024-09-20T20:31:42.143 INFO:tasks.workunit.client.0.smithi070.stdout:8/546: creat d4/db/d64/d95/fbe x:0 0 0 2024-09-20T20:31:42.143 INFO:tasks.workunit.client.0.smithi070.stdout:9/549: fdatasync d1/f61 0 2024-09-20T20:31:42.143 INFO:tasks.workunit.client.0.smithi070.stdout:6/547: write d4/d8/d10/db3/fad [1032553,31880] 0 2024-09-20T20:31:42.146 INFO:tasks.workunit.client.0.smithi070.stdout:4/503: dread d6/d7/f3e [0,4194304] 0 2024-09-20T20:31:42.147 INFO:tasks.workunit.client.0.smithi070.stdout:7/392: dread d2/d19/d25/d2a/f6b [0,4194304] 0 2024-09-20T20:31:42.147 INFO:tasks.workunit.client.0.smithi070.stdout:8/547: truncate d4/db/d64/d7b/f8f 1013417 0 2024-09-20T20:31:42.147 INFO:tasks.workunit.client.0.smithi070.stdout:9/550: rename d1/df/d38/c60 to d1/df/d18/d44/da2/db6/ccb 0 2024-09-20T20:31:42.147 INFO:tasks.workunit.client.0.smithi070.stdout:2/504: dwrite d3/f36 [0,4194304] 0 2024-09-20T20:31:42.148 INFO:tasks.workunit.client.0.smithi070.stdout:6/548: link d4/d8/d17/fc0 d4/d8/d17/d33/fc4 0 2024-09-20T20:31:42.148 INFO:tasks.workunit.client.0.smithi070.stdout:1/555: dwrite d4/d32/d34/d44/d48/f5e [0,4194304] 0 2024-09-20T20:31:42.149 INFO:tasks.workunit.client.0.smithi070.stdout:7/393: fdatasync d2/d19/d25/d2a/d5c/f72 0 2024-09-20T20:31:42.149 INFO:tasks.workunit.client.0.smithi070.stdout:9/551: readlink d1/df/d18/l36 0 2024-09-20T20:31:42.149 INFO:tasks.workunit.client.0.smithi070.stdout:2/505: fsync d3/d5/d9/d42/f59 0 2024-09-20T20:31:42.149 INFO:tasks.workunit.client.0.smithi070.stdout:8/548: readlink d4/d27/d73/l76 0 2024-09-20T20:31:42.150 INFO:tasks.workunit.client.0.smithi070.stdout:3/465: dread d7/d15/d1a/d48/d66/d69/f33 [0,4194304] 0 2024-09-20T20:31:42.150 INFO:tasks.workunit.client.0.smithi070.stdout:6/549: creat d4/d8/d10/d54/d55/d72/fc5 x:0 0 0 2024-09-20T20:31:42.150 INFO:tasks.workunit.client.0.smithi070.stdout:9/552: write d1/df/d18/d46/f8f [3650379,112952] 0 2024-09-20T20:31:42.151 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:42.152 INFO:tasks.workunit.client.0.smithi070.stdout:1/556: mknod d4/d32/d34/d44/d4b/d87/da9/cd5 0 2024-09-20T20:31:42.152 INFO:tasks.workunit.client.0.smithi070.stdout:1/557: chown d4/f96 101202 1 2024-09-20T20:31:42.153 INFO:tasks.workunit.client.0.smithi070.stdout:6/550: rename d4/d8/f1f to d4/d8/d17/db2/fc6 0 2024-09-20T20:31:42.153 INFO:tasks.workunit.client.0.smithi070.stdout:3/466: creat d7/d15/d1a/d4a/d7d/f8f x:0 0 0 2024-09-20T20:31:42.153 INFO:tasks.workunit.client.0.smithi070.stdout:9/553: mkdir d1/df/d18/d44/da2/dcc 0 2024-09-20T20:31:42.153 INFO:tasks.workunit.client.0.smithi070.stdout:3/467: sync 2024-09-20T20:31:42.154 INFO:tasks.workunit.client.0.smithi070.stdout:6/551: chown d4/d8/d10/d54/d7a/f9e 839 1 2024-09-20T20:31:42.154 INFO:tasks.workunit.client.0.smithi070.stdout:1/558: truncate d4/d32/d60/dca/fcc 4374173 0 2024-09-20T20:31:42.155 INFO:tasks.workunit.client.0.smithi070.stdout:9/554: symlink d1/df/d25/d69/d85/lcd 0 2024-09-20T20:31:42.156 INFO:tasks.workunit.client.0.smithi070.stdout:1/559: write d4/d1f/fb2 [75149,93821] 0 2024-09-20T20:31:42.156 INFO:tasks.workunit.client.0.smithi070.stdout:2/506: dread d3/d5/d9/d1c/d1f/f62 [0,4194304] 0 2024-09-20T20:31:42.156 INFO:tasks.workunit.client.0.smithi070.stdout:1/560: sync 2024-09-20T20:31:42.157 INFO:tasks.workunit.client.0.smithi070.stdout:2/507: read - d3/de/d12/f7a zero size 2024-09-20T20:31:42.158 INFO:tasks.workunit.client.0.smithi070.stdout:9/555: rename d1/d76/daa/cc5 to d1/df/d18/d46/cce 0 2024-09-20T20:31:42.159 INFO:tasks.workunit.client.0.smithi070.stdout:4/504: write d6/d7/dc/d20/f55 [147962,29391] 0 2024-09-20T20:31:42.159 INFO:tasks.workunit.client.0.smithi070.stdout:9/556: stat d1/f7 0 2024-09-20T20:31:42.159 INFO:tasks.workunit.client.0.smithi070.stdout:9/557: sync 2024-09-20T20:31:42.160 INFO:tasks.workunit.client.0.smithi070.stdout:8/549: dwrite d4/d27/d2a/d43/f45 [0,4194304] 0 2024-09-20T20:31:42.160 INFO:tasks.workunit.client.0.smithi070.stdout:1/561: write d4/d6/d11/d2c/d3b/f94 [1467619,87672] 0 2024-09-20T20:31:42.163 INFO:tasks.workunit.client.0.smithi070.stdout:2/508: chown d3/d5/dd/d5a/l96 8239805 1 2024-09-20T20:31:42.163 INFO:tasks.workunit.client.0.smithi070.stdout:9/558: creat d1/df/d25/d9e/fcf x:0 0 0 2024-09-20T20:31:42.163 INFO:tasks.workunit.client.0.smithi070.stdout:3/468: dread d7/d15/d1a/d48/d66/d69/d13/d1d/f47 [0,4194304] 0 2024-09-20T20:31:42.164 INFO:tasks.workunit.client.0.smithi070.stdout:8/550: mknod d4/d27/d2a/d3e/cbf 0 2024-09-20T20:31:42.164 INFO:tasks.workunit.client.0.smithi070.stdout:6/552: dwrite d4/d8/f4c [4194304,4194304] 0 2024-09-20T20:31:42.166 INFO:tasks.workunit.client.0.smithi070.stdout:3/469: chown d7/d15/d1a/d4a/d51/d5b/d88 32595 1 2024-09-20T20:31:42.166 INFO:tasks.workunit.client.0.smithi070.stdout:1/562: getdents d4/d6/d11/d2c/d3a 0 2024-09-20T20:31:42.166 INFO:tasks.workunit.client.0.smithi070.stdout:0/580: dwrite d4/d48/f72 [0,4194304] 0 2024-09-20T20:31:42.167 INFO:tasks.workunit.client.0.smithi070.stdout:9/559: mkdir d1/df/d18/d44/d77/dd0 0 2024-09-20T20:31:42.167 INFO:tasks.workunit.client.0.smithi070.stdout:6/553: write d4/d8/d1e/d7e/f91 [4976884,34637] 0 2024-09-20T20:31:42.167 INFO:tasks.workunit.client.0.smithi070.stdout:5/488: dread d2/f13 [0,4194304] 0 2024-09-20T20:31:42.168 INFO:tasks.workunit.client.0.smithi070.stdout:6/554: write d4/d8/d17/f57 [2505165,27521] 0 2024-09-20T20:31:42.169 INFO:tasks.workunit.client.0.smithi070.stdout:4/505: write d6/d43/d5a/f68 [1760850,72454] 0 2024-09-20T20:31:42.169 INFO:tasks.workunit.client.0.smithi070.stdout:1/563: write d4/d6/f52 [2484459,71393] 0 2024-09-20T20:31:42.169 INFO:tasks.workunit.client.0.smithi070.stdout:3/470: mknod d7/d15/d1e/d60/c90 0 2024-09-20T20:31:42.171 INFO:tasks.workunit.client.0.smithi070.stdout:8/551: mkdir d4/d27/d2a/d5b/d98/da9/db5/dc0 0 2024-09-20T20:31:42.172 INFO:tasks.workunit.client.0.smithi070.stdout:1/564: chown d4/d32/d34/d44/f55 221 1 2024-09-20T20:31:42.174 INFO:tasks.workunit.client.0.smithi070.stdout:7/394: dread d2/d52/f5e [0,4194304] 0 2024-09-20T20:31:42.175 INFO:tasks.workunit.client.0.smithi070.stdout:1/565: creat d4/d6/fd6 x:0 0 0 2024-09-20T20:31:42.176 INFO:tasks.workunit.client.0.smithi070.stdout:7/395: dread - d2/d19/d25/d42/d55/f71 zero size 2024-09-20T20:31:42.177 INFO:tasks.workunit.client.0.smithi070.stdout:5/489: dwrite d2/d7/f31 [0,4194304] 0 2024-09-20T20:31:42.177 INFO:tasks.workunit.client.0.smithi070.stdout:2/509: dwrite d3/f36 [4194304,4194304] 0 2024-09-20T20:31:42.177 INFO:tasks.workunit.client.0.smithi070.stdout:6/555: dwrite d4/d8/d17/f42 [0,4194304] 0 2024-09-20T20:31:42.177 INFO:tasks.workunit.client.0.smithi070.stdout:7/396: readlink d2/d30/l7a 0 2024-09-20T20:31:42.178 INFO:tasks.workunit.client.0.smithi070.stdout:0/581: truncate d4/d8/d12/d23/d26/d1d/d7e/f91 3401134 0 2024-09-20T20:31:42.179 INFO:tasks.workunit.client.0.smithi070.stdout:0/582: sync 2024-09-20T20:31:42.179 INFO:tasks.workunit.client.0.smithi070.stdout:6/556: write d4/d8/d10/d54/d7a/fab [485636,111626] 0 2024-09-20T20:31:42.180 INFO:tasks.workunit.client.0.smithi070.stdout:7/397: fsync d2/d8/f22 0 2024-09-20T20:31:42.180 INFO:tasks.workunit.client.0.smithi070.stdout:2/510: creat d3/d5/d9/d1c/d1f/d3e/d61/db2/fb8 x:0 0 0 2024-09-20T20:31:42.181 INFO:tasks.workunit.client.0.smithi070.stdout:9/560: dread d1/df/d25/d69/d85/dad/f57 [0,4194304] 0 2024-09-20T20:31:42.182 INFO:tasks.workunit.client.0.smithi070.stdout:6/557: chown d4/d8/d38/f5d 23 1 2024-09-20T20:31:42.182 INFO:tasks.workunit.client.0.smithi070.stdout:7/398: write d2/d19/d25/d2a/d5c/f5d [1637304,32169] 0 2024-09-20T20:31:42.182 INFO:tasks.workunit.client.0.smithi070.stdout:9/561: rmdir d1/df/d18/d46 39 2024-09-20T20:31:42.183 INFO:tasks.workunit.client.0.smithi070.stdout:3/471: dwrite f4 [0,4194304] 0 2024-09-20T20:31:42.183 INFO:tasks.workunit.client.0.smithi070.stdout:0/583: truncate d4/d8/d12/d23/d26/d1d/d41/fba 172868 0 2024-09-20T20:31:42.184 INFO:tasks.workunit.client.0.smithi070.stdout:0/584: fdatasync d4/d8/d12/d23/d26/d2d/fb1 0 2024-09-20T20:31:42.185 INFO:tasks.workunit.client.0.smithi070.stdout:6/558: rename d4/d8/d1e/f5f to d4/d8/d10/d54/fc7 0 2024-09-20T20:31:42.185 INFO:tasks.workunit.client.0.smithi070.stdout:3/472: rename d7/d15/d1e/l28 to d7/d15/d1e/d65/l91 0 2024-09-20T20:31:42.186 INFO:tasks.workunit.client.0.smithi070.stdout:1/566: write d4/d6/f21 [328445,123766] 0 2024-09-20T20:31:42.187 INFO:tasks.workunit.client.0.smithi070.stdout:6/559: write d4/f9c [210528,110484] 0 2024-09-20T20:31:42.187 INFO:tasks.workunit.client.0.smithi070.stdout:0/585: link d4/d8/d12/d23/d26/d2d/f96 d4/d48/d7b/fbc 0 2024-09-20T20:31:42.187 INFO:tasks.workunit.client.0.smithi070.stdout:1/567: mkdir d4/d6/d11/d63/dd7 0 2024-09-20T20:31:42.189 INFO:tasks.workunit.client.0.smithi070.stdout:0/586: mkdir d4/d8/d12/d43/d3b/da9/dbd 0 2024-09-20T20:31:42.189 INFO:tasks.workunit.client.0.smithi070.stdout:0/587: read - d4/d1b/f9f zero size 2024-09-20T20:31:42.190 INFO:tasks.workunit.client.0.smithi070.stdout:9/562: dwrite d1/df/d25/d69/d85/dad/f65 [4194304,4194304] 0 2024-09-20T20:31:42.191 INFO:tasks.workunit.client.0.smithi070.stdout:0/588: rename d4/d8/d12/d23/d26/d1d/d41/l64 to d4/d8/d12/d23/d26/d1d/d41/lbe 0 2024-09-20T20:31:42.193 INFO:tasks.workunit.client.0.smithi070.stdout:0/589: chown d4/d8/d12/d23/d26/d1d/d37 1378 1 2024-09-20T20:31:42.193 INFO:tasks.workunit.client.0.smithi070.stdout:9/563: rename d1/df/d25/d69/d85/dad/l31 to d1/df/d18/d44/d90/ld1 0 2024-09-20T20:31:42.194 INFO:tasks.workunit.client.0.smithi070.stdout:4/506: dread d6/f86 [0,4194304] 0 2024-09-20T20:31:42.195 INFO:tasks.workunit.client.0.smithi070.stdout:9/564: unlink d1/df/d25/d69/f75 0 2024-09-20T20:31:42.197 INFO:tasks.workunit.client.0.smithi070.stdout:4/507: write d6/d7/dc/d20/f38 [1640064,54316] 0 2024-09-20T20:31:42.197 INFO:tasks.workunit.client.0.smithi070.stdout:9/565: read d1/df/d25/d69/f8a [237041,8602] 0 2024-09-20T20:31:42.197 INFO:tasks.workunit.client.0.smithi070.stdout:1/568: dwrite d4/d32/d34/d44/d4b/d87/dbb/f5f [0,4194304] 0 2024-09-20T20:31:42.197 INFO:tasks.workunit.client.0.smithi070.stdout:9/566: fsync d1/df/d84/f91 0 2024-09-20T20:31:42.197 INFO:tasks.workunit.client.0.smithi070.stdout:4/508: write d6/d26/d69/d71/f5b [4532979,33391] 0 2024-09-20T20:31:42.198 INFO:tasks.workunit.client.0.smithi070.stdout:4/509: chown d6/d7/dc/l72 772979 1 2024-09-20T20:31:42.199 INFO:tasks.workunit.client.0.smithi070.stdout:5/490: dread d2/d4/de/f34 [0,4194304] 0 2024-09-20T20:31:42.199 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:42.197+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:42.199 INFO:tasks.workunit.client.0.smithi070.stdout:9/567: rename d1/df/c30 to d1/df/d18/d44/da2/dab/cd2 0 2024-09-20T20:31:42.200 INFO:tasks.workunit.client.0.smithi070.stdout:9/568: sync 2024-09-20T20:31:42.200 INFO:tasks.workunit.client.0.smithi070.stdout:5/491: creat d2/df/d75/f9f x:0 0 0 2024-09-20T20:31:42.200 INFO:tasks.workunit.client.0.smithi070.stdout:1/569: read d4/d6/d11/d63/d6c/f85 [1924804,120503] 0 2024-09-20T20:31:42.201 INFO:tasks.workunit.client.0.smithi070.stdout:6/560: dread d4/d8/d17/f24 [0,4194304] 0 2024-09-20T20:31:42.202 INFO:tasks.workunit.client.0.smithi070.stdout:7/399: truncate d2/f10 4430745 0 2024-09-20T20:31:42.203 INFO:tasks.workunit.client.0.smithi070.stdout:9/569: link d1/f11 d1/df/d25/d69/d80/fd3 0 2024-09-20T20:31:42.203 INFO:tasks.workunit.client.0.smithi070.stdout:7/400: read d2/d52/f5e [1603993,45452] 0 2024-09-20T20:31:42.204 INFO:tasks.workunit.client.0.smithi070.stdout:5/492: mkdir d2/d4/d98/d5b/d90/da0 0 2024-09-20T20:31:42.204 INFO:tasks.workunit.client.0.smithi070.stdout:8/552: dread d4/d27/d2a/d5b/d98/fb4 [0,4194304] 0 2024-09-20T20:31:42.205 INFO:tasks.workunit.client.0.smithi070.stdout:5/493: creat d2/d7/d88/fa1 x:0 0 0 2024-09-20T20:31:42.205 INFO:tasks.workunit.client.0.smithi070.stdout:7/401: link d2/d19/d25/d42/d55/c6c d2/d30/c7b 0 2024-09-20T20:31:42.205 INFO:tasks.workunit.client.0.smithi070.stdout:6/561: dread d4/d8/d1e/f7c [0,4194304] 0 2024-09-20T20:31:42.206 INFO:tasks.workunit.client.0.smithi070.stdout:8/553: mknod d4/d27/d2a/d5b/d98/da9/cc1 0 2024-09-20T20:31:42.207 INFO:tasks.workunit.client.0.smithi070.stdout:3/473: dread d7/f1b [4194304,4194304] 0 2024-09-20T20:31:42.208 INFO:tasks.workunit.client.0.smithi070.stdout:2/511: dread d3/de/f1b [0,4194304] 0 2024-09-20T20:31:42.208 INFO:tasks.workunit.client.0.smithi070.stdout:0/590: fsync d4/d48/d7b/fbc 0 2024-09-20T20:31:42.209 INFO:tasks.workunit.client.0.smithi070.stdout:7/402: truncate d2/d30/d63/f66 888315 0 2024-09-20T20:31:42.210 INFO:tasks.workunit.client.0.smithi070.stdout:4/510: truncate d6/d7/dc/d4a/d58/f2c 479917 0 2024-09-20T20:31:42.210 INFO:tasks.workunit.client.0.smithi070.stdout:5/494: truncate d2/d4/d98/f7a 5146035 0 2024-09-20T20:31:42.210 INFO:tasks.workunit.client.0.smithi070.stdout:3/474: fsync d7/d15/d1a/d48/d66/d69/d13/d72/f8a 0 2024-09-20T20:31:42.212 INFO:tasks.workunit.client.0.smithi070.stdout:6/562: getdents d4/d8/d10 0 2024-09-20T20:31:42.212 INFO:tasks.workunit.client.0.smithi070.stdout:1/570: dwrite d4/d6/d26/f5b [4194304,4194304] 0 2024-09-20T20:31:42.212 INFO:tasks.workunit.client.0.smithi070.stdout:8/554: getdents d4/db/d64/d7b 0 2024-09-20T20:31:42.212 INFO:tasks.workunit.client.0.smithi070.stdout:3/475: chown d7/d15/f3f 452194773 1 2024-09-20T20:31:42.213 INFO:tasks.workunit.client.0.smithi070.stdout:6/563: chown d4/d8/d17/d33/d36 33469526 1 2024-09-20T20:31:42.213 INFO:tasks.workunit.client.0.smithi070.stdout:8/555: stat d4/d27/d2a/d3e/d39/l69 0 2024-09-20T20:31:42.214 INFO:tasks.workunit.client.0.smithi070.stdout:8/556: chown d4/db/l47 1549048 1 2024-09-20T20:31:42.215 INFO:tasks.workunit.client.0.smithi070.stdout:8/557: sync 2024-09-20T20:31:42.216 INFO:tasks.workunit.client.0.smithi070.stdout:1/571: unlink d4/d1f/c65 0 2024-09-20T20:31:42.216 INFO:tasks.workunit.client.0.smithi070.stdout:2/512: getdents d3/de/d12/d1a 0 2024-09-20T20:31:42.216 INFO:tasks.workunit.client.0.smithi070.stdout:6/564: rename d4/d8/d10/f65 to d4/d8/d10/fc8 0 2024-09-20T20:31:42.216 INFO:tasks.workunit.client.0.smithi070.stdout:3/476: mknod d7/d15/d1a/d48/d66/d69/d13/d7a/c92 0 2024-09-20T20:31:42.219 INFO:tasks.workunit.client.0.smithi070.stdout:9/570: dwrite d1/df/d25/d9e/fcf [0,4194304] 0 2024-09-20T20:31:42.221 INFO:tasks.workunit.client.0.smithi070.stdout:1/572: rmdir d4/d6/d11/d2c/d3b 39 2024-09-20T20:31:42.221 INFO:tasks.workunit.client.0.smithi070.stdout:7/403: dwrite d2/d8/f33 [0,4194304] 0 2024-09-20T20:31:42.221 INFO:tasks.workunit.client.0.smithi070.stdout:6/565: fdatasync d4/d8/d10/f6e 0 2024-09-20T20:31:42.221 INFO:tasks.workunit.client.0.smithi070.stdout:8/558: truncate d4/d27/d2a/d3e/f67 977547 0 2024-09-20T20:31:42.221 INFO:tasks.workunit.client.0.smithi070.stdout:4/511: dwrite d6/d7/f59 [4194304,4194304] 0 2024-09-20T20:31:42.222 INFO:tasks.workunit.client.0.smithi070.stdout:9/571: chown d1/df/f59 396734 1 2024-09-20T20:31:42.223 INFO:tasks.workunit.client.0.smithi070.stdout:3/477: unlink d7/d15/d1a/d48/d57/f89 0 2024-09-20T20:31:42.223 INFO:tasks.workunit.client.0.smithi070.stdout:3/478: sync 2024-09-20T20:31:42.223 INFO:tasks.workunit.client.0.smithi070.stdout:5/495: dwrite d2/df/d75/f9f [0,4194304] 0 2024-09-20T20:31:42.224 INFO:tasks.workunit.client.0.smithi070.stdout:6/566: fdatasync d4/d8/d10/d3c/fb9 0 2024-09-20T20:31:42.224 INFO:tasks.workunit.client.0.smithi070.stdout:9/572: write d1/df/d18/d46/f8f [2806353,22080] 0 2024-09-20T20:31:42.225 INFO:tasks.workunit.client.0.smithi070.stdout:6/567: sync 2024-09-20T20:31:42.225 INFO:tasks.workunit.client.0.smithi070.stdout:7/404: unlink d2/d19/d25/d42/f53 0 2024-09-20T20:31:42.225 INFO:tasks.workunit.client.0.smithi070.stdout:4/512: stat d6/d7/dc/d4a/d81/c9e 0 2024-09-20T20:31:42.227 INFO:tasks.workunit.client.0.smithi070.stdout:3/479: stat d7/d15/d1a/d4a/d51/d5b/f6c 0 2024-09-20T20:31:42.227 INFO:tasks.workunit.client.0.smithi070.stdout:1/573: rename d4/d6/d11/d2c/l50 to d4/d6/d11/d2c/d3a/ld8 0 2024-09-20T20:31:42.227 INFO:tasks.workunit.client.0.smithi070.stdout:9/573: rmdir d1 39 2024-09-20T20:31:42.227 INFO:tasks.workunit.client.0.smithi070.stdout:6/568: fdatasync d4/f6 0 2024-09-20T20:31:42.227 INFO:tasks.workunit.client.0.smithi070.stdout:5/496: truncate d2/d4/f1e 98583 0 2024-09-20T20:31:42.227 INFO:tasks.workunit.client.0.smithi070.stdout:7/405: readlink d2/d19/d2e/l58 0 2024-09-20T20:31:42.228 INFO:tasks.workunit.client.0.smithi070.stdout:5/497: sync 2024-09-20T20:31:42.229 INFO:tasks.workunit.client.0.smithi070.stdout:5/498: fsync d2/d7/d88/f83 0 2024-09-20T20:31:42.229 INFO:tasks.workunit.client.0.smithi070.stdout:2/513: dwrite d3/d5/d9/d10/f6a [0,4194304] 0 2024-09-20T20:31:42.229 INFO:tasks.workunit.client.0.smithi070.stdout:6/569: unlink d4/d8/d17/db2/fc6 0 2024-09-20T20:31:42.229 INFO:tasks.workunit.client.0.smithi070.stdout:7/406: readlink d2/d8/l2c 0 2024-09-20T20:31:42.229 INFO:tasks.workunit.client.0.smithi070.stdout:1/574: symlink d4/d6/d11/d7b/d83/ld9 0 2024-09-20T20:31:42.230 INFO:tasks.workunit.client.0.smithi070.stdout:8/559: dwrite d4/db/f11 [4194304,4194304] 0 2024-09-20T20:31:42.232 INFO:tasks.workunit.client.0.smithi070.stdout:7/407: write d2/d30/d63/d69/f70 [911359,31441] 0 2024-09-20T20:31:42.232 INFO:tasks.workunit.client.0.smithi070.stdout:6/570: read d4/d8/d10/d3c/f8d [58615,103894] 0 2024-09-20T20:31:42.234 INFO:tasks.workunit.client.0.smithi070.stdout:3/480: dwrite d7/d15/d1a/d48/d66/d69/d13/d1d/f34 [0,4194304] 0 2024-09-20T20:31:42.236 INFO:tasks.workunit.client.0.smithi070.stdout:2/514: dwrite d3/d5/d9/d1c/d47/d85/f98 [0,4194304] 0 2024-09-20T20:31:42.238 INFO:tasks.workunit.client.0.smithi070.stdout:7/408: mkdir d2/d19/d7c 0 2024-09-20T20:31:42.238 INFO:tasks.workunit.client.0.smithi070.stdout:8/560: dwrite d4/d27/d2a/d3e/f56 [0,4194304] 0 2024-09-20T20:31:42.238 INFO:tasks.workunit.client.0.smithi070.stdout:2/515: mknod d3/cb9 0 2024-09-20T20:31:42.239 INFO:tasks.workunit.client.0.smithi070.stdout:2/516: chown d3/d5/dd/d99 3 1 2024-09-20T20:31:42.240 INFO:tasks.workunit.client.0.smithi070.stdout:6/571: fdatasync d4/d8/d17/d33/d36/f63 0 2024-09-20T20:31:42.240 INFO:tasks.workunit.client.0.smithi070.stdout:2/517: creat d3/de/d9f/fba x:0 0 0 2024-09-20T20:31:42.242 INFO:tasks.workunit.client.0.smithi070.stdout:7/409: truncate d2/f45 132209 0 2024-09-20T20:31:42.243 INFO:tasks.workunit.client.0.smithi070.stdout:3/481: creat d7/d15/d1a/d48/d66/f93 x:0 0 0 2024-09-20T20:31:42.243 INFO:tasks.workunit.client.0.smithi070.stdout:8/561: rename d4/d27/d2a/f6f to d4/d27/d2a/d3e/d31/d63/fc2 0 2024-09-20T20:31:42.244 INFO:tasks.workunit.client.0.smithi070.stdout:3/482: creat d7/d15/d1a/d4a/f94 x:0 0 0 2024-09-20T20:31:42.245 INFO:tasks.workunit.client.0.smithi070.stdout:5/499: dwrite d2/d4/d98/f5a [0,4194304] 0 2024-09-20T20:31:42.246 INFO:tasks.workunit.client.0.smithi070.stdout:5/500: stat d2/d7/d88/l94 0 2024-09-20T20:31:42.247 INFO:tasks.workunit.client.0.smithi070.stdout:3/483: truncate d7/d15/d1a/d4a/d51/d5b/f6a 2458538 0 2024-09-20T20:31:42.247 INFO:tasks.workunit.client.0.smithi070.stdout:5/501: fsync d2/f13 0 2024-09-20T20:31:42.247 INFO:tasks.workunit.client.0.smithi070.stdout:2/518: dread d3/d5/d9/d10/f6a [0,4194304] 0 2024-09-20T20:31:42.248 INFO:tasks.workunit.client.0.smithi070.stdout:6/572: link d4/d8/d10/d54/c7f d4/d8/d3a/da7/cc9 0 2024-09-20T20:31:42.248 INFO:tasks.workunit.client.0.smithi070.stdout:3/484: dread - d7/d15/d1a/d4a/d7d/f8f zero size 2024-09-20T20:31:42.248 INFO:tasks.workunit.client.0.smithi070.stdout:5/502: fdatasync d2/d4/d98/d4c/f44 0 2024-09-20T20:31:42.250 INFO:tasks.workunit.client.0.smithi070.stdout:5/503: stat d2/d4/de/l3d 0 2024-09-20T20:31:42.250 INFO:tasks.workunit.client.0.smithi070.stdout:2/519: fsync d3/d5/d9/d1c/d1f/f5e 0 2024-09-20T20:31:42.250 INFO:tasks.workunit.client.0.smithi070.stdout:6/573: creat d4/d8/db4/db6/fca x:0 0 0 2024-09-20T20:31:42.250 INFO:tasks.workunit.client.0.smithi070.stdout:2/520: sync 2024-09-20T20:31:42.252 INFO:tasks.workunit.client.0.smithi070.stdout:1/575: dread d4/d6/f17 [0,4194304] 0 2024-09-20T20:31:42.253 INFO:tasks.workunit.client.0.smithi070.stdout:7/410: dwrite d2/d8/f18 [0,4194304] 0 2024-09-20T20:31:42.253 INFO:tasks.workunit.client.0.smithi070.stdout:7/411: dread - d2/f51 zero size 2024-09-20T20:31:42.253 INFO:tasks.workunit.client.0.smithi070.stdout:2/521: rmdir d3/d5/d9/d10 39 2024-09-20T20:31:42.253 INFO:tasks.workunit.client.0.smithi070.stdout:6/574: creat d4/d8/d38/fcb x:0 0 0 2024-09-20T20:31:42.254 INFO:tasks.workunit.client.0.smithi070.stdout:2/522: fdatasync d3/de/d12/d1a/f21 0 2024-09-20T20:31:42.254 INFO:tasks.workunit.client.0.smithi070.stdout:6/575: mknod d4/d8/d17/d33/d36/ccc 0 2024-09-20T20:31:42.255 INFO:tasks.workunit.client.0.smithi070.stdout:6/576: fdatasync d4/d8/d1e/f5b 0 2024-09-20T20:31:42.256 INFO:tasks.workunit.client.0.smithi070.stdout:2/523: symlink d3/d5/d9/d1c/d4e/lbb 0 2024-09-20T20:31:42.257 INFO:tasks.workunit.client.0.smithi070.stdout:8/562: truncate d4/db/d64/f93 5671913 0 2024-09-20T20:31:42.258 INFO:tasks.workunit.client.0.smithi070.stdout:4/513: dread d6/d7/f59 [0,4194304] 0 2024-09-20T20:31:42.259 INFO:tasks.workunit.client.0.smithi070.stdout:7/412: dread d2/d19/d25/d2a/d4a/f62 [0,4194304] 0 2024-09-20T20:31:42.259 INFO:tasks.workunit.client.0.smithi070.stdout:1/576: dwrite d4/d6/d11/d63/d6c/f98 [0,4194304] 0 2024-09-20T20:31:42.260 INFO:tasks.workunit.client.0.smithi070.stdout:5/504: dwrite d2/d4/d98/d5b/f5e [4194304,4194304] 0 2024-09-20T20:31:42.262 INFO:tasks.workunit.client.0.smithi070.stdout:3/485: truncate d7/d15/d1a/d48/d66/d69/f19 3383537 0 2024-09-20T20:31:42.262 INFO:tasks.workunit.client.0.smithi070.stdout:1/577: symlink d4/d32/d34/d44/d5a/lda 0 2024-09-20T20:31:42.263 INFO:tasks.workunit.client.0.smithi070.stdout:5/505: unlink d2/df/l3e 0 2024-09-20T20:31:42.263 INFO:tasks.workunit.client.0.smithi070.stdout:2/524: read d3/de/f39 [96353,130017] 0 2024-09-20T20:31:42.264 INFO:tasks.workunit.client.0.smithi070.stdout:7/413: getdents d2/d19/d25/d42/d55 0 2024-09-20T20:31:42.264 INFO:tasks.workunit.client.0.smithi070.stdout:1/578: mkdir d4/d6/ddb 0 2024-09-20T20:31:42.267 INFO:tasks.workunit.client.0.smithi070.stdout:3/486: symlink d7/d15/d1a/d48/d66/d69/d13/d7a/l95 0 2024-09-20T20:31:42.268 INFO:tasks.workunit.client.0.smithi070.stdout:9/574: dread d1/df/d38/f97 [0,4194304] 0 2024-09-20T20:31:42.269 INFO:tasks.workunit.client.0.smithi070.stdout:8/563: dwrite d4/db/d64/d7b/f8f [0,4194304] 0 2024-09-20T20:31:42.269 INFO:tasks.workunit.client.0.smithi070.stdout:7/414: write d2/d19/d25/d2a/f6b [3124193,117549] 0 2024-09-20T20:31:42.269 INFO:tasks.workunit.client.0.smithi070.stdout:4/514: dwrite d6/d26/f27 [4194304,4194304] 0 2024-09-20T20:31:42.269 INFO:tasks.workunit.client.0.smithi070.stdout:6/577: dwrite d4/d8/ff [0,4194304] 0 2024-09-20T20:31:42.269 INFO:tasks.workunit.client.0.smithi070.stdout:2/525: creat d3/d5/d9/d1c/d1f/d3e/d61/db2/fbc x:0 0 0 2024-09-20T20:31:42.270 INFO:tasks.workunit.client.0.smithi070.stdout:9/575: fdatasync d1/df/d18/d46/f73 0 2024-09-20T20:31:42.270 INFO:tasks.workunit.client.0.smithi070.stdout:1/579: unlink d4/d32/d34/d44/d4b/f8f 0 2024-09-20T20:31:42.271 INFO:tasks.workunit.client.0.smithi070.stdout:4/515: write d6/d5e/d75/d40/f56 [3159812,16837] 0 2024-09-20T20:31:42.271 INFO:tasks.workunit.client.0.smithi070.stdout:6/578: creat d4/d8/d17/fcd x:0 0 0 2024-09-20T20:31:42.273 INFO:tasks.workunit.client.0.smithi070.stdout:2/526: chown d3/d5/d9/d42/f93 95 1 2024-09-20T20:31:42.273 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:42.269+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:42.277 INFO:tasks.workunit.client.0.smithi070.stdout:6/579: mkdir d4/dce 0 2024-09-20T20:31:42.278 INFO:tasks.workunit.client.0.smithi070.stdout:5/506: dwrite d2/d4/de/d47/d67/d92/f86 [0,4194304] 0 2024-09-20T20:31:42.279 INFO:tasks.workunit.client.0.smithi070.stdout:8/564: dwrite d4/d27/d2a/d3e/f67 [0,4194304] 0 2024-09-20T20:31:42.280 INFO:tasks.workunit.client.0.smithi070.stdout:4/516: rmdir d6/d26/d69/d71/d4c/d50 0 2024-09-20T20:31:42.280 INFO:tasks.workunit.client.0.smithi070.stdout:6/580: rename d4/d8/d17/f42 to d4/d8/d68/d93/fcf 0 2024-09-20T20:31:42.281 INFO:tasks.workunit.client.0.smithi070.stdout:8/565: chown d4/d27/d2a/d3e/d39/f9f 93566 1 2024-09-20T20:31:42.281 INFO:tasks.workunit.client.0.smithi070.stdout:4/517: write d6/d7/f45 [3030860,13230] 0 2024-09-20T20:31:42.283 INFO:tasks.workunit.client.0.smithi070.stdout:7/415: truncate d2/d8/f33 899334 0 2024-09-20T20:31:42.284 INFO:tasks.workunit.client.0.smithi070.stdout:9/576: truncate d1/df/d25/d69/d85/dad/f54 3580455 0 2024-09-20T20:31:42.284 INFO:tasks.workunit.client.0.smithi070.stdout:5/507: symlink d2/d4/d98/la2 0 2024-09-20T20:31:42.284 INFO:tasks.workunit.client.0.smithi070.stdout:6/581: mknod d4/d8/d10/d54/d64/cd0 0 2024-09-20T20:31:42.285 INFO:tasks.workunit.client.0.smithi070.stdout:3/487: dwrite d7/d15/d1a/f32 [0,4194304] 0 2024-09-20T20:31:42.285 INFO:tasks.workunit.client.0.smithi070.stdout:8/566: creat d4/d27/d2a/d5b/d98/da9/db5/dc0/fc3 x:0 0 0 2024-09-20T20:31:42.285 INFO:tasks.workunit.client.0.smithi070.stdout:4/518: symlink d6/d26/la0 0 2024-09-20T20:31:42.285 INFO:tasks.workunit.client.0.smithi070.stdout:6/582: rmdir d4/d8/d10/d3c 39 2024-09-20T20:31:42.285 INFO:tasks.workunit.client.0.smithi070.stdout:1/580: link d4/l61 d4/d6/ldc 0 2024-09-20T20:31:42.285 INFO:tasks.workunit.client.0.smithi070.stdout:8/567: dread - d4/db/d64/d95/f9b zero size 2024-09-20T20:31:42.285 INFO:tasks.workunit.client.0.smithi070.stdout:3/488: fsync d7/d15/d1a/f44 0 2024-09-20T20:31:42.286 INFO:tasks.workunit.client.0.smithi070.stdout:9/577: symlink d1/df/d18/d46/ld4 0 2024-09-20T20:31:42.286 INFO:tasks.workunit.client.0.smithi070.stdout:3/489: chown f3 5785 1 2024-09-20T20:31:42.286 INFO:tasks.workunit.client.0.smithi070.stdout:1/581: creat d4/d32/d34/fdd x:0 0 0 2024-09-20T20:31:42.287 INFO:tasks.workunit.client.0.smithi070.stdout:4/519: rename d6/d7/dc/d4a/d81/c9e to d6/d5e/d75/d61/ca1 0 2024-09-20T20:31:42.287 INFO:tasks.workunit.client.0.smithi070.stdout:6/583: fdatasync d4/d8/d10/fa6 0 2024-09-20T20:31:42.287 INFO:tasks.workunit.client.0.smithi070.stdout:7/416: creat d2/d19/d25/d2a/f7d x:0 0 0 2024-09-20T20:31:42.288 INFO:tasks.workunit.client.0.smithi070.stdout:9/578: chown d1/df/d18/d46/ld4 0 1 2024-09-20T20:31:42.288 INFO:tasks.workunit.client.0.smithi070.stdout:8/568: creat d4/d27/d2a/d3e/d31/fc4 x:0 0 0 2024-09-20T20:31:42.288 INFO:tasks.workunit.client.0.smithi070.stdout:6/584: stat d4/d8/d10/d54/f6b 0 2024-09-20T20:31:42.288 INFO:tasks.workunit.client.0.smithi070.stdout:4/520: chown d6/d26/d97/c9f 245 1 2024-09-20T20:31:42.288 INFO:tasks.workunit.client.0.smithi070.stdout:7/417: chown d2/d19/d25/d2a/f7d 116159 1 2024-09-20T20:31:42.289 INFO:tasks.workunit.client.0.smithi070.stdout:4/521: chown d6/d7/dc/l5d 159047377 1 2024-09-20T20:31:42.289 INFO:tasks.workunit.client.0.smithi070.stdout:8/569: write d4/db/d64/d95/da5/f96 [338319,78450] 0 2024-09-20T20:31:42.289 INFO:tasks.workunit.client.0.smithi070.stdout:8/570: chown d4/d27/d2a/d43 229914 1 2024-09-20T20:31:42.289 INFO:tasks.workunit.client.0.smithi070.stdout:8/571: sync 2024-09-20T20:31:42.291 INFO:tasks.workunit.client.0.smithi070.stdout:1/582: unlink d4/d32/d34/d44/d4b/d87/dbb/f81 0 2024-09-20T20:31:42.291 INFO:tasks.workunit.client.0.smithi070.stdout:6/585: creat d4/d8/d10/d54/d55/d72/fd1 x:0 0 0 2024-09-20T20:31:42.292 INFO:tasks.workunit.client.0.smithi070.stdout:4/522: fdatasync d6/d7/dc/d4a/d58/f2c 0 2024-09-20T20:31:42.293 INFO:tasks.workunit.client.0.smithi070.stdout:4/523: fsync d6/d5e/d75/f21 0 2024-09-20T20:31:42.293 INFO:tasks.workunit.client.0.smithi070.stdout:6/586: mknod d4/d8/d10/d54/d7a/cd2 0 2024-09-20T20:31:42.293 INFO:tasks.workunit.client.0.smithi070.stdout:7/418: truncate d2/d8/f6 204105 0 2024-09-20T20:31:42.295 INFO:tasks.workunit.client.0.smithi070.stdout:0/591: dread d4/d8/d12/d23/d26/d1d/d37/f60 [0,4194304] 0 2024-09-20T20:31:42.295 INFO:tasks.workunit.client.0.smithi070.stdout:1/583: mkdir d4/d6/d11/d2c/d3a/d78/dde 0 2024-09-20T20:31:42.295 INFO:tasks.workunit.client.0.smithi070.stdout:7/419: readlink d2/d30/l7a 0 2024-09-20T20:31:42.295 INFO:tasks.workunit.client.0.smithi070.stdout:7/420: mknod d2/d30/d63/c7e 0 2024-09-20T20:31:42.296 INFO:tasks.workunit.client.0.smithi070.stdout:7/421: read - d2/f68 zero size 2024-09-20T20:31:42.296 INFO:tasks.workunit.client.0.smithi070.stdout:1/584: unlink d4/d6/d11/d2c/d3a/d9d/lcd 0 2024-09-20T20:31:42.297 INFO:tasks.workunit.client.0.smithi070.stdout:7/422: write d2/d19/d25/d2a/d5c/f72 [881945,79781] 0 2024-09-20T20:31:42.298 INFO:tasks.workunit.client.0.smithi070.stdout:8/572: dwrite d4/db/f5e [0,4194304] 0 2024-09-20T20:31:42.298 INFO:tasks.workunit.client.0.smithi070.stdout:1/585: write d4/d32/d34/d44/d48/f5e [794268,81609] 0 2024-09-20T20:31:42.299 INFO:tasks.workunit.client.0.smithi070.stdout:7/423: unlink d2/d19/d25/d2a/f3a 0 2024-09-20T20:31:42.302 INFO:tasks.workunit.client.0.smithi070.stdout:8/573: rename d4/d27/d2a/d75/cb8 to d4/d27/cc5 0 2024-09-20T20:31:42.302 INFO:tasks.workunit.client.0.smithi070.stdout:6/587: dwrite d4/d8/d10/f89 [0,4194304] 0 2024-09-20T20:31:42.302 INFO:tasks.workunit.client.0.smithi070.stdout:4/524: read d6/d7/dc/f4b [3121504,66108] 0 2024-09-20T20:31:42.302 INFO:tasks.workunit.client.0.smithi070.stdout:7/424: getdents d2/d19/d2e 0 2024-09-20T20:31:42.303 INFO:tasks.workunit.client.0.smithi070.stdout:0/592: dwrite d4/d19/f52 [0,4194304] 0 2024-09-20T20:31:42.304 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:42.304 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:42.304 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:42.304 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:42.304 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:42.305 INFO:tasks.workunit.client.0.smithi070.stdout:0/593: truncate d4/d48/f72 4853874 0 2024-09-20T20:31:42.305 INFO:tasks.workunit.client.0.smithi070.stdout:1/586: rename d4/d6/d11/d2c/d3b/l4e to d4/d6/d11/d63/dd7/ldf 0 2024-09-20T20:31:42.306 INFO:tasks.workunit.client.0.smithi070.stdout:0/594: chown d4/d48/d67/da5 26831773 1 2024-09-20T20:31:42.306 INFO:tasks.workunit.client.0.smithi070.stdout:6/588: creat d4/d8/d1e/d7e/fd3 x:0 0 0 2024-09-20T20:31:42.306 INFO:tasks.workunit.client.0.smithi070.stdout:4/525: rename d6/d7 to d6/d7/dc/da2 22 2024-09-20T20:31:42.306 INFO:tasks.workunit.client.0.smithi070.stdout:8/574: mkdir d4/d27/dc6 0 2024-09-20T20:31:42.307 INFO:tasks.workunit.client.0.smithi070.stdout:6/589: fsync d4/d8/d10/f44 0 2024-09-20T20:31:42.307 INFO:tasks.workunit.client.0.smithi070.stdout:7/425: symlink d2/d19/d25/d42/d77/l7f 0 2024-09-20T20:31:42.308 INFO:tasks.workunit.client.0.smithi070.stdout:6/590: chown d4/d8/d1e/l3d 311484633 1 2024-09-20T20:31:42.308 INFO:tasks.workunit.client.0.smithi070.stdout:1/587: rmdir d4/d32/d34/d44/d4b/d87/da9 39 2024-09-20T20:31:42.308 INFO:tasks.workunit.client.0.smithi070.stdout:0/595: dread - d4/d8/d12/d23/d26/d2d/f96 zero size 2024-09-20T20:31:42.308 INFO:tasks.workunit.client.0.smithi070.stdout:4/526: rename d6/d5e/d51/d63/f8c to d6/d7/dc/d4a/d81/fa3 0 2024-09-20T20:31:42.308 INFO:tasks.workunit.client.0.smithi070.stdout:0/596: sync 2024-09-20T20:31:42.308 INFO:tasks.workunit.client.0.smithi070.stdout:7/426: creat d2/d30/d63/f80 x:0 0 0 2024-09-20T20:31:42.308 INFO:tasks.workunit.client.0.smithi070.stdout:8/575: creat d4/fc7 x:0 0 0 2024-09-20T20:31:42.309 INFO:tasks.workunit.client.0.smithi070.stdout:6/591: fsync d4/d8/d17/fc0 0 2024-09-20T20:31:42.309 INFO:tasks.workunit.client.0.smithi070.stdout:0/597: write d4/d19/fb9 [32352,64712] 0 2024-09-20T20:31:42.309 INFO:tasks.workunit.client.0.smithi070.stdout:6/592: rmdir d4/d8/d10/d3c 39 2024-09-20T20:31:42.309 INFO:tasks.workunit.client.0.smithi070.stdout:0/598: readlink d4/d8/d12/l1a 0 2024-09-20T20:31:42.310 INFO:tasks.workunit.client.0.smithi070.stdout:4/527: getdents d6/d7/dc/d4a 0 2024-09-20T20:31:42.310 INFO:tasks.workunit.client.0.smithi070.stdout:0/599: stat d4/d48/d4e/f90 0 2024-09-20T20:31:42.310 INFO:tasks.workunit.client.0.smithi070.stdout:4/528: read - d6/d7/dc/d20/f62 zero size 2024-09-20T20:31:42.311 INFO:tasks.workunit.client.0.smithi070.stdout:4/529: mknod d6/d5e/d75/ca4 0 2024-09-20T20:31:42.312 INFO:tasks.workunit.client.0.smithi070.stdout:3/490: dread d7/d15/d1a/f78 [0,4194304] 0 2024-09-20T20:31:42.312 INFO:tasks.workunit.client.0.smithi070.stdout:4/530: creat d6/d5e/d75/fa5 x:0 0 0 2024-09-20T20:31:42.313 INFO:tasks.workunit.client.0.smithi070.stdout:3/491: symlink d7/d15/d1a/d48/d57/d75/l96 0 2024-09-20T20:31:42.314 INFO:tasks.workunit.client.0.smithi070.stdout:6/593: dread d4/d8/f4c [4194304,4194304] 0 2024-09-20T20:31:42.314 INFO:tasks.workunit.client.0.smithi070.stdout:4/531: write d6/d26/f90 [407052,120685] 0 2024-09-20T20:31:42.315 INFO:tasks.workunit.client.0.smithi070.stdout:4/532: symlink d6/la6 0 2024-09-20T20:31:42.315 INFO:tasks.workunit.client.0.smithi070.stdout:3/492: mknod d7/d15/d1a/d48/d57/c97 0 2024-09-20T20:31:42.315 INFO:tasks.workunit.client.0.smithi070.stdout:6/594: rename d4/d8 to d4/d8/d10/d3c/d99/dd4 22 2024-09-20T20:31:42.315 INFO:tasks.workunit.client.0.smithi070.stdout:7/427: read d2/f1b [2786026,76846] 0 2024-09-20T20:31:42.316 INFO:tasks.workunit.client.0.smithi070.stdout:4/533: unlink d6/c44 0 2024-09-20T20:31:42.316 INFO:tasks.workunit.client.0.smithi070.stdout:6/595: creat d4/d8/d10/d54/d7a/fd5 x:0 0 0 2024-09-20T20:31:42.317 INFO:tasks.workunit.client.0.smithi070.stdout:7/428: creat d2/d30/d63/f81 x:0 0 0 2024-09-20T20:31:42.318 INFO:tasks.workunit.client.0.smithi070.stdout:0/600: dwrite d4/d19/fb9 [0,4194304] 0 2024-09-20T20:31:42.318 INFO:tasks.workunit.client.0.smithi070.stdout:7/429: rmdir d2 39 2024-09-20T20:31:42.319 INFO:tasks.workunit.client.0.smithi070.stdout:4/534: fsync d6/d7/dc/d4a/d58/f6c 0 2024-09-20T20:31:42.320 INFO:tasks.workunit.client.0.smithi070.stdout:4/535: chown d6/d26/d69 0 1 2024-09-20T20:31:42.320 INFO:tasks.workunit.client.0.smithi070.stdout:6/596: getdents d4/d8/db4 0 2024-09-20T20:31:42.320 INFO:tasks.workunit.client.0.smithi070.stdout:0/601: write d4/f11 [4542430,121858] 0 2024-09-20T20:31:42.321 INFO:tasks.workunit.client.0.smithi070.stdout:1/588: truncate d4/d6/d11/d2c/d3b/f3e 1801804 0 2024-09-20T20:31:42.321 INFO:tasks.workunit.client.0.smithi070.stdout:0/602: write f2 [4886183,25440] 0 2024-09-20T20:31:42.321 INFO:tasks.workunit.client.0.smithi070.stdout:7/430: mkdir d2/d65/d82 0 2024-09-20T20:31:42.321 INFO:tasks.workunit.client.0.smithi070.stdout:4/536: rename d6/d7/dc/d4a/d58/l35 to d6/d5e/d51/d63/la7 0 2024-09-20T20:31:42.322 INFO:tasks.workunit.client.0.smithi070.stdout:1/589: symlink d4/d32/d34/d44/d5a/le0 0 2024-09-20T20:31:42.322 INFO:tasks.workunit.client.0.smithi070.stdout:7/431: fdatasync d2/d8/f33 0 2024-09-20T20:31:42.323 INFO:tasks.workunit.client.0.smithi070.stdout:4/537: creat d6/d7/dc/d4a/d81/fa8 x:0 0 0 2024-09-20T20:31:42.323 INFO:tasks.workunit.client.0.smithi070.stdout:7/432: chown d2/d19/d25/l49 244862 1 2024-09-20T20:31:42.324 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:42.325 INFO:tasks.workunit.client.0.smithi070.stdout:0/603: mkdir d4/d8/d12/d43/dbf 0 2024-09-20T20:31:42.325 INFO:tasks.workunit.client.0.smithi070.stdout:7/433: write d2/d8/f64 [682638,17684] 0 2024-09-20T20:31:42.326 INFO:tasks.workunit.client.0.smithi070.stdout:9/579: dread d1/df/f19 [0,4194304] 0 2024-09-20T20:31:42.327 INFO:tasks.workunit.client.0.smithi070.stdout:6/597: dread d4/d8/d3a/f97 [0,4194304] 0 2024-09-20T20:31:42.329 INFO:tasks.workunit.client.0.smithi070.stdout:2/527: dread d3/de/d12/d1a/f21 [4194304,4194304] 0 2024-09-20T20:31:42.329 INFO:tasks.workunit.client.0.smithi070.stdout:7/434: creat d2/d19/f83 x:0 0 0 2024-09-20T20:31:42.331 INFO:tasks.workunit.client.0.smithi070.stdout:1/590: dwrite d4/d6/d26/f70 [0,4194304] 0 2024-09-20T20:31:42.331 INFO:tasks.workunit.client.0.smithi070.stdout:5/508: dread d2/d4/d98/d5b/f37 [0,4194304] 0 2024-09-20T20:31:42.331 INFO:tasks.workunit.client.0.smithi070.stdout:4/538: dwrite d6/d5e/f95 [0,4194304] 0 2024-09-20T20:31:42.331 INFO:tasks.workunit.client.0.smithi070.stdout:9/580: creat d1/df/d25/d69/d85/d9f/fd5 x:0 0 0 2024-09-20T20:31:42.332 INFO:tasks.workunit.client.0.smithi070.stdout:1/591: fsync d4/d6/d11/d2c/d3b/f74 0 2024-09-20T20:31:42.333 INFO:tasks.workunit.client.0.smithi070.stdout:8/576: dread d4/db/f16 [0,4194304] 0 2024-09-20T20:31:42.334 INFO:tasks.workunit.client.0.smithi070.stdout:5/509: creat d2/d4/de/d47/d67/d92/fa3 x:0 0 0 2024-09-20T20:31:42.335 INFO:tasks.workunit.client.0.smithi070.stdout:4/539: unlink d6/d7/dc/d4a/d58/f8b 0 2024-09-20T20:31:42.336 INFO:tasks.workunit.client.0.smithi070.stdout:7/435: rename d2/d65/d82 to d2/d19/d25/d84 0 2024-09-20T20:31:42.336 INFO:tasks.workunit.client.0.smithi070.stdout:9/581: rename d1/df/f59 to d1/df/fd6 0 2024-09-20T20:31:42.336 INFO:tasks.workunit.client.0.smithi070.stdout:1/592: fsync d4/d6/d11/f38 0 2024-09-20T20:31:42.336 INFO:tasks.workunit.client.0.smithi070.stdout:5/510: chown d2/d4/d98/d5b/f26 2 1 2024-09-20T20:31:42.337 INFO:tasks.workunit.client.0.smithi070.stdout:4/540: dread - d6/d43/f8e zero size 2024-09-20T20:31:42.338 INFO:tasks.workunit.client.0.smithi070.stdout:7/436: rename d2/d19/d25/d2a to d2/d19/d25/d2a/d4a/d85 22 2024-09-20T20:31:42.338 INFO:tasks.workunit.client.0.smithi070.stdout:9/582: mknod d1/df/d25/d69/d80/cd7 0 2024-09-20T20:31:42.339 INFO:tasks.workunit.client.0.smithi070.stdout:4/541: creat d6/d26/d69/d71/fa9 x:0 0 0 2024-09-20T20:31:42.339 INFO:tasks.workunit.client.0.smithi070.stdout:8/577: stat d4/d27/d2a/d3e/d31/l71 0 2024-09-20T20:31:42.339 INFO:tasks.workunit.client.0.smithi070.stdout:2/528: dwrite d3/d5/d9/d1c/d1f/f5e [0,4194304] 0 2024-09-20T20:31:42.339 INFO:tasks.workunit.client.0.smithi070.stdout:9/583: readlink d1/d76/l8c 0 2024-09-20T20:31:42.339 INFO:tasks.workunit.client.0.smithi070.stdout:5/511: getdents d2/d4/de 0 2024-09-20T20:31:42.339 INFO:tasks.workunit.client.0.smithi070.stdout:5/512: sync 2024-09-20T20:31:42.340 INFO:tasks.workunit.client.0.smithi070.stdout:7/437: unlink d2/d19/d25/f36 0 2024-09-20T20:31:42.343 INFO:tasks.workunit.client.0.smithi070.stdout:4/542: unlink d6/d5e/d75/c19 0 2024-09-20T20:31:42.343 INFO:tasks.workunit.client.0.smithi070.stdout:5/513: creat d2/d4/d53/fa4 x:0 0 0 2024-09-20T20:31:42.343 INFO:tasks.workunit.client.0.smithi070.stdout:1/593: link d4/d32/d34/d44/d5a/fc1 d4/d6/d11/d2c/d3a/d78/db0/fe1 0 2024-09-20T20:31:42.343 INFO:tasks.workunit.client.0.smithi070.stdout:2/529: dread d3/d5/dd/f89 [0,4194304] 0 2024-09-20T20:31:42.344 INFO:tasks.workunit.client.0.smithi070.stdout:8/578: rmdir d4/d27/d2a/d5b/db0 0 2024-09-20T20:31:42.344 INFO:tasks.workunit.client.0.smithi070.stdout:7/438: getdents d2/d30/d78 0 2024-09-20T20:31:42.344 INFO:tasks.workunit.client.0.smithi070.stdout:1/594: chown d4/l61 16 1 2024-09-20T20:31:42.344 INFO:tasks.workunit.client.0.smithi070.stdout:8/579: fsync d4/db/f1b 0 2024-09-20T20:31:42.344 INFO:tasks.workunit.client.0.smithi070.stdout:7/439: fsync d2/d8/f18 0 2024-09-20T20:31:42.345 INFO:tasks.workunit.client.0.smithi070.stdout:4/543: symlink d6/d5e/d75/laa 0 2024-09-20T20:31:42.346 INFO:tasks.workunit.client.0.smithi070.stdout:7/440: chown d2/d19/d2e/f60 202411 1 2024-09-20T20:31:42.346 INFO:tasks.workunit.client.0.smithi070.stdout:5/514: dread d2/d4/d98/d4c/f71 [0,4194304] 0 2024-09-20T20:31:42.346 INFO:tasks.workunit.client.0.smithi070.stdout:8/580: write d4/d27/d42/fb1 [1042765,9745] 0 2024-09-20T20:31:42.346 INFO:tasks.workunit.client.0.smithi070.stdout:3/493: dread d7/d15/d1e/d65/f27 [0,4194304] 0 2024-09-20T20:31:42.347 INFO:tasks.workunit.client.0.smithi070.stdout:9/584: dwrite d1/df/d18/fc9 [0,4194304] 0 2024-09-20T20:31:42.347 INFO:tasks.workunit.client.0.smithi070.stdout:1/595: mkdir d4/d6/d26/de2 0 2024-09-20T20:31:42.347 INFO:tasks.workunit.client.0.smithi070.stdout:5/515: dread - d2/d4/de/d47/d67/d92/f84 zero size 2024-09-20T20:31:42.348 INFO:tasks.workunit.client.0.smithi070.stdout:2/530: unlink d3/d5/dd/l43 0 2024-09-20T20:31:42.349 INFO:tasks.workunit.client.0.smithi070.stdout:1/596: fdatasync d4/d6/d26/f5b 0 2024-09-20T20:31:42.349 INFO:tasks.workunit.client.0.smithi070.stdout:3/494: truncate d7/d15/d1a/d48/d66/d69/f8d 1208568 0 2024-09-20T20:31:42.350 INFO:tasks.workunit.client.0.smithi070.stdout:7/441: creat d2/d19/d25/f86 x:0 0 0 2024-09-20T20:31:42.350 INFO:tasks.workunit.client.0.smithi070.stdout:1/597: rmdir d4/d6/d11/d63 39 2024-09-20T20:31:42.350 INFO:tasks.workunit.client.0.smithi070.stdout:2/531: chown d3/d5/l23 27849198 1 2024-09-20T20:31:42.351 INFO:tasks.workunit.client.0.smithi070.stdout:5/516: rmdir d2/d7/d7f 0 2024-09-20T20:31:42.351 INFO:tasks.workunit.client.0.smithi070.stdout:1/598: readlink d4/d6/d11/d7b/ld0 0 2024-09-20T20:31:42.352 INFO:tasks.workunit.client.0.smithi070.stdout:5/517: unlink d2/df/f89 0 2024-09-20T20:31:42.353 INFO:tasks.workunit.client.0.smithi070.stdout:2/532: mknod d3/d5/dd/d5a/cbd 0 2024-09-20T20:31:42.353 INFO:tasks.workunit.client.0.smithi070.stdout:5/518: sync 2024-09-20T20:31:42.353 INFO:tasks.workunit.client.0.smithi070.stdout:4/544: dwrite d6/f8 [4194304,4194304] 0 2024-09-20T20:31:42.353 INFO:tasks.workunit.client.0.smithi070.stdout:1/599: chown d4/d32/d34/d44/d4b/d87/fd4 43468285 1 2024-09-20T20:31:42.353 INFO:tasks.workunit.client.0.smithi070.stdout:5/519: chown d2/d4/d53/d59 38390927 1 2024-09-20T20:31:42.355 INFO:tasks.workunit.client.0.smithi070.stdout:9/585: truncate d1/df/d18/d46/f63 120889 0 2024-09-20T20:31:42.355 INFO:tasks.workunit.client.0.smithi070.stdout:2/533: rmdir d3/de/d12/d1a 39 2024-09-20T20:31:42.355 INFO:tasks.workunit.client.0.smithi070.stdout:1/600: mknod d4/d6/dae/ce3 0 2024-09-20T20:31:42.355 INFO:tasks.workunit.client.0.smithi070.stdout:4/545: mknod d6/d7/dc/d4a/d58/cab 0 2024-09-20T20:31:42.356 INFO:tasks.workunit.client.0.smithi070.stdout:8/581: dread d4/d27/d2a/d3e/d31/d63/fc2 [0,4194304] 0 2024-09-20T20:31:42.357 INFO:tasks.workunit.client.0.smithi070.stdout:2/534: mkdir d3/d5/d9/d1c/d1f/d3e/dbe 0 2024-09-20T20:31:42.357 INFO:tasks.workunit.client.0.smithi070.stdout:8/582: dread - d4/db/d64/f80 zero size 2024-09-20T20:31:42.357 INFO:tasks.workunit.client.0.smithi070.stdout:8/583: readlink d4/d27/l58 0 2024-09-20T20:31:42.357 INFO:tasks.workunit.client.0.smithi070.stdout:9/586: getdents d1/df/d25/d69/d80 0 2024-09-20T20:31:42.358 INFO:tasks.workunit.client.0.smithi070.stdout:2/535: symlink d3/d5/d9/d1c/d1f/d3e/d92/lbf 0 2024-09-20T20:31:42.360 INFO:tasks.workunit.client.0.smithi070.stdout:2/536: symlink d3/d4c/d5c/db7/lc0 0 2024-09-20T20:31:42.361 INFO:tasks.workunit.client.0.smithi070.stdout:6/598: dread d4/d8/d17/d33/d36/f37 [0,4194304] 0 2024-09-20T20:31:42.361 INFO:tasks.workunit.client.0.smithi070.stdout:9/587: dread d1/df/d25/d69/fb0 [0,4194304] 0 2024-09-20T20:31:42.362 INFO:tasks.workunit.client.0.smithi070.stdout:8/584: dread d4/d27/d2a/d5b/d98/fad [4194304,4194304] 0 2024-09-20T20:31:42.362 INFO:tasks.workunit.client.0.smithi070.stdout:0/604: dread d4/d8/d12/d23/d26/d1d/d37/d38/f57 [0,4194304] 0 2024-09-20T20:31:42.362 INFO:tasks.workunit.client.0.smithi070.stdout:2/537: dread - d3/d5/d9/d1c/d1f/d3e/d61/db2/fb8 zero size 2024-09-20T20:31:42.363 INFO:tasks.workunit.client.0.smithi070.stdout:6/599: fdatasync d4/d8/d17/d33/d61/d73/fae 0 2024-09-20T20:31:42.363 INFO:tasks.workunit.client.0.smithi070.stdout:2/538: rmdir d3/d5/d9 39 2024-09-20T20:31:42.364 INFO:tasks.workunit.client.0.smithi070.stdout:9/588: rename d1/df/d18/d46/f8f to d1/df/fd8 0 2024-09-20T20:31:42.365 INFO:tasks.workunit.client.0.smithi070.stdout:6/600: chown d4/la3 13993 1 2024-09-20T20:31:42.365 INFO:tasks.workunit.client.0.smithi070.stdout:5/520: dwrite d2/d7/d60/f93 [0,4194304] 0 2024-09-20T20:31:42.365 INFO:tasks.workunit.client.0.smithi070.stdout:2/539: write d3/de/d12/f82 [719496,80483] 0 2024-09-20T20:31:42.366 INFO:tasks.workunit.client.0.smithi070.stdout:9/589: chown d1/df/d25/d69/d85/dad/f65 137471186 1 2024-09-20T20:31:42.366 INFO:tasks.workunit.client.0.smithi070.stdout:6/601: mkdir d4/d8/d1e/d7e/dd6 0 2024-09-20T20:31:42.367 INFO:tasks.workunit.client.0.smithi070.stdout:5/521: rename d2/df/d75 to d2/df/d9d/da5 0 2024-09-20T20:31:42.368 INFO:tasks.workunit.client.0.smithi070.stdout:6/602: dread - d4/d8/d17/d33/fc4 zero size 2024-09-20T20:31:42.368 INFO:tasks.workunit.client.0.smithi070.stdout:8/585: write d4/d27/d2a/d3e/d31/f52 [721294,41363] 0 2024-09-20T20:31:42.369 INFO:tasks.workunit.client.0.smithi070.stdout:6/603: write d4/f23 [1670580,104407] 0 2024-09-20T20:31:42.371 INFO:tasks.workunit.client.0.smithi070.stdout:2/540: truncate d3/d5/d9/d1c/d1f/fb3 915359 0 2024-09-20T20:31:42.371 INFO:tasks.workunit.client.0.smithi070.stdout:5/522: truncate d2/d4/d98/d5b/f37 3798501 0 2024-09-20T20:31:42.371 INFO:tasks.workunit.client.0.smithi070.stdout:6/604: symlink d4/d8/db4/ld7 0 2024-09-20T20:31:42.371 INFO:tasks.workunit.client.0.smithi070.stdout:8/586: symlink d4/d27/d2a/d5b/d98/da9/db5/dc0/lc8 0 2024-09-20T20:31:42.372 INFO:tasks.workunit.client.0.smithi070.stdout:0/605: dwrite f2 [0,4194304] 0 2024-09-20T20:31:42.373 INFO:tasks.workunit.client.0.smithi070.stdout:5/523: creat d2/d4/de/d47/fa6 x:0 0 0 2024-09-20T20:31:42.374 INFO:tasks.workunit.client.0.smithi070.stdout:9/590: dread d1/df/d38/f97 [0,4194304] 0 2024-09-20T20:31:42.374 INFO:tasks.workunit.client.0.smithi070.stdout:8/587: creat d4/db/fc9 x:0 0 0 2024-09-20T20:31:42.374 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:42.367+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:42.374 INFO:tasks.workunit.client.0.smithi070.stdout:5/524: readlink d2/df/d40/l6e 0 2024-09-20T20:31:42.375 INFO:tasks.workunit.client.0.smithi070.stdout:1/601: dread d4/d6/f52 [0,4194304] 0 2024-09-20T20:31:42.375 INFO:tasks.workunit.client.0.smithi070.stdout:8/588: write d4/db/d64/d95/da5/fab [675286,81967] 0 2024-09-20T20:31:42.375 INFO:tasks.workunit.client.0.smithi070.stdout:5/525: write d2/d4/f39 [378848,68322] 0 2024-09-20T20:31:42.375 INFO:tasks.workunit.client.0.smithi070.stdout:2/541: truncate d3/de/f39 141417 0 2024-09-20T20:31:42.375 INFO:tasks.workunit.client.0.smithi070.stdout:9/591: mkdir d1/df/d18/d44/da2/db6/dd9 0 2024-09-20T20:31:42.376 INFO:tasks.workunit.client.0.smithi070.stdout:6/605: mkdir d4/d8/d17/d33/d61/d73/dd8 0 2024-09-20T20:31:42.376 INFO:tasks.workunit.client.0.smithi070.stdout:1/602: creat d4/d32/d60/dca/fe4 x:0 0 0 2024-09-20T20:31:42.376 INFO:tasks.workunit.client.0.smithi070.stdout:3/495: dread d7/d15/d1e/f49 [0,4194304] 0 2024-09-20T20:31:42.377 INFO:tasks.workunit.client.0.smithi070.stdout:8/589: truncate d4/db/d64/f80 993958 0 2024-09-20T20:31:42.377 INFO:tasks.workunit.client.0.smithi070.stdout:2/542: dread - d3/d5/d9/d1c/d47/d7e/f84 zero size 2024-09-20T20:31:42.377 INFO:tasks.workunit.client.0.smithi070.stdout:9/592: symlink d1/df/d18/d44/da2/db6/lda 0 2024-09-20T20:31:42.378 INFO:tasks.workunit.client.0.smithi070.stdout:6/606: fsync d4/f7 0 2024-09-20T20:31:42.380 INFO:tasks.workunit.client.0.smithi070.stdout:6/607: symlink d4/d8/d10/d54/d55/ld9 0 2024-09-20T20:31:42.381 INFO:tasks.workunit.client.0.smithi070.stdout:8/590: mknod d4/d27/d2a/d3e/cca 0 2024-09-20T20:31:42.381 INFO:tasks.workunit.client.0.smithi070.stdout:9/593: mkdir d1/df/d25/db2/ddb 0 2024-09-20T20:31:42.381 INFO:tasks.workunit.client.0.smithi070.stdout:2/543: dread - d3/d5/dd/d99/dae/fb0 zero size 2024-09-20T20:31:42.382 INFO:tasks.workunit.client.0.smithi070.stdout:9/594: sync 2024-09-20T20:31:42.382 INFO:tasks.workunit.client.0.smithi070.stdout:2/544: sync 2024-09-20T20:31:42.383 INFO:tasks.workunit.client.0.smithi070.stdout:4/546: dread d6/d7/dc/f52 [0,4194304] 0 2024-09-20T20:31:42.384 INFO:tasks.workunit.client.0.smithi070.stdout:6/608: write d4/d8/f90 [1424518,138] 0 2024-09-20T20:31:42.386 INFO:tasks.workunit.client.0.smithi070.stdout:9/595: symlink d1/df/d18/d44/d77/dd0/ldc 0 2024-09-20T20:31:42.386 INFO:tasks.workunit.client.0.smithi070.stdout:7/442: dread d2/d19/d25/d2a/d5c/f5d [0,4194304] 0 2024-09-20T20:31:42.387 INFO:tasks.workunit.client.0.smithi070.stdout:5/526: dwrite d2/d7/d88/f4d [4194304,4194304] 0 2024-09-20T20:31:42.388 INFO:tasks.workunit.client.0.smithi070.stdout:4/547: creat d6/d5e/d6b/fac x:0 0 0 2024-09-20T20:31:42.388 INFO:tasks.workunit.client.0.smithi070.stdout:0/606: dwrite d4/d13/f68 [0,4194304] 0 2024-09-20T20:31:42.389 INFO:tasks.workunit.client.0.smithi070.stdout:3/496: dwrite d7/d15/d1a/d48/d66/d69/f24 [0,4194304] 0 2024-09-20T20:31:42.390 INFO:tasks.workunit.client.0.smithi070.stdout:0/607: write d4/f11 [4024984,118693] 0 2024-09-20T20:31:42.394 INFO:tasks.workunit.client.0.smithi070.stdout:3/497: rmdir d7/d15/d1a/d4a/d7d 39 2024-09-20T20:31:42.395 INFO:tasks.workunit.client.0.smithi070.stdout:5/527: write d2/df/f22 [4081820,72527] 0 2024-09-20T20:31:42.395 INFO:tasks.workunit.client.0.smithi070.stdout:6/609: link d4/d8/d10/d54/c7f d4/d8/d10/d54/d64/cda 0 2024-09-20T20:31:42.396 INFO:tasks.workunit.client.0.smithi070.stdout:4/548: link d6/d7/dc/d4a/d58/c2b d6/d7/dc/d20/cad 0 2024-09-20T20:31:42.396 INFO:tasks.workunit.client.0.smithi070.stdout:2/545: dwrite d3/de/d9f/fba [0,4194304] 0 2024-09-20T20:31:42.396 INFO:tasks.workunit.client.0.smithi070.stdout:3/498: symlink d7/d71/l98 0 2024-09-20T20:31:42.397 INFO:tasks.workunit.client.0.smithi070.stdout:0/608: rename d4/d8/d12/d23/db2 to d4/d8/d12/d23/db2/dc0 22 2024-09-20T20:31:42.397 INFO:tasks.workunit.client.0.smithi070.stdout:8/591: dwrite d4/d27/d2a/d3e/f67 [4194304,4194304] 0 2024-09-20T20:31:42.397 INFO:tasks.workunit.client.0.smithi070.stdout:5/528: creat d2/d4/de/d47/d5f/fa7 x:0 0 0 2024-09-20T20:31:42.398 INFO:tasks.workunit.client.0.smithi070.stdout:0/609: readlink d4/d8/d12/d43/d3b/da9/lad 0 2024-09-20T20:31:42.398 INFO:tasks.workunit.client.0.smithi070.stdout:6/610: mkdir d4/d8/d17/d33/d36/ddb 0 2024-09-20T20:31:42.398 INFO:tasks.workunit.client.0.smithi070.stdout:2/546: mkdir d3/d5/d9/dc1 0 2024-09-20T20:31:42.398 INFO:tasks.workunit.client.0.smithi070.stdout:8/592: stat d4/db/d66/f6a 0 2024-09-20T20:31:42.399 INFO:tasks.workunit.client.0.smithi070.stdout:4/549: truncate d6/d26/d69/d71/fa9 505559 0 2024-09-20T20:31:42.399 INFO:tasks.workunit.client.0.smithi070.stdout:3/499: truncate d7/d15/f18 457289 0 2024-09-20T20:31:42.399 INFO:tasks.workunit.client.0.smithi070.stdout:5/529: mkdir d2/df/d40/da8 0 2024-09-20T20:31:42.400 INFO:tasks.workunit.client.0.smithi070.stdout:8/593: stat d4/db/d64/d95/da5/fab 0 2024-09-20T20:31:42.400 INFO:tasks.workunit.client.0.smithi070.stdout:0/610: truncate d4/d19/f95 784772 0 2024-09-20T20:31:42.401 INFO:tasks.workunit.client.0.smithi070.stdout:7/443: dwrite d2/d8/f1d [0,4194304] 0 2024-09-20T20:31:42.401 INFO:tasks.workunit.client.0.smithi070.stdout:3/500: write d7/f1b [2301728,60745] 0 2024-09-20T20:31:42.401 INFO:tasks.workunit.client.0.smithi070.stdout:8/594: readlink d4/d27/d2a/d3e/d39/l3b 0 2024-09-20T20:31:42.401 INFO:tasks.workunit.client.0.smithi070.stdout:5/530: symlink d2/df/d77/la9 0 2024-09-20T20:31:42.402 INFO:tasks.workunit.client.0.smithi070.stdout:4/550: link c3 d6/d26/d69/d71/cae 0 2024-09-20T20:31:42.402 INFO:tasks.workunit.client.0.smithi070.stdout:2/547: rename d3/d5/d9/d1c/d47/d85 to d3/d4c/d5c/db7/dc2 0 2024-09-20T20:31:42.403 INFO:tasks.workunit.client.0.smithi070.stdout:0/611: unlink d4/d8/d55/d7c/l87 0 2024-09-20T20:31:42.403 INFO:tasks.workunit.client.0.smithi070.stdout:7/444: dread - d2/d19/d25/d42/f4f zero size 2024-09-20T20:31:42.403 INFO:tasks.workunit.client.0.smithi070.stdout:4/551: readlink d6/d7/dc/l1b 0 2024-09-20T20:31:42.405 INFO:tasks.workunit.client.0.smithi070.stdout:4/552: stat d6/d43/f57 0 2024-09-20T20:31:42.405 INFO:tasks.workunit.client.0.smithi070.stdout:5/531: creat d2/d4/d98/faa x:0 0 0 2024-09-20T20:31:42.406 INFO:tasks.workunit.client.0.smithi070.stdout:2/548: creat d3/d5/d9/d1c/d1f/d3e/d61/fc3 x:0 0 0 2024-09-20T20:31:42.406 INFO:tasks.workunit.client.0.smithi070.stdout:0/612: creat d4/d8/d12/d43/d3b/da9/fc1 x:0 0 0 2024-09-20T20:31:42.407 INFO:tasks.workunit.client.0.smithi070.stdout:6/611: truncate d4/d8/d17/f1a 2180900 0 2024-09-20T20:31:42.407 INFO:tasks.workunit.client.0.smithi070.stdout:2/549: mknod d3/d5/d9/d79/cc4 0 2024-09-20T20:31:42.408 INFO:tasks.workunit.client.0.smithi070.stdout:4/553: write d6/d5e/d6b/fac [290377,101380] 0 2024-09-20T20:31:42.408 INFO:tasks.workunit.client.0.smithi070.stdout:4/554: sync 2024-09-20T20:31:42.409 INFO:tasks.workunit.client.0.smithi070.stdout:5/532: creat d2/d4/d98/fab x:0 0 0 2024-09-20T20:31:42.409 INFO:tasks.workunit.client.0.smithi070.stdout:6/612: readlink d4/d8/d10/d54/d55/ld9 0 2024-09-20T20:31:42.410 INFO:tasks.workunit.client.0.smithi070.stdout:2/550: fdatasync d3/de/d12/d1a/f30 0 2024-09-20T20:31:42.411 INFO:tasks.workunit.client.0.smithi070.stdout:1/603: dread d4/d6/d11/f3f [0,4194304] 0 2024-09-20T20:31:42.412 INFO:tasks.workunit.client.0.smithi070.stdout:5/533: unlink d2/d4/d98/d5b/f45 0 2024-09-20T20:31:42.412 INFO:tasks.workunit.client.0.smithi070.stdout:4/555: write d6/d5e/d75/d61/f96 [50868,1169] 0 2024-09-20T20:31:42.412 INFO:tasks.workunit.client.0.smithi070.stdout:1/604: sync 2024-09-20T20:31:42.412 INFO:tasks.workunit.client.0.smithi070.stdout:7/445: dwrite d2/d19/f83 [0,4194304] 0 2024-09-20T20:31:42.414 INFO:tasks.workunit.client.0.smithi070.stdout:8/595: dwrite d4/d27/f40 [4194304,4194304] 0 2024-09-20T20:31:42.414 INFO:tasks.workunit.client.0.smithi070.stdout:9/596: dread d1/df/d25/d69/f8d [0,4194304] 0 2024-09-20T20:31:42.415 INFO:tasks.workunit.client.0.smithi070.stdout:6/613: dread d4/d8/d17/f24 [0,4194304] 0 2024-09-20T20:31:42.416 INFO:tasks.workunit.client.0.smithi070.stdout:2/551: creat d3/d4c/d5c/fc5 x:0 0 0 2024-09-20T20:31:42.416 INFO:tasks.workunit.client.0.smithi070.stdout:5/534: mknod d2/d4/de/cac 0 2024-09-20T20:31:42.416 INFO:tasks.workunit.client.0.smithi070.stdout:3/501: dread d7/fd [0,4194304] 0 2024-09-20T20:31:42.417 INFO:tasks.workunit.client.0.smithi070.stdout:9/597: unlink d1/df/l15 0 2024-09-20T20:31:42.417 INFO:tasks.workunit.client.0.smithi070.stdout:8/596: rename d4/db/d64/d7b/l8b to d4/d27/d2a/d5b/d98/lcb 0 2024-09-20T20:31:42.418 INFO:tasks.workunit.client.0.smithi070.stdout:3/502: chown d7/d15/c40 3 1 2024-09-20T20:31:42.418 INFO:tasks.workunit.client.0.smithi070.stdout:6/614: write d4/d8/f2f [5229885,55453] 0 2024-09-20T20:31:42.418 INFO:tasks.workunit.client.0.smithi070.stdout:5/535: mkdir d2/d4/d98/d4c/dad 0 2024-09-20T20:31:42.420 INFO:tasks.workunit.client.0.smithi070.stdout:9/598: getdents d1/df/d25/db2 0 2024-09-20T20:31:42.421 INFO:tasks.workunit.client.0.smithi070.stdout:8/597: rename d4/d27/d2a/d3e/d39/f9f to d4/d27/d2a/d5b/d6c/da6/fcc 0 2024-09-20T20:31:42.421 INFO:tasks.workunit.client.0.smithi070.stdout:9/599: readlink d1/df/d18/d44/da2/lb4 0 2024-09-20T20:31:42.422 INFO:tasks.workunit.client.0.smithi070.stdout:7/446: dwrite d2/f68 [0,4194304] 0 2024-09-20T20:31:42.422 INFO:tasks.workunit.client.0.smithi070.stdout:9/600: creat d1/df/d25/d69/fdd x:0 0 0 2024-09-20T20:31:42.423 INFO:tasks.workunit.client.0.smithi070.stdout:8/598: rename d4/lc to d4/d27/d73/d87/lcd 0 2024-09-20T20:31:42.424 INFO:tasks.workunit.client.0.smithi070.stdout:7/447: symlink d2/l87 0 2024-09-20T20:31:42.425 INFO:tasks.workunit.client.0.smithi070.stdout:8/599: dread - d4/d27/d73/d87/fb3 zero size 2024-09-20T20:31:42.425 INFO:tasks.workunit.client.0.smithi070.stdout:4/556: truncate d6/f8 1619133 0 2024-09-20T20:31:42.426 INFO:tasks.workunit.client.0.smithi070.stdout:9/601: creat d1/df/d84/dc0/fde x:0 0 0 2024-09-20T20:31:42.427 INFO:tasks.workunit.client.0.smithi070.stdout:7/448: mkdir d2/d19/d25/d42/d88 0 2024-09-20T20:31:42.427 INFO:tasks.workunit.client.0.smithi070.stdout:2/552: dwrite d3/d5/dd/d99/dae/fb0 [0,4194304] 0 2024-09-20T20:31:42.429 INFO:tasks.workunit.client.0.smithi070.stdout:6/615: dwrite d4/d8/d10/d3c/f5e [0,4194304] 0 2024-09-20T20:31:42.429 INFO:tasks.workunit.client.0.smithi070.stdout:5/536: dwrite d2/d4/d98/d5b/f26 [0,4194304] 0 2024-09-20T20:31:42.430 INFO:tasks.workunit.client.0.smithi070.stdout:5/537: chown d2/d4/l38 2 1 2024-09-20T20:31:42.431 INFO:tasks.workunit.client.0.smithi070.stdout:5/538: write d2/d4/d53/d59/f61 [15582,94909] 0 2024-09-20T20:31:42.431 INFO:tasks.workunit.client.0.smithi070.stdout:8/600: mknod d4/db/d64/d7b/cce 0 2024-09-20T20:31:42.432 INFO:tasks.workunit.client.0.smithi070.stdout:4/557: symlink d6/d26/d69/d71/laf 0 2024-09-20T20:31:42.432 INFO:tasks.workunit.client.0.smithi070.stdout:7/449: mknod d2/d19/d25/d42/d55/c89 0 2024-09-20T20:31:42.432 INFO:tasks.workunit.client.0.smithi070.stdout:2/553: creat d3/de/d12/d1a/fc6 x:0 0 0 2024-09-20T20:31:42.432 INFO:tasks.workunit.client.0.smithi070.stdout:5/539: creat d2/df/d40/fae x:0 0 0 2024-09-20T20:31:42.433 INFO:tasks.workunit.client.0.smithi070.stdout:4/558: stat d6/d5e/d51/d63/la7 0 2024-09-20T20:31:42.433 INFO:tasks.workunit.client.0.smithi070.stdout:5/540: stat d2/df/c6a 0 2024-09-20T20:31:42.433 INFO:tasks.workunit.client.0.smithi070.stdout:4/559: sync 2024-09-20T20:31:42.433 INFO:tasks.workunit.client.0.smithi070.stdout:2/554: unlink d3/d5/dd/la0 0 2024-09-20T20:31:42.434 INFO:tasks.workunit.client.0.smithi070.stdout:5/541: mknod d2/df/d9d/da5/caf 0 2024-09-20T20:31:42.437 INFO:tasks.workunit.client.0.smithi070.stdout:5/542: creat d2/df/d9d/fb0 x:0 0 0 2024-09-20T20:31:42.437 INFO:tasks.workunit.client.0.smithi070.stdout:0/613: dread d4/d8/d12/d23/d26/d2d/f6c [0,4194304] 0 2024-09-20T20:31:42.438 INFO:tasks.workunit.client.0.smithi070.stdout:5/543: chown d2/df/d9d/fb0 554202314 1 2024-09-20T20:31:42.438 INFO:tasks.workunit.client.0.smithi070.stdout:2/555: getdents d3/d4c/d5c/d86 0 2024-09-20T20:31:42.438 INFO:tasks.workunit.client.0.smithi070.stdout:0/614: write d4/d8/d55/fb3 [954605,26867] 0 2024-09-20T20:31:42.438 INFO:tasks.workunit.client.0.smithi070.stdout:7/450: dwrite d2/f51 [0,4194304] 0 2024-09-20T20:31:42.439 INFO:tasks.workunit.client.0.smithi070.stdout:2/556: stat d3/d4c/d5c 0 2024-09-20T20:31:42.439 INFO:tasks.workunit.client.0.smithi070.stdout:8/601: rename d4/db/c5f to d4/d27/d42/ccf 0 2024-09-20T20:31:42.439 INFO:tasks.workunit.client.0.smithi070.stdout:2/557: sync 2024-09-20T20:31:42.439 INFO:tasks.workunit.client.0.smithi070.stdout:2/558: sync 2024-09-20T20:31:42.439 INFO:tasks.workunit.client.0.smithi070.stdout:7/451: fsync d2/d30/f3f 0 2024-09-20T20:31:42.440 INFO:tasks.workunit.client.0.smithi070.stdout:8/602: write d4/f28 [4603406,40387] 0 2024-09-20T20:31:42.440 INFO:tasks.workunit.client.0.smithi070.stdout:2/559: mknod d3/d5/d9/d1c/d4e/da4/cc7 0 2024-09-20T20:31:42.441 INFO:tasks.workunit.client.0.smithi070.stdout:8/603: write d4/db/f5e [2013031,67742] 0 2024-09-20T20:31:42.442 INFO:tasks.workunit.client.0.smithi070.stdout:7/452: mknod d2/d19/d25/d2a/c8a 0 2024-09-20T20:31:42.442 INFO:tasks.workunit.client.0.smithi070.stdout:8/604: chown d4/d27/d2a/f1c 522599259 1 2024-09-20T20:31:42.442 INFO:tasks.workunit.client.0.smithi070.stdout:7/453: dread - d2/d8/f22 zero size 2024-09-20T20:31:42.443 INFO:tasks.workunit.client.0.smithi070.stdout:8/605: creat d4/d27/d2a/d5b/d98/da9/fd0 x:0 0 0 2024-09-20T20:31:42.443 INFO:tasks.workunit.client.0.smithi070.stdout:7/454: creat d2/d19/d25/d42/d77/f8b x:0 0 0 2024-09-20T20:31:42.444 INFO:tasks.workunit.client.0.smithi070.stdout:8/606: mknod d4/db/d64/cd1 0 2024-09-20T20:31:42.444 INFO:tasks.workunit.client.0.smithi070.stdout:7/455: rmdir d2/d19/d25/d2a 39 2024-09-20T20:31:42.445 INFO:tasks.workunit.client.0.smithi070.stdout:8/607: stat d4/d27/d2a/d3e/f56 0 2024-09-20T20:31:42.445 INFO:tasks.workunit.client.0.smithi070.stdout:1/605: dread f2 [0,4194304] 0 2024-09-20T20:31:42.445 INFO:tasks.workunit.client.0.smithi070.stdout:7/456: creat d2/d19/d25/d84/f8c x:0 0 0 2024-09-20T20:31:42.446 INFO:tasks.workunit.client.0.smithi070.stdout:8/608: symlink d4/d27/d2a/d7e/ld2 0 2024-09-20T20:31:42.446 INFO:tasks.workunit.client.0.smithi070.stdout:7/457: rmdir d2/d30/d63/d69 39 2024-09-20T20:31:42.447 INFO:tasks.workunit.client.0.smithi070.stdout:1/606: creat d4/d6/d11/d63/d6c/fe5 x:0 0 0 2024-09-20T20:31:42.447 INFO:tasks.workunit.client.0.smithi070.stdout:7/458: mknod d2/d19/d25/d42/c8d 0 2024-09-20T20:31:42.447 INFO:tasks.workunit.client.0.smithi070.stdout:8/609: dread - d4/d27/d2a/d5b/d6c/da6/fb9 zero size 2024-09-20T20:31:42.448 INFO:tasks.workunit.client.0.smithi070.stdout:7/459: chown d2/d8/f6 196670238 1 2024-09-20T20:31:42.448 INFO:tasks.workunit.client.0.smithi070.stdout:8/610: dread - d4/d27/d73/d87/fb3 zero size 2024-09-20T20:31:42.448 INFO:tasks.workunit.client.0.smithi070.stdout:7/460: fdatasync d2/d19/d25/d61/f6f 0 2024-09-20T20:31:42.449 INFO:tasks.workunit.client.0.smithi070.stdout:8/611: write d4/db/f32 [6642321,15397] 0 2024-09-20T20:31:42.450 INFO:tasks.workunit.client.0.smithi070.stdout:3/503: dread d7/d15/d1a/d4a/f4d [0,4194304] 0 2024-09-20T20:31:42.450 INFO:tasks.workunit.client.0.smithi070.stdout:8/612: mkdir d4/dd3 0 2024-09-20T20:31:42.452 INFO:tasks.workunit.client.0.smithi070.stdout:6/616: dread f0 [0,4194304] 0 2024-09-20T20:31:42.452 INFO:tasks.workunit.client.0.smithi070.stdout:3/504: mkdir d7/d15/d1a/d48/d66/d69/d99 0 2024-09-20T20:31:42.454 INFO:tasks.workunit.client.0.smithi070.stdout:6/617: write d4/d8/d17/f49 [290619,25889] 0 2024-09-20T20:31:42.454 INFO:tasks.workunit.client.0.smithi070.stdout:3/505: creat d7/d15/d1e/d65/f9a x:0 0 0 2024-09-20T20:31:42.455 INFO:tasks.workunit.client.0.smithi070.stdout:1/607: dwrite d4/d6/d11/d63/d6c/fbf [0,4194304] 0 2024-09-20T20:31:42.457 INFO:tasks.workunit.client.0.smithi070.stdout:3/506: stat d7/d15/d1e/d65/f3c 0 2024-09-20T20:31:42.458 INFO:tasks.workunit.client.0.smithi070.stdout:1/608: mkdir d4/d32/de6 0 2024-09-20T20:31:42.458 INFO:tasks.workunit.client.0.smithi070.stdout:7/461: dwrite d2/d19/f1a [0,4194304] 0 2024-09-20T20:31:42.459 INFO:tasks.workunit.client.0.smithi070.stdout:7/462: dread - d2/d30/d63/f81 zero size 2024-09-20T20:31:42.460 INFO:tasks.workunit.client.0.smithi070.stdout:3/507: symlink d7/d15/d1a/d48/d66/d69/d13/d72/l9b 0 2024-09-20T20:31:42.461 INFO:tasks.workunit.client.0.smithi070.stdout:8/613: dwrite d4/db/f1b [0,4194304] 0 2024-09-20T20:31:42.462 INFO:tasks.workunit.client.0.smithi070.stdout:7/463: truncate d2/d19/d25/d2a/f7d 48550 0 2024-09-20T20:31:42.463 INFO:tasks.workunit.client.0.smithi070.stdout:8/614: rename d4/d27/d2a/d3e/d39/f51 to d4/db/fd4 0 2024-09-20T20:31:42.464 INFO:tasks.workunit.client.0.smithi070.stdout:7/464: stat d2/d30/c7b 0 2024-09-20T20:31:42.465 INFO:tasks.workunit.client.0.smithi070.stdout:8/615: creat d4/d27/d2a/d7e/fd5 x:0 0 0 2024-09-20T20:31:42.465 INFO:tasks.workunit.client.0.smithi070.stdout:6/618: dwrite d4/d8/d10/d54/d7a/f9e [0,4194304] 0 2024-09-20T20:31:42.465 INFO:tasks.workunit.client.0.smithi070.stdout:7/465: readlink d2/d8/l23 0 2024-09-20T20:31:42.466 INFO:tasks.workunit.client.0.smithi070.stdout:7/466: sync 2024-09-20T20:31:42.467 INFO:tasks.workunit.client.0.smithi070.stdout:8/616: write d4/d27/d2a/d3e/d31/f3f [3320747,71268] 0 2024-09-20T20:31:42.467 INFO:tasks.workunit.client.0.smithi070.stdout:6/619: truncate d4/d8/d17/f57 2850383 0 2024-09-20T20:31:42.468 INFO:tasks.workunit.client.0.smithi070.stdout:8/617: fdatasync d4/db/fc9 0 2024-09-20T20:31:42.468 INFO:tasks.workunit.client.0.smithi070.stdout:8/618: creat d4/d27/fd6 x:0 0 0 2024-09-20T20:31:42.469 INFO:tasks.workunit.client.0.smithi070.stdout:8/619: chown d4/db/d64/f93 74 1 2024-09-20T20:31:42.469 INFO:tasks.workunit.client.0.smithi070.stdout:4/560: dread d6/d26/d69/d71/f6d [0,4194304] 0 2024-09-20T20:31:42.470 INFO:tasks.workunit.client.0.smithi070.stdout:6/620: dread d4/d8/ff [0,4194304] 0 2024-09-20T20:31:42.471 INFO:tasks.workunit.client.0.smithi070.stdout:4/561: creat d6/d5e/fb0 x:0 0 0 2024-09-20T20:31:42.471 INFO:tasks.workunit.client.0.smithi070.stdout:6/621: creat d4/d8/d38/fdc x:0 0 0 2024-09-20T20:31:42.472 INFO:tasks.workunit.client.0.smithi070.stdout:6/622: write d4/d8/f4c [2101739,126573] 0 2024-09-20T20:31:42.472 INFO:tasks.workunit.client.0.smithi070.stdout:4/562: link d6/d5e/f70 d6/d7/dc/d4a/fb1 0 2024-09-20T20:31:42.473 INFO:tasks.workunit.client.0.smithi070.stdout:1/609: truncate d4/d6/d11/d63/d6c/f98 554576 0 2024-09-20T20:31:42.474 INFO:tasks.workunit.client.0.smithi070.stdout:4/563: creat d6/d26/fb2 x:0 0 0 2024-09-20T20:31:42.474 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:42.472+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:42.475 INFO:tasks.workunit.client.0.smithi070.stdout:1/610: unlink d4/d32/d34/d44/d5a/la1 0 2024-09-20T20:31:42.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/564: chown d6/d7/dc/d4a/d81 3394594 1 2024-09-20T20:31:42.475 INFO:tasks.workunit.client.0.smithi070.stdout:9/602: dread d1/df/d18/d44/d77/f99 [0,4194304] 0 2024-09-20T20:31:42.476 INFO:tasks.workunit.client.0.smithi070.stdout:4/565: write d6/d26/d69/d71/d4c/f8f [565998,49659] 0 2024-09-20T20:31:42.476 INFO:tasks.workunit.client.0.smithi070.stdout:9/603: write d1/df/d25/d9e/fa4 [280507,118493] 0 2024-09-20T20:31:42.477 INFO:tasks.workunit.client.0.smithi070.stdout:4/566: rmdir d6/d7/dc/d20 39 2024-09-20T20:31:42.482 INFO:tasks.workunit.client.0.smithi070.stdout:9/604: dwrite d1/df/d18/d44/fc6 [0,4194304] 0 2024-09-20T20:31:42.484 INFO:tasks.workunit.client.0.smithi070.stdout:2/560: dread d3/d5/dd/d5a/f5f [0,4194304] 0 2024-09-20T20:31:42.486 INFO:tasks.workunit.client.0.smithi070.stdout:2/561: write d3/d5/d9/d10/f52 [549447,83835] 0 2024-09-20T20:31:42.487 INFO:tasks.workunit.client.0.smithi070.stdout:2/562: chown d3/d4c/d5c/fa2 420531010 1 2024-09-20T20:31:42.487 INFO:tasks.workunit.client.0.smithi070.stdout:3/508: dread d7/d15/d1a/d48/d66/d69/d13/d1d/f7b [0,4194304] 0 2024-09-20T20:31:42.488 INFO:tasks.workunit.client.0.smithi070.stdout:2/563: mknod d3/d5/cc8 0 2024-09-20T20:31:42.488 INFO:tasks.workunit.client.0.smithi070.stdout:3/509: unlink d7/d71/l98 0 2024-09-20T20:31:42.489 INFO:tasks.workunit.client.0.smithi070.stdout:8/620: truncate d4/d27/d2a/d5b/d6c/da6/fcc 1514323 0 2024-09-20T20:31:42.489 INFO:tasks.workunit.client.0.smithi070.stdout:6/623: write d4/d8/d17/f1a [278495,73854] 0 2024-09-20T20:31:42.489 INFO:tasks.workunit.client.0.smithi070.stdout:3/510: symlink d7/d15/d1a/d48/d57/l9c 0 2024-09-20T20:31:42.490 INFO:tasks.workunit.client.0.smithi070.stdout:2/564: symlink d3/d5/dd/lc9 0 2024-09-20T20:31:42.491 INFO:tasks.workunit.client.0.smithi070.stdout:0/615: dread d4/fd [0,4194304] 0 2024-09-20T20:31:42.491 INFO:tasks.workunit.client.0.smithi070.stdout:8/621: rmdir d4/d27/d2a/d5b 39 2024-09-20T20:31:42.491 INFO:tasks.workunit.client.0.smithi070.stdout:6/624: stat d4/d8/d17/f24 0 2024-09-20T20:31:42.492 INFO:tasks.workunit.client.0.smithi070.stdout:7/467: dread d2/d19/d25/f4c [0,4194304] 0 2024-09-20T20:31:42.492 INFO:tasks.workunit.client.0.smithi070.stdout:0/616: symlink d4/d8/d12/lc2 0 2024-09-20T20:31:42.493 INFO:tasks.workunit.client.0.smithi070.stdout:8/622: creat d4/d27/d73/fd7 x:0 0 0 2024-09-20T20:31:42.493 INFO:tasks.workunit.client.0.smithi070.stdout:5/544: dread d2/f79 [0,4194304] 0 2024-09-20T20:31:42.493 INFO:tasks.workunit.client.0.smithi070.stdout:6/625: chown d4/d8/d10/d54/d7a/fd5 849262284 1 2024-09-20T20:31:42.494 INFO:tasks.workunit.client.0.smithi070.stdout:3/511: rmdir d7/d15/d1a/d48/d66/d69/d13/d1d 39 2024-09-20T20:31:42.495 INFO:tasks.workunit.client.0.smithi070.stdout:7/468: symlink d2/d30/l8e 0 2024-09-20T20:31:42.495 INFO:tasks.workunit.client.0.smithi070.stdout:4/567: dwrite d6/d43/f5c [0,4194304] 0 2024-09-20T20:31:42.495 INFO:tasks.workunit.client.0.smithi070.stdout:0/617: creat d4/d48/d7b/fc3 x:0 0 0 2024-09-20T20:31:42.495 INFO:tasks.workunit.client.0.smithi070.stdout:1/611: truncate d4/d6/d11/d63/d6c/f98 1427413 0 2024-09-20T20:31:42.495 INFO:tasks.workunit.client.0.smithi070.stdout:5/545: creat d2/d7/d60/fb1 x:0 0 0 2024-09-20T20:31:42.497 INFO:tasks.workunit.client.0.smithi070.stdout:8/623: mkdir d4/d27/d2a/d5b/d98/da9/db5/dd8 0 2024-09-20T20:31:42.498 INFO:tasks.workunit.client.0.smithi070.stdout:7/469: symlink d2/d8/l8f 0 2024-09-20T20:31:42.499 INFO:tasks.workunit.client.0.smithi070.stdout:5/546: creat d2/d4/de/fb2 x:0 0 0 2024-09-20T20:31:42.501 INFO:tasks.workunit.client.0.smithi070.stdout:4/568: chown d6/d7/dc/l1b 1340 1 2024-09-20T20:31:42.501 INFO:tasks.workunit.client.0.smithi070.stdout:2/565: dwrite d3/d5/f34 [0,4194304] 0 2024-09-20T20:31:42.502 INFO:tasks.workunit.client.0.smithi070.stdout:9/605: dwrite d1/f5 [0,4194304] 0 2024-09-20T20:31:42.503 INFO:tasks.workunit.client.0.smithi070.stdout:7/470: mknod d2/d19/d25/d2a/d4a/c90 0 2024-09-20T20:31:42.503 INFO:tasks.workunit.client.0.smithi070.stdout:0/618: dread d4/d19/d5b/f5f [0,4194304] 0 2024-09-20T20:31:42.503 INFO:tasks.workunit.client.0.smithi070.stdout:9/606: fsync d1/df/f28 0 2024-09-20T20:31:42.503 INFO:tasks.workunit.client.0.smithi070.stdout:5/547: creat d2/df/d9d/fb3 x:0 0 0 2024-09-20T20:31:42.504 INFO:tasks.workunit.client.0.smithi070.stdout:2/566: symlink d3/lca 0 2024-09-20T20:31:42.504 INFO:tasks.workunit.client.0.smithi070.stdout:4/569: symlink d6/d43/lb3 0 2024-09-20T20:31:42.505 INFO:tasks.workunit.client.0.smithi070.stdout:8/624: link d4/db/d64/d95/da5/caa d4/d27/d2a/d43/d61/cd9 0 2024-09-20T20:31:42.505 INFO:tasks.workunit.client.0.smithi070.stdout:6/626: dwrite d4/d8/d10/d3c/f8d [0,4194304] 0 2024-09-20T20:31:42.505 INFO:tasks.workunit.client.0.smithi070.stdout:7/471: creat d2/d19/d25/d42/f91 x:0 0 0 2024-09-20T20:31:42.505 INFO:tasks.workunit.client.0.smithi070.stdout:5/548: chown d2/df/d9d/da5/caf 642491 1 2024-09-20T20:31:42.506 INFO:tasks.workunit.client.0.smithi070.stdout:3/512: dwrite d7/fd [0,4194304] 0 2024-09-20T20:31:42.506 INFO:tasks.workunit.client.0.smithi070.stdout:0/619: symlink d4/d48/lc4 0 2024-09-20T20:31:42.506 INFO:tasks.workunit.client.0.smithi070.stdout:5/549: fsync d2/d7/d88/fa1 0 2024-09-20T20:31:42.507 INFO:tasks.workunit.client.0.smithi070.stdout:2/567: mknod d3/d4c/d5c/db7/ccb 0 2024-09-20T20:31:42.508 INFO:tasks.workunit.client.0.smithi070.stdout:9/607: unlink d1/df/f28 0 2024-09-20T20:31:42.508 INFO:tasks.workunit.client.0.smithi070.stdout:8/625: creat d4/db/d64/d95/da5/fda x:0 0 0 2024-09-20T20:31:42.510 INFO:tasks.workunit.client.0.smithi070.stdout:6/627: creat d4/d8/d1e/fdd x:0 0 0 2024-09-20T20:31:42.510 INFO:tasks.workunit.client.0.smithi070.stdout:0/620: readlink d4/d8/d12/d23/d26/d1d/d7e/l8a 0 2024-09-20T20:31:42.511 INFO:tasks.workunit.client.0.smithi070.stdout:2/568: truncate d3/d5/f2e 4253340 0 2024-09-20T20:31:42.511 INFO:tasks.workunit.client.0.smithi070.stdout:0/621: chown d4/d19/d82 0 1 2024-09-20T20:31:42.513 INFO:tasks.workunit.client.0.smithi070.stdout:4/570: dwrite d6/d5e/d75/f21 [0,4194304] 0 2024-09-20T20:31:42.513 INFO:tasks.workunit.client.0.smithi070.stdout:2/569: symlink d3/d5/dd/d99/dae/lcc 0 2024-09-20T20:31:42.513 INFO:tasks.workunit.client.0.smithi070.stdout:3/513: dread d7/d15/d1a/d4a/d51/d5b/f6a [0,4194304] 0 2024-09-20T20:31:42.513 INFO:tasks.workunit.client.0.smithi070.stdout:8/626: creat d4/d27/d2a/d3e/d31/d63/fdb x:0 0 0 2024-09-20T20:31:42.516 INFO:tasks.workunit.client.0.smithi070.stdout:3/514: mkdir d7/d15/d1e/d65/d9d 0 2024-09-20T20:31:42.516 INFO:tasks.workunit.client.0.smithi070.stdout:8/627: write d4/d27/faf [552659,100599] 0 2024-09-20T20:31:42.516 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:42.516 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:42.516 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:42.516 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:42.516 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.516 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560809944000001, 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.517 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:42.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:42.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.520 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560758433, 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.522 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:42.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.527 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560711979000001, 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.528 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:42.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:42.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:42.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560673778, 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:42.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:42.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:42.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.537 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560642199, 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:42.539 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:42.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:42.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.543 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560590704999999, 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:42.544 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.56055636, 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.549 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.554 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560525461999999, 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:42.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560476398, 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.560 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.565 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.560443633, 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.567 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:42.570 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.542233861, 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.571 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:42.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.541677633000001, 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.576 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.578 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.579 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:42.580 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.581 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.541182482, 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.582 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:42.583 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:42.584 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:42.585 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.586 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.540516845999999, 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.587 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.588 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.589 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.590 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:42.591 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.592 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.539922151000001, 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.593 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:42.594 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:42.595 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:42.596 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.597 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.539795627, 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.598 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.599 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.600 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.601 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:42.602 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.603 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.539712342, 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.604 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.605 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.606 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:42.607 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.608 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:42.609 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.538731888999999, 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.610 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:42.613 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:42.614 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.538620908, 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.615 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:42.618 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:42.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.620 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 10.533033904, 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:42.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.623 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:42.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:42.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:42.626 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:42.628 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:42.634 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:42.624+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:42.645 INFO:tasks.workunit.client.0.smithi070.stdout:2/570: rename d3/de/d12/c17 to d3/d5/d9/d1c/d1f/d3e/ccd 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:4/571: rmdir d6/d5e/d75/d40 39 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:3/515: mkdir d7/d15/d1a/d4a/d51/d5b/d9e 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:7/472: dwrite d2/d8/f3b [0,4194304] 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:2/571: chown d3/d5/d9/d1c/d1f/d3e/d61 3029715 1 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:4/572: link d6/d26/d97/c9f d6/d7/dc/d4a/d81/cb4 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:2/572: getdents d3/d4c/d5c 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:3/516: link d7/d15/d1a/d48/d66/d69/d13/d1d/l35 d7/d15/d1e/l9f 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:4/573: write d6/d7/f45 [4564728,14352] 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:3/517: dread - d7/d15/d1a/d4a/f94 zero size 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:8/628: dread d4/f38 [0,4194304] 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:9/608: write d1/df/d18/d46/f63 [995342,86366] 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:8/629: write d4/d27/d2a/d3e/d31/d63/fac [303108,44706] 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:6/628: write d4/f7 [445631,102525] 0 2024-09-20T20:31:42.646 INFO:tasks.workunit.client.0.smithi070.stdout:7/473: truncate d2/d8/f47 228431 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:4/574: dwrite d6/d26/d69/d71/f7e [0,4194304] 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:8/630: dread - d4/db/d64/d95/f9b zero size 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:2/573: sync 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:6/629: chown d4/d8/l18 443223 1 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:7/474: mknod d2/d52/c92 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:3/518: dwrite d7/d15/d1a/d48/d66/d69/f42 [0,4194304] 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:2/574: creat d3/d5/d9/d10/fce x:0 0 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:8/631: truncate d4/d27/d2a/d7e/fd5 121652 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:8/632: chown d4/d27/d2a/c7c 463175715 1 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:6/630: creat d4/d8/d17/db2/db5/fde x:0 0 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:2/575: rename d3/d5/d9/d1c/d1f/d3e/d92/faf to d3/d5/d9/fcf 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:1/612: dread d4/d32/d60/dca/fcc [0,4194304] 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:5/550: dread d2/d7/f9 [0,4194304] 0 2024-09-20T20:31:42.647 INFO:tasks.workunit.client.0.smithi070.stdout:8/633: rename d4/d27/d2a/d3e/d39/l3b to d4/d27/d2a/d43/d61/ldc 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:4/575: dwrite d6/d7/dc/d20/f38 [0,4194304] 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:7/475: dwrite d2/d19/d25/d42/d55/f71 [0,4194304] 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:1/613: fdatasync d4/d6/f21 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:3/519: dwrite d7/d15/d1e/d65/f3c [4194304,4194304] 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:5/551: mknod d2/d4/d53/d59/cb4 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:5/552: stat d2/d7/d88/l5c 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:4/576: dread - d6/d43/f8e zero size 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:3/520: chown d7/d15/d1a/f78 26 1 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:5/553: stat d2/d7/d60 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:0/622: dread d4/d8/d12/d23/d26/d1d/d37/d38/f63 [0,4194304] 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:6/631: getdents d4/d8/d10/d54/d55/d72 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:5/554: mknod d2/d4/cb5 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:0/623: chown d4/d8/d12/f25 1046735545 1 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:5/555: fsync d2/d7/d60/fb1 0 2024-09-20T20:31:42.648 INFO:tasks.workunit.client.0.smithi070.stdout:3/521: rename d7/d15/f45 to d7/d15/d1a/d4a/d51/d5b/fa0 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:5/556: mknod d2/d4/d98/d4c/cb6 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:7/476: creat d2/d30/d63/f93 x:0 0 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:3/522: readlink d7/l31 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:6/632: rename d4/d8/d17/f34 to d4/d8/d17/d33/d36/ddb/fdf 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:1/614: getdents d4/d32/d34/d44/d48 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:7/477: fdatasync d2/d8/f1d 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:0/624: creat d4/d8/d12/d23/d26/fc5 x:0 0 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:5/557: mkdir d2/db7 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:6/633: unlink d4/d8/d10/d3c/f5e 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:5/558: fsync d2/d7/d60/fb1 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:3/523: mknod d7/d15/d1a/d48/d66/d69/d13/d72/ca1 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:7/478: rename d2/d19/l32 to d2/d19/d2e/l94 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:1/615: getdents d4/d32/d60/dca/dd2 0 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:6/634: chown d4/d8/d10/c12 83047754 1 2024-09-20T20:31:42.649 INFO:tasks.workunit.client.0.smithi070.stdout:0/625: creat d4/d8/d12/d23/d26/d1d/fc6 x:0 0 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:5/559: fdatasync d2/d4/f1e 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:1/616: truncate d4/d32/d34/d44/d5a/fc1 1756956 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:6/635: chown d4/d8/l6c 2084541534 1 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:7/479: getdents d2/d19/d25/d42/d55 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:1/617: rename d4/d32/d34 to d4/d6/d11/d63/de7 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:6/636: getdents d4/d8/d10/d54/d55/d72 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:7/480: dread - d2/d30/d63/f81 zero size 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:1/618: chown d4/d6/d26/f5b 2141993212 1 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:7/481: mkdir d2/d19/d25/d61/d95 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:3/524: dwrite d7/d15/f3f [0,4194304] 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:1/619: write d4/d6/d11/f38 [484149,127213] 0 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:3/525: chown d7/d15/d1a/d4a/d51/d5b 42817 1 2024-09-20T20:31:42.650 INFO:tasks.workunit.client.0.smithi070.stdout:1/620: mkdir d4/d6/d11/d63/de7/d44/de8 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:3/526: write d7/d15/d1a/f78 [1279198,80165] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:8/634: dwrite d4/d27/d42/f54 [4194304,4194304] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:0/626: dwrite d4/d13/f9d [0,4194304] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:4/577: dwrite d6/d7/dc/d4a/fb1 [0,4194304] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:3/527: mknod d7/d15/d1a/d48/d66/d69/ca2 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:1/621: mknod d4/d6/d11/d63/de7/d44/d4b/d87/da9/db4/ce9 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:0/627: rmdir d4/d8/d12/d43/d3b/da9 39 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:2/576: dwrite d3/d5/d9/fcf [0,4194304] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:6/637: dwrite d4/f13 [0,4194304] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:9/609: dread d1/df/d18/d46/f73 [0,4194304] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:7/482: dwrite d2/d19/d25/d42/f4f [0,4194304] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:9/610: write d1/df/d18/f66 [4833177,91770] 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:6/638: truncate d4/d8/d38/fcb 384352 0 2024-09-20T20:31:42.651 INFO:tasks.workunit.client.0.smithi070.stdout:4/578: truncate d6/d7/f16 1857971 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:3/528: write d7/d15/d1a/d4a/d51/d5b/fa0 [865750,120010] 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:8/635: dread d4/d27/d2a/d5b/d98/fb4 [4194304,4194304] 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:1/622: rename d4/d6/d11/d2c to d4/d32/dea 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:7/483: symlink d2/d52/l96 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:9/611: mknod d1/df/d25/d69/cdf 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:3/529: creat d7/d15/d1a/d4a/d51/d5b/fa3 x:0 0 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:6/639: mknod d4/d8/d10/d3c/d99/ce0 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:9/612: dread - d1/df/d18/d44/fba zero size 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:7/484: write d2/d19/d25/d61/f6f [4550948,5769] 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:4/579: link d6/d7/dc/d4a/d58/l66 d6/d5e/d75/d61/lb5 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:3/530: symlink d7/d15/d1e/d60/la4 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:0/628: getdents d4/d8/d12/d23/d26/d1d/d41 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:2/577: fsync d3/de/f6d 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:8/636: write d4/d27/d2a/d3e/d39/f41 [2805063,95180] 0 2024-09-20T20:31:42.652 INFO:tasks.workunit.client.0.smithi070.stdout:0/629: symlink d4/d13/lc7 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:3/531: chown d7/d15/d1a/d4a/d51/l6f 289 1 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:2/578: symlink d3/d5/d9/d1c/d1f/d3e/ld0 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:8/637: truncate d4/db/d66/f78 143458 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:7/485: dread d2/d19/d25/f4c [4194304,4194304] 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:5/560: dread d2/d4/d53/d59/f61 [0,4194304] 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:0/630: fsync d4/d8/d12/d23/d26/d2d/f96 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:7/486: readlink d2/d30/l7a 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:2/579: dread - d3/d5/d9/d1c/f65 zero size 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:5/561: read - d2/d4/de/fb2 zero size 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:8/638: creat d4/d27/d2a/d5b/d6c/fdd x:0 0 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:4/580: write d6/d7/dc/d4a/d81/fa3 [1112185,11775] 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:8/639: mkdir d4/d27/dde 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:2/580: creat d3/d5/d9/d1c/d47/d7e/fd1 x:0 0 0 2024-09-20T20:31:42.653 INFO:tasks.workunit.client.0.smithi070.stdout:1/623: dwrite d4/d6/d11/d63/d6c/fbe [0,4194304] 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:6/640: dwrite d4/d8/d10/f92 [0,4194304] 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:2/581: readlink d3/d4c/d5c/db7/lc0 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:9/613: dread d1/df/d38/f47 [0,4194304] 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:8/640: write d4/d27/f40 [7948216,130275] 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:2/582: truncate d3/d4c/d5c/fc5 534183 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:8/641: mkdir d4/d27/d2a/d3e/d39/ddf 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:6/641: symlink d4/d8/d10/d54/le1 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:1/624: link d4/d6/d11/d63/da3/cb9 d4/d32/dea/d3a/d9d/db7/ceb 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:6/642: rename d4/d8/d10/f45 to d4/d8/d1e/fe2 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:8/642: write d4/d27/d2a/d3e/d39/f97 [4826082,19259] 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:1/625: chown d4/d32/dea/d3a/d78/la8 66056 1 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:4/581: dwrite d6/d26/f87 [0,4194304] 0 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:6/643: rmdir d4/d8/d3a 39 2024-09-20T20:31:42.654 INFO:tasks.workunit.client.0.smithi070.stdout:8/643: write d4/d27/d2a/f1c [3380242,56486] 0 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:8/644: write d4/db/d64/d95/fbe [585132,74460] 0 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:4/582: chown d6/d26/d69/l8d 3329009 1 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:8/645: fsync d4/d27/d2a/d3e/d31/d63/fc2 0 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:0/631: write d4/d19/f29 [3869006,69927] 0 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:4/583: chown d6/d7/dc/d4a/d58/f6c 42062753 1 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:0/632: chown f2 1811 1 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:0/633: chown d4/d48/d67 1 1 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:7/487: truncate d2/d30/f59 1188650 0 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:4/584: dread d6/d26/f90 [0,4194304] 0 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:7/488: symlink d2/d19/d25/d2a/l97 0 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:5/562: truncate d2/d4/d98/f87 167295 0 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:4/585: rmdir d6/d26 39 2024-09-20T20:31:42.655 INFO:tasks.workunit.client.0.smithi070.stdout:5/563: mknod d2/df/d9d/da5/cb8 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:7/489: rename d2/d19/d25/d42/c5b to d2/d19/d25/d84/c98 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:4/586: symlink d6/d7/dc/d20/lb6 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/646: dwrite d4/d27/d42/f9d [0,4194304] 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:5/564: rename d2/df/d40/fae to d2/d4/d53/fb9 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/647: readlink d4/l5 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:5/565: chown d2/d7/d88/f4d 2 1 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:7/490: rename d2/d19/d25/d2a/l43 to d2/d19/d25/d84/l99 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:8/648: symlink d4/d27/dc6/le0 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:5/566: mkdir d2/d4/d98/d4c/dad/dba 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:7/491: symlink d2/d19/d25/d42/d88/l9a 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:4/587: dread d6/d43/f5c [0,4194304] 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:4/588: symlink d6/d5e/d75/d40/lb7 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:4/589: symlink d6/d7/dc/d4a/lb8 0 2024-09-20T20:31:42.656 INFO:tasks.workunit.client.0.smithi070.stdout:3/532: dread d7/d15/d1e/d65/f27 [0,4194304] 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:3/533: write d7/d15/f4f [338095,11977] 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:5/567: dwrite d2/d4/d98/f56 [0,4194304] 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:2/583: dread d3/d5/d9/f29 [0,4194304] 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:0/634: dwrite d4/d48/d7b/fbc [0,4194304] 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:1/626: sync 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:3/534: symlink d7/d15/d1a/d48/d57/d75/la5 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:1/627: fdatasync d4/d6/d11/d63/d6c/fe5 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:0/635: mknod d4/d8/d12/d23/d26/d1d/d7e/cc8 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:0/636: fsync d4/d1b/f3d 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:2/584: getdents d3/d5/d9/d1c/d4e/da4 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:3/535: creat d7/d15/fa6 x:0 0 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:4/590: write d6/d7/f16 [1662407,114654] 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:5/568: write f1 [3762713,108884] 0 2024-09-20T20:31:42.657 INFO:tasks.workunit.client.0.smithi070.stdout:6/644: dread d4/d8/d10/f89 [0,4194304] 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:0/637: link d4/d8/d12/f25 d4/d8/d12/d43/fc9 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/569: stat d2/d4/de/c52 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:4/591: mknod d6/d43/d5a/cb9 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:0/638: stat d4/f62 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:9/614: dread d1/f2a [0,4194304] 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:6/645: truncate d4/d8/d1e/f7c 818951 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:9/615: write d1/df/d38/f7c [2064569,123129] 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:3/536: creat d7/d15/d1a/d80/d8e/fa7 x:0 0 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/570: symlink d2/df/d40/lbb 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:2/585: creat d3/de/d12/d4f/fd2 x:0 0 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:6/646: creat d4/d8/d17/fe3 x:0 0 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:0/639: creat d4/d8/db6/fca x:0 0 0 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:3/537: chown d7/d15/d1a/d48/f50 1878404 1 2024-09-20T20:31:42.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/571: creat d2/df/d9d/fbc x:0 0 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:6/647: mknod d4/d8/d1e/d7e/ce4 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:2/586: symlink d3/d5/d9/d1c/d47/d7e/ld3 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:5/572: mkdir d2/d7/d60/dbd 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:2/587: rmdir d3/d5/d9/d1c/d47 39 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:3/538: symlink d7/d15/d1a/d4a/d51/d5b/d9e/la8 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:6/648: rename d4/d8/f4f to d4/d8/db4/db6/fe5 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:1/628: dwrite d4/d32/dea/d3b/f74 [4194304,4194304] 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:5/573: mknod d2/d7/d60/dbd/cbe 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:3/539: mkdir d7/d15/d1e/da9 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:2/588: read d3/d5/dd/f89 [18883,23688] 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:6/649: write d4/d8/d17/d33/d36/ddb/fdf [4995960,26153] 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:1/629: creat d4/d32/dea/d3a/fec x:0 0 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:5/574: write d2/d4/de/f34 [202061,4405] 0 2024-09-20T20:31:42.659 INFO:tasks.workunit.client.0.smithi070.stdout:2/589: truncate d3/de/f39 4273503 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:3/540: readlink d7/d15/d1a/d48/d66/d69/d13/d7a/l95 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:6/650: symlink d4/d8/db4/dbd/le6 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:9/616: dwrite d1/df/d25/d69/d85/d9f/fd5 [0,4194304] 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:0/640: dwrite d4/fd [0,4194304] 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:5/575: rename d2/d4/l3b to d2/df/d9d/lbf 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:6/651: creat d4/d8/d10/fe7 x:0 0 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:3/541: write d7/d15/d1a/d48/d66/d69/d13/d72/f73 [568392,4205] 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:9/617: creat d1/df/d18/d44/da2/dcc/fe0 x:0 0 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:1/630: rename d4/d32/dea/d3a/d9d/db7/ceb to d4/d6/d11/d63/de7/d44/d4b/d87/dbb/ced 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:0/641: mknod d4/d8/d12/d23/d26/d1d/d37/ccb 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:5/576: creat d2/d4/d98/fc0 x:0 0 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:6/652: rmdir d4/d8/d10/d3c/d99 39 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:9/618: creat d1/df/d18/d44/da2/dcc/fe1 x:0 0 0 2024-09-20T20:31:42.660 INFO:tasks.workunit.client.0.smithi070.stdout:0/642: mknod d4/d8/d55/d7c/ccc 0 2024-09-20T20:31:42.663 INFO:tasks.workunit.client.0.smithi070.stdout:1/631: write d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f31 [292567,59961] 0 2024-09-20T20:31:42.663 INFO:tasks.workunit.client.0.smithi070.stdout:2/590: dwrite d3/d5/d9/d10/f52 [0,4194304] 0 2024-09-20T20:31:42.663 INFO:tasks.workunit.client.0.smithi070.stdout:2/591: chown d3/d4c/c95 1087 1 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:5/577: mknod d2/d4/d98/d5b/d90/da0/cc1 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:0/643: mkdir d4/d48/d67/dcd 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:6/653: rename d4/d8/d10/d54/d7a/fbc to d4/d8/d38/d50/fe8 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:1/632: rmdir d4/d32/dea/d3a/d9d 39 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:1/633: fsync d4/d6/fd6 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:2/592: mknod d3/d4c/d5c/d86/cd4 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:5/578: symlink d2/df/d40/da8/lc2 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:3/542: dwrite d7/d15/d1e/d65/f9a [0,4194304] 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:6/654: write d4/d8/d1e/d7e/fd3 [469099,9329] 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:3/543: write d7/d15/f4f [912254,113456] 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:8/649: dread d4/d27/d2a/d3e/f67 [0,4194304] 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:2/593: mkdir d3/d4c/d5c/d86/dd5 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:9/619: dwrite d1/f61 [4194304,4194304] 0 2024-09-20T20:31:42.664 INFO:tasks.workunit.client.0.smithi070.stdout:1/634: chown d4/d6/d11/d63/d6c/f98 587 1 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:3/544: symlink d7/d15/d1a/d48/d57/d75/laa 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:2/594: write d3/de/d12/d1a/fc6 [550065,106039] 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:9/620: write d1/df/f19 [2810312,63798] 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:1/635: readlink d4/d32/dea/d3a/d9d/db7/l79 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:3/545: readlink d7/d71/l84 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:7/492: dread d2/f26 [0,4194304] 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:3/546: readlink d7/d15/d1e/l76 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:1/636: symlink d4/d32/dea/d3a/d78/lee 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:2/595: chown d3/d5/d9/d42/c6e 3 1 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:9/621: mknod d1/df/d25/d69/d85/d9f/ce2 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:5/579: dwrite d2/d4/f39 [0,4194304] 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:6/655: dread d4/d8/f90 [0,4194304] 0 2024-09-20T20:31:42.665 INFO:tasks.workunit.client.0.smithi070.stdout:7/493: creat d2/d19/d25/d42/d77/f9b x:0 0 0 2024-09-20T20:31:42.666 INFO:tasks.workunit.client.0.smithi070.stdout:1/637: creat d4/d6/d11/d63/da3/fef x:0 0 0 2024-09-20T20:31:42.666 INFO:tasks.workunit.client.0.smithi070.stdout:5/580: fsync d2/d4/d53/f95 0 2024-09-20T20:31:42.666 INFO:tasks.workunit.client.0.smithi070.stdout:7/494: chown d2/f68 41683 1 2024-09-20T20:31:42.666 INFO:tasks.workunit.client.0.smithi070.stdout:2/596: creat d3/d5/dd/fd6 x:0 0 0 2024-09-20T20:31:42.666 INFO:tasks.workunit.client.0.smithi070.stdout:6/656: creat d4/d8/d3a/fe9 x:0 0 0 2024-09-20T20:31:42.667 INFO:tasks.workunit.client.0.smithi070.stdout:1/638: dread - d4/d32/dea/d3a/fec zero size 2024-09-20T20:31:42.667 INFO:tasks.workunit.client.0.smithi070.stdout:8/650: dwrite d4/d27/d2a/d5b/d98/fa8 [0,4194304] 0 2024-09-20T20:31:42.667 INFO:tasks.workunit.client.0.smithi070.stdout:9/622: mkdir d1/df/d25/d69/d85/d9f/db9/de3 0 2024-09-20T20:31:42.667 INFO:tasks.workunit.client.0.smithi070.stdout:6/657: symlink d4/d8/d17/d33/d36/lea 0 2024-09-20T20:31:42.667 INFO:tasks.workunit.client.0.smithi070.stdout:2/597: creat d3/d4c/d5c/fd7 x:0 0 0 2024-09-20T20:31:42.667 INFO:tasks.workunit.client.0.smithi070.stdout:9/623: chown d1/df/d38/fc1 12 1 2024-09-20T20:31:42.668 INFO:tasks.workunit.client.0.smithi070.stdout:8/651: link d4/d27/d2a/d5b/d6c/l94 d4/d27/d2a/d43/d61/le1 0 2024-09-20T20:31:42.669 INFO:tasks.workunit.client.0.smithi070.stdout:6/658: chown d4/d8/d10/d54/d7a/ca5 744 1 2024-09-20T20:31:42.669 INFO:tasks.workunit.client.0.smithi070.stdout:2/598: symlink d3/d5/d9/d1c/d1f/d3e/d61/db2/ld8 0 2024-09-20T20:31:42.669 INFO:tasks.workunit.client.0.smithi070.stdout:6/659: mkdir d4/d8/d17/db2/deb 0 2024-09-20T20:31:42.669 INFO:tasks.workunit.client.0.smithi070.stdout:9/624: chown d1/df/d25/f96 766916740 1 2024-09-20T20:31:42.670 INFO:tasks.workunit.client.0.smithi070.stdout:3/547: dwrite d7/d15/fa6 [0,4194304] 0 2024-09-20T20:31:42.671 INFO:tasks.workunit.client.0.smithi070.stdout:3/548: creat d7/d15/d1a/d48/d66/d69/d13/d1d/fab x:0 0 0 2024-09-20T20:31:42.672 INFO:tasks.workunit.client.0.smithi070.stdout:2/599: truncate d3/de/d12/f8d 559935 0 2024-09-20T20:31:42.672 INFO:tasks.workunit.client.0.smithi070.stdout:2/600: truncate d3/d5/d9/d10/f6a 4488757 0 2024-09-20T20:31:42.673 INFO:tasks.workunit.client.0.smithi070.stdout:2/601: creat d3/d5/d9/d10/fd9 x:0 0 0 2024-09-20T20:31:42.675 INFO:tasks.workunit.client.0.smithi070.stdout:8/652: truncate d4/d27/d2a/d3e/f2e 373154 0 2024-09-20T20:31:42.676 INFO:tasks.workunit.client.0.smithi070.stdout:8/653: symlink d4/d27/d2a/d43/le2 0 2024-09-20T20:31:42.676 INFO:tasks.workunit.client.0.smithi070.stdout:8/654: chown d4/d27/d2a/d5b/d98/da9/db5 0 1 2024-09-20T20:31:42.677 INFO:tasks.workunit.client.0.smithi070.stdout:9/625: dwrite d1/df/d25/d69/f6a [0,4194304] 0 2024-09-20T20:31:42.677 INFO:tasks.workunit.client.0.smithi070.stdout:7/495: read d2/d8/f1d [4079385,40126] 0 2024-09-20T20:31:42.678 INFO:tasks.workunit.client.0.smithi070.stdout:1/639: read d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f5f [1298707,53940] 0 2024-09-20T20:31:42.679 INFO:tasks.workunit.client.0.smithi070.stdout:7/496: truncate d2/d30/d63/f81 551067 0 2024-09-20T20:31:42.679 INFO:tasks.workunit.client.0.smithi070.stdout:8/655: rmdir d4/d27/d2a/d3e 39 2024-09-20T20:31:42.679 INFO:tasks.workunit.client.0.smithi070.stdout:1/640: symlink d4/d6/d11/d63/lf0 0 2024-09-20T20:31:42.680 INFO:tasks.workunit.client.0.smithi070.stdout:8/656: symlink d4/d27/d2a/d5b/d98/da9/le3 0 2024-09-20T20:31:42.680 INFO:tasks.workunit.client.0.smithi070.stdout:7/497: mknod d2/d8/c9c 0 2024-09-20T20:31:42.681 INFO:tasks.workunit.client.0.smithi070.stdout:9/626: getdents d1/df/d18/d44/d77/dd0 0 2024-09-20T20:31:42.681 INFO:tasks.workunit.client.0.smithi070.stdout:1/641: dread - d4/d6/d11/d63/de7/d44/d4b/d87/dbb/fc9 zero size 2024-09-20T20:31:42.682 INFO:tasks.workunit.client.0.smithi070.stdout:9/627: rmdir d1/d76/daa 0 2024-09-20T20:31:42.683 INFO:tasks.workunit.client.0.smithi070.stdout:4/592: dread d6/f11 [0,4194304] 0 2024-09-20T20:31:42.683 INFO:tasks.workunit.client.0.smithi070.stdout:1/642: rmdir d4/d6/d11/d63/de7/d44/d4b/d87/da9/db4 39 2024-09-20T20:31:42.683 INFO:tasks.workunit.client.0.smithi070.stdout:9/628: mknod d1/df/d25/d69/daf/ce4 0 2024-09-20T20:31:42.684 INFO:tasks.workunit.client.0.smithi070.stdout:1/643: write f2 [5350610,44929] 0 2024-09-20T20:31:42.685 INFO:tasks.workunit.client.0.smithi070.stdout:9/629: mkdir d1/df/d25/d69/d85/d9f/db9/de3/de5 0 2024-09-20T20:31:42.687 INFO:tasks.workunit.client.0.smithi070.stdout:9/630: rename d1/f89 to d1/df/d25/d69/d85/d9f/db9/de3/de5/fe6 0 2024-09-20T20:31:42.687 INFO:tasks.workunit.client.0.smithi070.stdout:8/657: dwrite d4/d27/f36 [0,4194304] 0 2024-09-20T20:31:42.688 INFO:tasks.workunit.client.0.smithi070.stdout:8/658: dread - d4/d27/d73/d87/fb3 zero size 2024-09-20T20:31:42.689 INFO:tasks.workunit.client.0.smithi070.stdout:4/593: dread d6/d7/dc/d20/f55 [0,4194304] 0 2024-09-20T20:31:42.690 INFO:tasks.workunit.client.0.smithi070.stdout:4/594: write d6/d7/f16 [429552,119346] 0 2024-09-20T20:31:42.690 INFO:tasks.workunit.client.0.smithi070.stdout:0/644: dread d4/d8/d12/d23/d26/d1d/d37/d38/f57 [0,4194304] 0 2024-09-20T20:31:42.691 INFO:tasks.workunit.client.0.smithi070.stdout:4/595: stat d6/d26/d69/d71/f7e 0 2024-09-20T20:31:42.691 INFO:tasks.workunit.client.0.smithi070.stdout:0/645: fsync d4/d19/f45 0 2024-09-20T20:31:42.692 INFO:tasks.workunit.client.0.smithi070.stdout:4/596: creat d6/d26/d69/d71/fba x:0 0 0 2024-09-20T20:31:42.693 INFO:tasks.workunit.client.0.smithi070.stdout:7/498: write d2/f10 [5274633,14222] 0 2024-09-20T20:31:42.695 INFO:tasks.workunit.client.0.smithi070.stdout:3/549: dread d7/d15/d1a/d48/d66/d69/fc [0,4194304] 0 2024-09-20T20:31:42.696 INFO:tasks.workunit.client.0.smithi070.stdout:3/550: symlink d7/d15/d1a/lac 0 2024-09-20T20:31:42.697 INFO:tasks.workunit.client.0.smithi070.stdout:1/644: truncate d4/d6/d11/d63/d6c/fbe 3179656 0 2024-09-20T20:31:42.698 INFO:tasks.workunit.client.0.smithi070.stdout:1/645: rmdir d4/d6/d11/d63/de7/d44/d4b/d87 39 2024-09-20T20:31:42.699 INFO:tasks.workunit.client.0.smithi070.stdout:1/646: fsync d4/d6/d11/d63/de7/d44/d48/f58 0 2024-09-20T20:31:42.700 INFO:tasks.workunit.client.0.smithi070.stdout:7/499: dwrite d2/d19/d25/d2a/f44 [4194304,4194304] 0 2024-09-20T20:31:42.700 INFO:tasks.workunit.client.0.smithi070.stdout:3/551: dread d7/d15/d1a/d48/d66/d69/d13/d72/f73 [0,4194304] 0 2024-09-20T20:31:42.701 INFO:tasks.workunit.client.0.smithi070.stdout:7/500: fsync d2/d19/d25/d42/f79 0 2024-09-20T20:31:42.701 INFO:tasks.workunit.client.0.smithi070.stdout:3/552: chown d7/d15/d1a/d48/d66/d69/f11 12 1 2024-09-20T20:31:42.703 INFO:tasks.workunit.client.0.smithi070.stdout:7/501: creat d2/d19/d25/d42/f9d x:0 0 0 2024-09-20T20:31:42.704 INFO:tasks.workunit.client.0.smithi070.stdout:3/553: symlink d7/d15/d1a/d48/d57/d75/lad 0 2024-09-20T20:31:42.705 INFO:tasks.workunit.client.0.smithi070.stdout:7/502: getdents d2/d8 0 2024-09-20T20:31:42.705 INFO:tasks.workunit.client.0.smithi070.stdout:9/631: dread d1/f14 [0,4194304] 0 2024-09-20T20:31:42.706 INFO:tasks.workunit.client.0.smithi070.stdout:3/554: creat d7/d15/d1a/d4a/fae x:0 0 0 2024-09-20T20:31:42.706 INFO:tasks.workunit.client.0.smithi070.stdout:4/597: truncate d6/d5e/d75/d40/f56 3230799 0 2024-09-20T20:31:42.706 INFO:tasks.workunit.client.0.smithi070.stdout:7/503: symlink d2/d8/l9e 0 2024-09-20T20:31:42.706 INFO:tasks.workunit.client.0.smithi070.stdout:9/632: write d1/f1a [4521675,77190] 0 2024-09-20T20:31:42.706 INFO:tasks.workunit.client.0.smithi070.stdout:8/659: dwrite d4/f38 [0,4194304] 0 2024-09-20T20:31:42.707 INFO:tasks.workunit.client.0.smithi070.stdout:9/633: chown d1/df/d25/f58 303 1 2024-09-20T20:31:42.707 INFO:tasks.workunit.client.0.smithi070.stdout:7/504: write d2/d19/d25/d42/f91 [542187,117981] 0 2024-09-20T20:31:42.708 INFO:tasks.workunit.client.0.smithi070.stdout:9/634: rename d1/df/d18/d44/d90 to d1/df/d25/d69/daf/de7 0 2024-09-20T20:31:42.708 INFO:tasks.workunit.client.0.smithi070.stdout:4/598: creat d6/d5e/d51/d84/fbb x:0 0 0 2024-09-20T20:31:42.709 INFO:tasks.workunit.client.0.smithi070.stdout:9/635: write d1/df/d18/d44/fc6 [1473321,119944] 0 2024-09-20T20:31:42.710 INFO:tasks.workunit.client.0.smithi070.stdout:9/636: creat d1/df/d84/fe8 x:0 0 0 2024-09-20T20:31:42.711 INFO:tasks.workunit.client.0.smithi070.stdout:4/599: write d6/d26/d69/d71/f5b [4311196,64483] 0 2024-09-20T20:31:42.711 INFO:tasks.workunit.client.0.smithi070.stdout:4/600: rmdir d6/d5e/d6b/d74 39 2024-09-20T20:31:42.712 INFO:tasks.workunit.client.0.smithi070.stdout:9/637: rename d1/l37 to d1/df/le9 0 2024-09-20T20:31:42.712 INFO:tasks.workunit.client.0.smithi070.stdout:8/660: dwrite d4/db/d64/d7b/f8f [0,4194304] 0 2024-09-20T20:31:42.712 INFO:tasks.workunit.client.0.smithi070.stdout:1/647: truncate d4/d6/d11/d63/d6c/fbe 2632644 0 2024-09-20T20:31:42.713 INFO:tasks.workunit.client.0.smithi070.stdout:3/555: truncate d7/d15/d1e/f49 950557 0 2024-09-20T20:31:42.713 INFO:tasks.workunit.client.0.smithi070.stdout:8/661: fsync d4/d27/d2a/fb7 0 2024-09-20T20:31:42.713 INFO:tasks.workunit.client.0.smithi070.stdout:9/638: symlink d1/df/d25/d69/d85/d9f/db9/lea 0 2024-09-20T20:31:42.714 INFO:tasks.workunit.client.0.smithi070.stdout:9/639: readlink d1/l45 0 2024-09-20T20:31:42.714 INFO:tasks.workunit.client.0.smithi070.stdout:3/556: stat d7/d15/d1a/d48/d66/d69/d13 0 2024-09-20T20:31:42.714 INFO:tasks.workunit.client.0.smithi070.stdout:8/662: chown d4/db/d64/f93 101 1 2024-09-20T20:31:42.715 INFO:tasks.workunit.client.0.smithi070.stdout:1/648: chown d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f31 1545658 1 2024-09-20T20:31:42.715 INFO:tasks.workunit.client.0.smithi070.stdout:7/505: read d2/d8/f64 [674818,55923] 0 2024-09-20T20:31:42.715 INFO:tasks.workunit.client.0.smithi070.stdout:8/663: write f0 [9170726,92652] 0 2024-09-20T20:31:42.716 INFO:tasks.workunit.client.0.smithi070.stdout:3/557: stat d7/d15/d1a/d48/d66/d69/d13/d1d/f47 0 2024-09-20T20:31:42.716 INFO:tasks.workunit.client.0.smithi070.stdout:9/640: truncate d1/df/d18/d46/fbe 691359 0 2024-09-20T20:31:42.716 INFO:tasks.workunit.client.0.smithi070.stdout:7/506: fdatasync d2/d30/d63/f81 0 2024-09-20T20:31:42.717 INFO:tasks.workunit.client.0.smithi070.stdout:8/664: fdatasync d4/db/f16 0 2024-09-20T20:31:42.717 INFO:tasks.workunit.client.0.smithi070.stdout:9/641: rmdir d1/df/d18/d46 39 2024-09-20T20:31:42.718 INFO:tasks.workunit.client.0.smithi070.stdout:3/558: rename d7/d15/d1e/l76 to d7/d15/d1a/d48/d57/laf 0 2024-09-20T20:31:42.719 INFO:tasks.workunit.client.0.smithi070.stdout:8/665: unlink d4/d27/d2a/d5b/d98/fb4 0 2024-09-20T20:31:42.719 INFO:tasks.workunit.client.0.smithi070.stdout:9/642: mkdir d1/df/d18/deb 0 2024-09-20T20:31:42.719 INFO:tasks.workunit.client.0.smithi070.stdout:4/601: dwrite d6/d7/dc/d4a/fb1 [0,4194304] 0 2024-09-20T20:31:42.720 INFO:tasks.workunit.client.0.smithi070.stdout:8/666: write d4/d27/d42/f54 [2913648,74527] 0 2024-09-20T20:31:42.720 INFO:tasks.workunit.client.0.smithi070.stdout:4/602: chown d6/d26/d69/d71 63783657 1 2024-09-20T20:31:42.720 INFO:tasks.workunit.client.0.smithi070.stdout:4/603: rmdir d6/d26 39 2024-09-20T20:31:42.721 INFO:tasks.workunit.client.0.smithi070.stdout:4/604: fdatasync d6/d7/f3e 0 2024-09-20T20:31:42.721 INFO:tasks.workunit.client.0.smithi070.stdout:8/667: dread d4/db/d66/f74 [0,4194304] 0 2024-09-20T20:31:42.723 INFO:tasks.workunit.client.0.smithi070.stdout:1/649: write d4/d32/dea/d3b/f3e [1509888,65114] 0 2024-09-20T20:31:42.723 INFO:tasks.workunit.client.0.smithi070.stdout:8/668: chown d4/d27/d2a/d5b/d6c/cbd 37 1 2024-09-20T20:31:42.723 INFO:tasks.workunit.client.0.smithi070.stdout:6/660: sync 2024-09-20T20:31:42.723 INFO:tasks.workunit.client.0.smithi070.stdout:5/581: sync 2024-09-20T20:31:42.723 INFO:tasks.workunit.client.0.smithi070.stdout:2/602: sync 2024-09-20T20:31:42.724 INFO:tasks.workunit.client.0.smithi070.stdout:1/650: readlink d4/l16 0 2024-09-20T20:31:42.724 INFO:tasks.workunit.client.0.smithi070.stdout:7/507: dwrite d2/d8/f3b [0,4194304] 0 2024-09-20T20:31:42.724 INFO:tasks.workunit.client.0.smithi070.stdout:8/669: chown d4/d27/d2a/d7e/fd5 471302 1 2024-09-20T20:31:42.724 INFO:tasks.workunit.client.0.smithi070.stdout:2/603: stat d3/d5/dd/d99 0 2024-09-20T20:31:42.724 INFO:tasks.workunit.client.0.smithi070.stdout:7/508: chown d2/f26 4041678 1 2024-09-20T20:31:42.725 INFO:tasks.workunit.client.0.smithi070.stdout:4/605: truncate d6/d7/dc/fe 5264104 0 2024-09-20T20:31:42.726 INFO:tasks.workunit.client.0.smithi070.stdout:1/651: mknod d4/d6/cf1 0 2024-09-20T20:31:42.727 INFO:tasks.workunit.client.0.smithi070.stdout:7/509: symlink d2/d19/d7c/l9f 0 2024-09-20T20:31:42.728 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:42.725+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:42.728 INFO:tasks.workunit.client.0.smithi070.stdout:7/510: write d2/d19/d25/d42/d77/f9b [847516,36546] 0 2024-09-20T20:31:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:7/511: write d2/d8/f64 [1277498,107744] 0 2024-09-20T20:31:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:8/670: dread d4/d27/d2a/d3e/d31/d63/fc2 [0,4194304] 0 2024-09-20T20:31:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:8/671: creat d4/d27/d2a/d3e/d39/fe4 x:0 0 0 2024-09-20T20:31:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:8/672: write d4/d27/d2a/d75/f77 [1235195,129790] 0 2024-09-20T20:31:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:6/661: dwrite d4/d8/d10/f44 [0,4194304] 0 2024-09-20T20:31:42.735 INFO:tasks.workunit.client.0.smithi070.stdout:8/673: truncate d4/d27/d2a/d7e/fd5 1053418 0 2024-09-20T20:31:42.736 INFO:tasks.workunit.client.0.smithi070.stdout:8/674: readlink d4/d27/d2a/d7e/ld2 0 2024-09-20T20:31:42.737 INFO:tasks.workunit.client.0.smithi070.stdout:6/662: rename d4/d8/d10/db3 to d4/d8/d10/d54/dec 0 2024-09-20T20:31:42.738 INFO:tasks.workunit.client.0.smithi070.stdout:5/582: dread d2/d4/d98/d4c/f71 [0,4194304] 0 2024-09-20T20:31:42.738 INFO:tasks.workunit.client.0.smithi070.stdout:5/583: chown d2/c78 12604599 1 2024-09-20T20:31:42.739 INFO:tasks.workunit.client.0.smithi070.stdout:5/584: truncate d2/df/d40/f5d 228123 0 2024-09-20T20:31:42.740 INFO:tasks.workunit.client.0.smithi070.stdout:5/585: mkdir d2/d7/d60/dc3 0 2024-09-20T20:31:42.742 INFO:tasks.workunit.client.0.smithi070.stdout:5/586: rename d2/c78 to d2/d7/cc4 0 2024-09-20T20:31:42.743 INFO:tasks.workunit.client.0.smithi070.stdout:1/652: dread d4/f62 [0,4194304] 0 2024-09-20T20:31:42.745 INFO:tasks.workunit.client.0.smithi070.stdout:8/675: dwrite d4/d27/d2a/d43/d61/f62 [4194304,4194304] 0 2024-09-20T20:31:42.745 INFO:tasks.workunit.client.0.smithi070.stdout:4/606: dwrite d6/d7/dc/fe [0,4194304] 0 2024-09-20T20:31:42.745 INFO:tasks.workunit.client.0.smithi070.stdout:1/653: readlink d4/l8a 0 2024-09-20T20:31:42.746 INFO:tasks.workunit.client.0.smithi070.stdout:5/587: mknod d2/df/d40/da8/cc5 0 2024-09-20T20:31:42.747 INFO:tasks.workunit.client.0.smithi070.stdout:3/559: dread d7/fd [0,4194304] 0 2024-09-20T20:31:42.747 INFO:tasks.workunit.client.0.smithi070.stdout:6/663: dwrite d4/d8/d17/d33/f52 [0,4194304] 0 2024-09-20T20:31:42.748 INFO:tasks.workunit.client.0.smithi070.stdout:8/676: mknod d4/db/d64/d95/ce5 0 2024-09-20T20:31:42.748 INFO:tasks.workunit.client.0.smithi070.stdout:5/588: read - d2/df/d9d/fb0 zero size 2024-09-20T20:31:42.749 INFO:tasks.workunit.client.0.smithi070.stdout:4/607: mkdir d6/d5e/d51/d78/dbc 0 2024-09-20T20:31:42.749 INFO:tasks.workunit.client.0.smithi070.stdout:9/643: dread d1/df/d38/f97 [0,4194304] 0 2024-09-20T20:31:42.749 INFO:tasks.workunit.client.0.smithi070.stdout:1/654: fdatasync d4/d32/dea/d3a/d78/db0/fe1 0 2024-09-20T20:31:42.750 INFO:tasks.workunit.client.0.smithi070.stdout:6/664: creat d4/d8/db4/dbd/fed x:0 0 0 2024-09-20T20:31:42.750 INFO:tasks.workunit.client.0.smithi070.stdout:8/677: mknod d4/d27/d2a/d43/d61/ce6 0 2024-09-20T20:31:42.751 INFO:tasks.workunit.client.0.smithi070.stdout:7/512: dwrite d2/d8/f6 [0,4194304] 0 2024-09-20T20:31:42.751 INFO:tasks.workunit.client.0.smithi070.stdout:4/608: dread - d6/d7/dc/d20/f99 zero size 2024-09-20T20:31:42.752 INFO:tasks.workunit.client.0.smithi070.stdout:3/560: creat d7/d15/d1a/d48/d66/d69/d13/d72/fb0 x:0 0 0 2024-09-20T20:31:42.752 INFO:tasks.workunit.client.0.smithi070.stdout:5/589: chown d2/df/d40/l70 56001084 1 2024-09-20T20:31:42.752 INFO:tasks.workunit.client.0.smithi070.stdout:1/655: creat d4/d1f/ff2 x:0 0 0 2024-09-20T20:31:42.752 INFO:tasks.workunit.client.0.smithi070.stdout:6/665: chown d4/d8/d3a/f58 29 1 2024-09-20T20:31:42.752 INFO:tasks.workunit.client.0.smithi070.stdout:4/609: fsync d6/d43/f5c 0 2024-09-20T20:31:42.753 INFO:tasks.workunit.client.0.smithi070.stdout:1/656: unlink d4/d32/d60/l88 0 2024-09-20T20:31:42.754 INFO:tasks.workunit.client.0.smithi070.stdout:2/604: dread d3/d5/dd/d5a/f66 [0,4194304] 0 2024-09-20T20:31:42.755 INFO:tasks.workunit.client.0.smithi070.stdout:4/610: truncate d6/d7/dc/fe 6235078 0 2024-09-20T20:31:42.755 INFO:tasks.workunit.client.0.smithi070.stdout:6/666: write d4/d8/db4/db6/fe5 [3553852,101939] 0 2024-09-20T20:31:42.755 INFO:tasks.workunit.client.0.smithi070.stdout:5/590: creat d2/d4/d98/d4c/dad/dba/fc6 x:0 0 0 2024-09-20T20:31:42.755 INFO:tasks.workunit.client.0.smithi070.stdout:4/611: chown d6/d7/dc 41682978 1 2024-09-20T20:31:42.757 INFO:tasks.workunit.client.0.smithi070.stdout:4/612: creat d6/d26/d69/fbd x:0 0 0 2024-09-20T20:31:42.757 INFO:tasks.workunit.client.0.smithi070.stdout:6/667: creat d4/d8/d10/d54/d55/d72/fee x:0 0 0 2024-09-20T20:31:42.758 INFO:tasks.workunit.client.0.smithi070.stdout:2/605: mkdir d3/d5/d9/d1c/dda 0 2024-09-20T20:31:42.758 INFO:tasks.workunit.client.0.smithi070.stdout:5/591: fdatasync d2/d4/de/d47/d67/d92/fa3 0 2024-09-20T20:31:42.759 INFO:tasks.workunit.client.0.smithi070.stdout:4/613: chown d6/d5e/d51/d84 1 1 2024-09-20T20:31:42.763 INFO:tasks.workunit.client.0.smithi070.stdout:9/644: dwrite d1/df/d18/d46/f73 [4194304,4194304] 0 2024-09-20T20:31:42.764 INFO:tasks.workunit.client.0.smithi070.stdout:0/646: sync 2024-09-20T20:31:42.765 INFO:tasks.workunit.client.0.smithi070.stdout:8/678: dwrite d4/db/fc9 [0,4194304] 0 2024-09-20T20:31:42.766 INFO:tasks.workunit.client.0.smithi070.stdout:7/513: dwrite d2/d8/f47 [0,4194304] 0 2024-09-20T20:31:42.766 INFO:tasks.workunit.client.0.smithi070.stdout:5/592: rename d2/df/d9d to d2/d4/d98/dc7 0 2024-09-20T20:31:42.766 INFO:tasks.workunit.client.0.smithi070.stdout:6/668: getdents d4/d8/d1e/d7e/dd6 0 2024-09-20T20:31:42.767 INFO:tasks.workunit.client.0.smithi070.stdout:1/657: dwrite d4/d6/d11/d63/de7/d44/f55 [0,4194304] 0 2024-09-20T20:31:42.767 INFO:tasks.workunit.client.0.smithi070.stdout:4/614: creat d6/d26/fbe x:0 0 0 2024-09-20T20:31:42.770 INFO:tasks.workunit.client.0.smithi070.stdout:7/514: fsync d2/d30/d63/f81 0 2024-09-20T20:31:42.770 INFO:tasks.workunit.client.0.smithi070.stdout:6/669: fdatasync d4/d8/db4/db6/fca 0 2024-09-20T20:31:42.770 INFO:tasks.workunit.client.0.smithi070.stdout:5/593: truncate d2/d4/de/f29 5154942 0 2024-09-20T20:31:42.770 INFO:tasks.workunit.client.0.smithi070.stdout:8/679: mkdir d4/d27/d2a/d43/de7 0 2024-09-20T20:31:42.770 INFO:tasks.workunit.client.0.smithi070.stdout:7/515: write d2/d8/f22 [865817,23224] 0 2024-09-20T20:31:42.770 INFO:tasks.workunit.client.0.smithi070.stdout:5/594: write d2/d4/d98/d4c/f44 [879338,110571] 0 2024-09-20T20:31:42.771 INFO:tasks.workunit.client.0.smithi070.stdout:1/658: symlink d4/d32/d60/dca/dd2/lf3 0 2024-09-20T20:31:42.772 INFO:tasks.workunit.client.0.smithi070.stdout:4/615: rename d6/d7/dc/d20/lb6 to d6/d5e/lbf 0 2024-09-20T20:31:42.773 INFO:tasks.workunit.client.0.smithi070.stdout:8/680: write d4/d27/d2a/d5b/d98/da9/fd0 [717689,52305] 0 2024-09-20T20:31:42.773 INFO:tasks.workunit.client.0.smithi070.stdout:3/561: dread d7/d15/d1a/d48/d57/f59 [4194304,4194304] 0 2024-09-20T20:31:42.774 INFO:tasks.workunit.client.0.smithi070.stdout:1/659: unlink d4/c27 0 2024-09-20T20:31:42.774 INFO:tasks.workunit.client.0.smithi070.stdout:7/516: getdents d2/d19/d25/d61 0 2024-09-20T20:31:42.774 INFO:tasks.workunit.client.0.smithi070.stdout:4/616: fdatasync d6/d43/f60 0 2024-09-20T20:31:42.775 INFO:tasks.workunit.client.0.smithi070.stdout:2/606: dwrite d3/d5/d9/d10/f6a [0,4194304] 0 2024-09-20T20:31:42.776 INFO:tasks.workunit.client.0.smithi070.stdout:9/645: dwrite d1/df/d18/d44/fc6 [0,4194304] 0 2024-09-20T20:31:42.776 INFO:tasks.workunit.client.0.smithi070.stdout:6/670: rename d4/d8/d1e/l29 to d4/lef 0 2024-09-20T20:31:42.776 INFO:tasks.workunit.client.0.smithi070.stdout:3/562: stat d7/d15/d1a/d4a/d51/d5b/d88 0 2024-09-20T20:31:42.776 INFO:tasks.workunit.client.0.smithi070.stdout:5/595: chown d2/d4/d98/dc7/lbf 263851462 1 2024-09-20T20:31:42.777 INFO:tasks.workunit.client.0.smithi070.stdout:5/596: read - d2/d4/de/fb2 zero size 2024-09-20T20:31:42.778 INFO:tasks.workunit.client.0.smithi070.stdout:2/607: mkdir d3/d5/dd/d99/ddb 0 2024-09-20T20:31:42.778 INFO:tasks.workunit.client.0.smithi070.stdout:0/647: dwrite d4/d1b/f98 [0,4194304] 0 2024-09-20T20:31:42.778 INFO:tasks.workunit.client.0.smithi070.stdout:3/563: mknod d7/d15/d1e/d60/cb1 0 2024-09-20T20:31:42.778 INFO:tasks.workunit.client.0.smithi070.stdout:8/681: link d4/d27/d2a/d5b/d6c/da6/fb9 d4/d27/d2a/d43/d61/fe8 0 2024-09-20T20:31:42.779 INFO:tasks.workunit.client.0.smithi070.stdout:9/646: write d1/df/fd8 [644646,35882] 0 2024-09-20T20:31:42.780 INFO:tasks.workunit.client.0.smithi070.stdout:5/597: fdatasync d2/d4/f39 0 2024-09-20T20:31:42.781 INFO:tasks.workunit.client.0.smithi070.stdout:8/682: mknod d4/d27/d2a/d3e/d31/d63/ce9 0 2024-09-20T20:31:42.781 INFO:tasks.workunit.client.0.smithi070.stdout:6/671: rename d4/d8/d10/d54/d64 to d4/df0 0 2024-09-20T20:31:42.782 INFO:tasks.workunit.client.0.smithi070.stdout:7/517: getdents d2/d19/d25/d2a/d4a 0 2024-09-20T20:31:42.782 INFO:tasks.workunit.client.0.smithi070.stdout:5/598: write d2/d7/d88/f83 [2574297,126663] 0 2024-09-20T20:31:42.783 INFO:tasks.workunit.client.0.smithi070.stdout:9/647: truncate d1/df/d25/d9e/fcf 4802854 0 2024-09-20T20:31:42.785 INFO:tasks.workunit.client.0.smithi070.stdout:8/683: read d4/d27/d2a/d3e/f67 [1788692,13205] 0 2024-09-20T20:31:42.789 INFO:tasks.workunit.client.0.smithi070.stdout:0/648: dwrite d4/d19/f52 [0,4194304] 0 2024-09-20T20:31:42.790 INFO:tasks.workunit.client.0.smithi070.stdout:5/599: rename d2/d4/d98/d5b/l2c to d2/d4/d98/d4c/dad/lc8 0 2024-09-20T20:31:42.790 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:42.790 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:42.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.790 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:13492 4.2f 4:f54177e9:::10000003657.00000000:head [write 3801088~393216 in=393216b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:42.790 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:42.776631+0000", 2024-09-20T20:31:42.790 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.012178906, 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012218387000000001, 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 13492 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:42.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.776631+0000", 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.776631+0000", 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.776633+0000", 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0229999999999999e-06 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.777039+0000", 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00040539999999999999 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.777208+0000", 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000169894 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.777221+0000", 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2373e-05 2024-09-20T20:31:42.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.781114+0000", 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038934730000000002 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.781269+0000", 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015468099999999999 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:42.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.781471+0000", 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020219699999999999 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.782797+0000", 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001325386 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:13500 4.33 4:cf53490a:::100000032c2.00000000:head [write 0~3670016 in=3670016b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:42.778369+0000", 2024-09-20T20:31:42.795 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.010441512, 2024-09-20T20:31:42.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010560590999999999, 2024-09-20T20:31:42.796 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:42.796 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:42.796 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:42.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:42.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:42.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:42.797 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 13500 2024-09-20T20:31:42.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.778369+0000", 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.778369+0000", 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.778369+0000", 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6599999999999996e-07 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785401+0000", 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070315600000000001 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785416+0000", 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4791e-05 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785444+0000", 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8138000000000001e-05 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785516+0000", 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2137000000000004e-05 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785601+0000", 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5679000000000004e-05 2024-09-20T20:31:42.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785718+0000", 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011669500000000001 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:13501 4.33 4.5092caf3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:42.785466+0000", 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0033440710000000001, 2024-09-20T20:31:42.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035030410000000001, 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 13501 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785466+0000", 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:42.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785466+0000", 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.785467+0000", 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2979999999999999e-06 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.786263+0000", 2024-09-20T20:31:42.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00079563599999999996 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.786281+0000", 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8196e-05 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.786290+0000", 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2459999999999992e-06 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4469.0:13489 4.2f 4:f54177e9:::10000003657.00000000:head [write 0~3801088 in=3801088b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:42.767621+0000", 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.021188657999999999, 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.021378906, 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4469", 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 13489 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.805 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.767621+0000", 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.767621+0000", 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:42.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.767623+0000", 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.209e-06 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.776576+0000", 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0089536719999999993 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.776591+0000", 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5012e-05 2024-09-20T20:31:42.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.776602+0000", 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0638e-05 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.776701+0000", 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9359999999999997e-05 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.776895+0000", 2024-09-20T20:31:42.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019369600000000001 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.777068+0000", 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017320599999999999 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:42.782412+0000", 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053433320000000001 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:42.810 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-09-20T20:31:42.810 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 4 2024-09-20T20:31:42.810 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:1/660: dwrite d4/d6/d11/d63/de7/d44/d4b/d87/fa2 [0,4194304] 0 2024-09-20T20:31:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:4/617: dread d6/d5e/d51/d78/f93 [0,4194304] 0 2024-09-20T20:31:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:2/608: dwrite d3/d5/f34 [0,4194304] 0 2024-09-20T20:31:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:4/618: write d6/d5e/fb0 [770827,106883] 0 2024-09-20T20:31:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:3/564: dwrite d7/f1b [0,4194304] 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:1/661: readlink d4/d32/dea/d3a/d78/lee 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:6/672: dwrite d4/d8/d3a/f75 [0,4194304] 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:8/684: rename d4/d27/d2a/d43/f45 to d4/d27/dde/fea 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:6/673: write d4/d8/d38/fcb [135546,113867] 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:0/649: unlink d4/d8/d12/f14 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:2/609: mknod d3/d5/d9/d1c/d4e/da4/cdc 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:1/662: truncate d4/d32/fcf 773924 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:9/648: truncate d1/df/d18/d46/f7f 554878 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:5/600: chown d2/d4/d98/c65 40496 1 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:3/565: creat d7/d15/d1e/d65/d9d/fb2 x:0 0 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:6/674: dread - d4/d8/d3a/fe9 zero size 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:0/650: mkdir d4/d48/d7b/d8c/dce 0 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:5/601: dread - d2/d7/d60/f91 zero size 2024-09-20T20:31:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:0/651: fsync d4/d8/d12/d23/f73 0 2024-09-20T20:31:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:2/610: rename d3/d5/d9/d1c/d1f/ca1 to d3/de/d12/cdd 0 2024-09-20T20:31:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:0/652: mkdir d4/d48/d67/dcf 0 2024-09-20T20:31:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:9/649: rename d1/df/d25/d69/fca to d1/df/d38/dac/fec 0 2024-09-20T20:31:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:9/650: rename d1/df/d18/l27 to d1/df/d25/db2/ddb/led 0 2024-09-20T20:31:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:5/602: dwrite d2/d4/d98/dc7/fb3 [0,4194304] 0 2024-09-20T20:31:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:5/603: chown d2/d4/l38 199423 1 2024-09-20T20:31:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:5/604: dwrite d2/d4/d53/d59/f61 [0,4194304] 0 2024-09-20T20:31:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:5/605: rename d2/d4/de/c52 to d2/d4/d98/d5b/cc9 0 2024-09-20T20:31:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:5/606: dwrite d2/df/f68 [0,4194304] 0 2024-09-20T20:31:42.819 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:42.822 INFO:tasks.workunit.client.0.smithi070.stdout:1/663: dwrite d4/d6/d11/f10 [4194304,4194304] 0 2024-09-20T20:31:42.823 INFO:tasks.workunit.client.0.smithi070.stdout:0/653: dwrite d4/d8/d12/d23/d26/f33 [0,4194304] 0 2024-09-20T20:31:42.824 INFO:tasks.workunit.client.0.smithi070.stdout:1/664: symlink d4/d6/d11/d63/de7/lf4 0 2024-09-20T20:31:42.824 INFO:tasks.workunit.client.0.smithi070.stdout:5/607: dwrite d2/d4/de/d47/d67/d92/f86 [0,4194304] 0 2024-09-20T20:31:42.825 INFO:tasks.workunit.client.0.smithi070.stdout:0/654: creat d4/d8/d12/d23/d26/d1d/d41/fd0 x:0 0 0 2024-09-20T20:31:42.826 INFO:tasks.workunit.client.0.smithi070.stdout:0/655: write d4/d8/d12/d23/d26/fc5 [765247,101992] 0 2024-09-20T20:31:42.828 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:42.824+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:42.831 INFO:tasks.workunit.client.0.smithi070.stdout:6/675: read d4/d8/d10/d54/fc7 [3356011,72747] 0 2024-09-20T20:31:42.834 INFO:tasks.workunit.client.0.smithi070.stdout:5/608: dwrite d2/d4/d98/fc0 [0,4194304] 0 2024-09-20T20:31:42.834 INFO:tasks.workunit.client.0.smithi070.stdout:6/676: dread - d4/d8/d17/d33/d61/d73/fae zero size 2024-09-20T20:31:42.834 INFO:tasks.workunit.client.0.smithi070.stdout:0/656: dwrite d4/d8/d12/d23/f73 [0,4194304] 0 2024-09-20T20:31:42.835 INFO:tasks.workunit.client.0.smithi070.stdout:4/619: dread d6/d26/d69/d71/f7e [0,4194304] 0 2024-09-20T20:31:42.835 INFO:tasks.workunit.client.0.smithi070.stdout:1/665: dwrite d4/d6/d11/f3f [0,4194304] 0 2024-09-20T20:31:42.836 INFO:tasks.workunit.client.0.smithi070.stdout:5/609: write d2/df/d40/f7c [27706,29402] 0 2024-09-20T20:31:42.836 INFO:tasks.workunit.client.0.smithi070.stdout:2/611: dread d3/d5/dd/f15 [0,4194304] 0 2024-09-20T20:31:42.839 INFO:tasks.workunit.client.0.smithi070.stdout:4/620: symlink d6/d5e/d51/d63/lc0 0 2024-09-20T20:31:42.839 INFO:tasks.workunit.client.0.smithi070.stdout:6/677: truncate d4/d8/d38/f4e 2205132 0 2024-09-20T20:31:42.840 INFO:tasks.workunit.client.0.smithi070.stdout:5/610: fdatasync d2/d4/d53/fb9 0 2024-09-20T20:31:42.841 INFO:tasks.workunit.client.0.smithi070.stdout:4/621: truncate d6/d43/f60 7635 0 2024-09-20T20:31:42.841 INFO:tasks.workunit.client.0.smithi070.stdout:6/678: write d4/d8/d1e/f5b [5103996,68131] 0 2024-09-20T20:31:42.841 INFO:tasks.workunit.client.0.smithi070.stdout:1/666: getdents d4/d1f 0 2024-09-20T20:31:42.842 INFO:tasks.workunit.client.0.smithi070.stdout:5/611: truncate d2/d4/de/d47/d67/f8e 184965 0 2024-09-20T20:31:42.842 INFO:tasks.workunit.client.0.smithi070.stdout:4/622: creat d6/d26/fc1 x:0 0 0 2024-09-20T20:31:42.843 INFO:tasks.workunit.client.0.smithi070.stdout:1/667: symlink d4/d32/dea/d3a/lf5 0 2024-09-20T20:31:42.844 INFO:tasks.workunit.client.0.smithi070.stdout:2/612: rename d3/d4c/d5c/db7/dc2/laa to d3/d5/d9/d1c/d47/d7e/lde 0 2024-09-20T20:31:42.844 INFO:tasks.workunit.client.0.smithi070.stdout:0/657: dwrite d4/d8/d12/d23/d26/d1d/d41/fd0 [0,4194304] 0 2024-09-20T20:31:42.844 INFO:tasks.workunit.client.0.smithi070.stdout:0/658: stat d4/d19/f29 0 2024-09-20T20:31:42.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:31:42.845 INFO:tasks.workunit.client.0.smithi070.stdout:2/613: chown d3/d5/d9/d1c/f8c 185373 1 2024-09-20T20:31:42.847 INFO:tasks.workunit.client.0.smithi070.stdout:0/659: rename d4/d8/d12/d23/d26/d1f/d4d to d4/d8/d12/d23/d26/d1d/d41/dd1 0 2024-09-20T20:31:42.850 INFO:tasks.workunit.client.0.smithi070.stdout:1/668: dwrite d4/d6/f52 [0,4194304] 0 2024-09-20T20:31:42.851 INFO:tasks.workunit.client.0.smithi070.stdout:5/612: read d2/d4/d98/d5b/f42 [57980,48512] 0 2024-09-20T20:31:42.852 INFO:tasks.workunit.client.0.smithi070.stdout:4/623: dwrite d6/d43/f60 [0,4194304] 0 2024-09-20T20:31:42.854 INFO:tasks.workunit.client.0.smithi070.stdout:4/624: mknod d6/d26/d69/d71/d4c/cc2 0 2024-09-20T20:31:42.854 INFO:tasks.workunit.client.0.smithi070.stdout:4/625: write d6/d5e/d75/d61/f9a [544556,88920] 0 2024-09-20T20:31:42.856 INFO:tasks.workunit.client.0.smithi070.stdout:7/518: sync 2024-09-20T20:31:42.857 INFO:tasks.workunit.client.0.smithi070.stdout:7/519: rename d2/d8/f6 to d2/d65/fa0 0 2024-09-20T20:31:42.862 INFO:tasks.workunit.client.0.smithi070.stdout:2/614: dread d3/de/f1b [0,4194304] 0 2024-09-20T20:31:42.862 INFO:tasks.workunit.client.0.smithi070.stdout:4/626: dwrite d6/d7/dc/f4b [0,4194304] 0 2024-09-20T20:31:42.864 INFO:tasks.workunit.client.0.smithi070.stdout:7/520: dwrite d2/d30/d63/d69/f70 [0,4194304] 0 2024-09-20T20:31:42.864 INFO:tasks.workunit.client.0.smithi070.stdout:5/613: truncate d2/d4/d98/f5a 1887392 0 2024-09-20T20:31:42.865 INFO:tasks.workunit.client.0.smithi070.stdout:7/521: chown d2/d19/d25/d2a/f6b 26 1 2024-09-20T20:31:42.865 INFO:tasks.workunit.client.0.smithi070.stdout:2/615: rmdir d3/d5/d9/d42 39 2024-09-20T20:31:42.865 INFO:tasks.workunit.client.0.smithi070.stdout:5/614: symlink d2/d7/lca 0 2024-09-20T20:31:42.867 INFO:tasks.workunit.client.0.smithi070.stdout:5/615: creat d2/df/d77/fcb x:0 0 0 2024-09-20T20:31:42.869 INFO:tasks.workunit.client.0.smithi070.stdout:5/616: creat d2/d7/d60/dbd/fcc x:0 0 0 2024-09-20T20:31:42.869 INFO:tasks.workunit.client.0.smithi070.stdout:7/522: creat d2/d19/d25/d42/d77/fa1 x:0 0 0 2024-09-20T20:31:42.869 INFO:tasks.workunit.client.0.smithi070.stdout:4/627: dwrite d6/d7/dc/d4a/fb1 [4194304,4194304] 0 2024-09-20T20:31:42.871 INFO:tasks.workunit.client.0.smithi070.stdout:5/617: mkdir d2/d7/d60/dbd/dcd 0 2024-09-20T20:31:42.871 INFO:tasks.workunit.client.0.smithi070.stdout:4/628: symlink d6/d7/dc/d4a/lc3 0 2024-09-20T20:31:42.872 INFO:tasks.workunit.client.0.smithi070.stdout:4/629: readlink d6/d7/dc/d4a/lb8 0 2024-09-20T20:31:42.872 INFO:tasks.workunit.client.0.smithi070.stdout:5/618: rmdir d2/d4/d98/dc7/da5 39 2024-09-20T20:31:42.874 INFO:tasks.workunit.client.0.smithi070.stdout:4/630: getdents d6/d7/dc/d4a/d81 0 2024-09-20T20:31:42.875 INFO:tasks.workunit.client.0.smithi070.stdout:5/619: rename d2/d7/d88/fa1 to d2/fce 0 2024-09-20T20:31:42.875 INFO:tasks.workunit.client.0.smithi070.stdout:2/616: dwrite d3/de/d12/d1a/f3f [0,4194304] 0 2024-09-20T20:31:42.875 INFO:tasks.workunit.client.0.smithi070.stdout:1/669: dread f2 [0,4194304] 0 2024-09-20T20:31:42.875 INFO:tasks.workunit.client.0.smithi070.stdout:4/631: fsync d6/d5e/d75/f2e 0 2024-09-20T20:31:42.877 INFO:tasks.workunit.client.0.smithi070.stdout:4/632: write d6/d7/f3e [1255088,17733] 0 2024-09-20T20:31:42.877 INFO:tasks.workunit.client.0.smithi070.stdout:7/523: dwrite d2/d19/d25/d2a/f44 [0,4194304] 0 2024-09-20T20:31:42.879 INFO:tasks.workunit.client.0.smithi070.stdout:1/670: rename d4/d6/d26/f8d to d4/d6/d11/d7b/d83/ff6 0 2024-09-20T20:31:42.879 INFO:tasks.workunit.client.0.smithi070.stdout:4/633: rmdir d6/d7/dc/d4a/d58 39 2024-09-20T20:31:42.879 INFO:tasks.workunit.client.0.smithi070.stdout:2/617: link d3/d5/d9/d1c/d1f/f5e d3/d5/d9/d1c/d1f/d3e/fdf 0 2024-09-20T20:31:42.880 INFO:tasks.workunit.client.0.smithi070.stdout:6/679: dread d4/d8/d3a/f41 [0,4194304] 0 2024-09-20T20:31:42.880 INFO:tasks.workunit.client.0.smithi070.stdout:1/671: write d4/d6/d11/d63/de7/f59 [291026,22417] 0 2024-09-20T20:31:42.881 INFO:tasks.workunit.client.0.smithi070.stdout:2/618: getdents d3/d4c/d5c 0 2024-09-20T20:31:42.882 INFO:tasks.workunit.client.0.smithi070.stdout:6/680: truncate d4/d8/d10/f15 4870921 0 2024-09-20T20:31:42.882 INFO:tasks.workunit.client.0.smithi070.stdout:4/634: getdents d6/d5e/d6b/d74 0 2024-09-20T20:31:42.883 INFO:tasks.workunit.client.0.smithi070.stdout:2/619: mknod d3/d5/ce0 0 2024-09-20T20:31:42.883 INFO:tasks.workunit.client.0.smithi070.stdout:2/620: chown d3/de/d12 0 1 2024-09-20T20:31:42.883 INFO:tasks.workunit.client.0.smithi070.stdout:4/635: creat d6/d5e/d51/fc4 x:0 0 0 2024-09-20T20:31:42.883 INFO:tasks.workunit.client.0.smithi070.stdout:6/681: fdatasync d4/d8/d10/d54/d55/d72/faf 0 2024-09-20T20:31:42.884 INFO:tasks.workunit.client.0.smithi070.stdout:4/636: fsync d6/d7/dc/d20/f24 0 2024-09-20T20:31:42.884 INFO:tasks.workunit.client.0.smithi070.stdout:2/621: write d3/d5/dd/d99/dae/fb0 [719230,99629] 0 2024-09-20T20:31:42.885 INFO:tasks.workunit.client.0.smithi070.stdout:4/637: write d6/d7/f3b [967906,44006] 0 2024-09-20T20:31:42.885 INFO:tasks.workunit.client.0.smithi070.stdout:6/682: creat d4/d8/d10/d3c/ff1 x:0 0 0 2024-09-20T20:31:42.886 INFO:tasks.workunit.client.0.smithi070.stdout:4/638: creat d6/d26/d97/fc5 x:0 0 0 2024-09-20T20:31:42.887 INFO:tasks.workunit.client.0.smithi070.stdout:4/639: mknod d6/d5e/d75/d61/cc6 0 2024-09-20T20:31:42.889 INFO:tasks.workunit.client.0.smithi070.stdout:6/683: creat d4/d8/d17/d33/d61/d73/ff2 x:0 0 0 2024-09-20T20:31:42.889 INFO:tasks.workunit.client.0.smithi070.stdout:4/640: creat d6/d5e/d51/d78/fc7 x:0 0 0 2024-09-20T20:31:42.890 INFO:tasks.workunit.client.0.smithi070.stdout:4/641: dread - d6/d7/dc/d4a/d81/fa8 zero size 2024-09-20T20:31:42.890 INFO:tasks.workunit.client.0.smithi070.stdout:6/684: rename d4/dce to d4/d8/db4/db6/df3 0 2024-09-20T20:31:42.891 INFO:tasks.workunit.client.0.smithi070.stdout:6/685: fdatasync d4/d8/d10/d3c/fb9 0 2024-09-20T20:31:42.891 INFO:tasks.workunit.client.0.smithi070.stdout:2/622: dwrite d3/d4c/d5c/db7/dc2/f98 [0,4194304] 0 2024-09-20T20:31:42.892 INFO:tasks.workunit.client.0.smithi070.stdout:2/623: chown d3/d5/d9/d1c/d47/d7e 107293795 1 2024-09-20T20:31:42.892 INFO:tasks.workunit.client.0.smithi070.stdout:6/686: write d4/d8/d1e/f5b [1187090,74862] 0 2024-09-20T20:31:42.896 INFO:tasks.workunit.client.0.smithi070.stdout:5/620: dread d2/d4/d98/d4c/f3a [0,4194304] 0 2024-09-20T20:31:42.897 INFO:tasks.workunit.client.0.smithi070.stdout:5/621: symlink d2/lcf 0 2024-09-20T20:31:42.899 INFO:tasks.workunit.client.0.smithi070.stdout:6/687: dwrite d4/d8/f69 [0,4194304] 0 2024-09-20T20:31:42.899 INFO:tasks.workunit.client.0.smithi070.stdout:5/622: creat d2/d4/d98/d5b/d90/fd0 x:0 0 0 2024-09-20T20:31:42.899 INFO:tasks.workunit.client.0.smithi070.stdout:2/624: dwrite d3/d5/d9/d10/f6a [0,4194304] 0 2024-09-20T20:31:42.900 INFO:tasks.workunit.client.0.smithi070.stdout:5/623: write d2/d4/d53/d59/f8f [344428,41782] 0 2024-09-20T20:31:42.903 INFO:tasks.workunit.client.0.smithi070.stdout:6/688: truncate d4/f6 3201530 0 2024-09-20T20:31:42.905 INFO:tasks.workunit.client.0.smithi070.stdout:5/624: rename d2/d4/de/f29 to d2/d4/de/d47/d67/d92/fd1 0 2024-09-20T20:31:42.905 INFO:tasks.workunit.client.0.smithi070.stdout:6/689: symlink d4/d8/d1e/lf4 0 2024-09-20T20:31:42.906 INFO:tasks.workunit.client.0.smithi070.stdout:5/625: creat d2/d7/d60/dbd/fd2 x:0 0 0 2024-09-20T20:31:42.906 INFO:tasks.workunit.client.0.smithi070.stdout:6/690: chown d4/d8/d10/fe7 1435633 1 2024-09-20T20:31:42.906 INFO:tasks.workunit.client.0.smithi070.stdout:6/691: dread - d4/d8/d10/d54/d55/d72/fee zero size 2024-09-20T20:31:42.907 INFO:tasks.workunit.client.0.smithi070.stdout:2/625: dwrite d3/d5/d9/d1c/d1f/d3e/d61/db2/fbc [0,4194304] 0 2024-09-20T20:31:42.910 INFO:tasks.workunit.client.0.smithi070.stdout:2/626: mknod d3/d4c/d5c/d86/dd5/ce1 0 2024-09-20T20:31:42.910 INFO:tasks.workunit.client.0.smithi070.stdout:2/627: chown d3/l74 419103 1 2024-09-20T20:31:42.910 INFO:tasks.workunit.client.0.smithi070.stdout:1/672: dread d4/d6/d11/d63/d6c/fbe [0,4194304] 0 2024-09-20T20:31:42.911 INFO:tasks.workunit.client.0.smithi070.stdout:5/626: dwrite d2/d4/de/fb2 [0,4194304] 0 2024-09-20T20:31:42.911 INFO:tasks.workunit.client.0.smithi070.stdout:2/628: creat d3/d5/d9/d1c/d4e/fe2 x:0 0 0 2024-09-20T20:31:42.913 INFO:tasks.workunit.client.0.smithi070.stdout:5/627: creat d2/d7/fd3 x:0 0 0 2024-09-20T20:31:42.913 INFO:tasks.workunit.client.0.smithi070.stdout:2/629: readlink d3/d5/d9/d1c/d47/d7e/ld3 0 2024-09-20T20:31:42.914 INFO:tasks.workunit.client.0.smithi070.stdout:5/628: link d2/d4/d98/d4c/f44 d2/d7/fd4 0 2024-09-20T20:31:42.915 INFO:tasks.workunit.client.0.smithi070.stdout:5/629: getdents d2 0 2024-09-20T20:31:42.917 INFO:tasks.workunit.client.0.smithi070.stdout:5/630: rename d2/d4/de/l20 to d2/df/d40/ld5 0 2024-09-20T20:31:42.917 INFO:tasks.workunit.client.0.smithi070.stdout:1/673: dwrite d4/d32/d60/f8e [0,4194304] 0 2024-09-20T20:31:42.919 INFO:tasks.workunit.client.0.smithi070.stdout:5/631: write d2/d4/de/d47/d67/d92/fa3 [9193,100436] 0 2024-09-20T20:31:42.919 INFO:tasks.workunit.client.0.smithi070.stdout:2/630: dwrite d3/de/d9f/fba [0,4194304] 0 2024-09-20T20:31:42.920 INFO:tasks.workunit.client.0.smithi070.stdout:1/674: creat d4/d32/d60/dca/ff7 x:0 0 0 2024-09-20T20:31:42.920 INFO:tasks.workunit.client.0.smithi070.stdout:1/675: stat d4/d6/ddb 0 2024-09-20T20:31:42.921 INFO:tasks.workunit.client.0.smithi070.stdout:5/632: creat d2/d4/d98/fd6 x:0 0 0 2024-09-20T20:31:42.922 INFO:tasks.workunit.client.0.smithi070.stdout:2/631: rmdir d3/d5/d9/d1c/d1f 39 2024-09-20T20:31:42.922 INFO:tasks.workunit.client.0.smithi070.stdout:2/632: read - d3/d5/d9/f88 zero size 2024-09-20T20:31:42.923 INFO:tasks.workunit.client.0.smithi070.stdout:5/633: link d2/d7/d60/l9b d2/d7/d60/dbd/dcd/ld7 0 2024-09-20T20:31:42.924 INFO:tasks.workunit.client.0.smithi070.stdout:5/634: creat d2/d4/d98/dc7/da5/fd8 x:0 0 0 2024-09-20T20:31:42.925 INFO:tasks.workunit.client.0.smithi070.stdout:5/635: symlink d2/d4/de/ld9 0 2024-09-20T20:31:42.925 INFO:tasks.workunit.client.0.smithi070.stdout:5/636: chown d2/d4/d53/c97 0 1 2024-09-20T20:31:42.926 INFO:tasks.workunit.client.0.smithi070.stdout:5/637: chown d2/d7/d60/f6f 50648394 1 2024-09-20T20:31:42.926 INFO:tasks.workunit.client.0.smithi070.stdout:2/633: read d3/d4c/d5c/fc5 [516281,8181] 0 2024-09-20T20:31:42.929 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:42.924+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:42.931 INFO:tasks.workunit.client.0.smithi070.stdout:5/638: dwrite d2/d4/de/d47/d67/f9a [0,4194304] 0 2024-09-20T20:31:42.942 INFO:tasks.workunit.client.0.smithi070.stdout:6/692: dread d4/d8/f2f [0,4194304] 0 2024-09-20T20:31:42.943 INFO:tasks.workunit.client.0.smithi070.stdout:8/685: sync 2024-09-20T20:31:42.944 INFO:tasks.workunit.client.0.smithi070.stdout:8/686: mknod d4/db/d64/d7b/ceb 0 2024-09-20T20:31:42.945 INFO:tasks.workunit.client.0.smithi070.stdout:8/687: dread - d4/d27/d2a/d3e/f6d zero size 2024-09-20T20:31:42.945 INFO:tasks.workunit.client.0.smithi070.stdout:1/676: dread d4/d6/d11/d63/da3/faa [0,4194304] 0 2024-09-20T20:31:42.946 INFO:tasks.workunit.client.0.smithi070.stdout:1/677: unlink d4/d6/dae/cb6 0 2024-09-20T20:31:42.948 INFO:tasks.workunit.client.0.smithi070.stdout:6/693: dwrite d4/d8/ff [0,4194304] 0 2024-09-20T20:31:42.950 INFO:tasks.workunit.client.0.smithi070.stdout:5/639: dread d2/d7/fc [0,4194304] 0 2024-09-20T20:31:42.951 INFO:tasks.workunit.client.0.smithi070.stdout:6/694: link d4/d8/ff d4/d8/d10/ff5 0 2024-09-20T20:31:42.952 INFO:tasks.workunit.client.0.smithi070.stdout:6/695: link d4/d8/d10/d3c/l3e d4/d8/d38/d50/lf6 0 2024-09-20T20:31:42.953 INFO:tasks.workunit.client.0.smithi070.stdout:6/696: chown d4/d8/d1e/d7e/fac 821 1 2024-09-20T20:31:42.957 INFO:tasks.workunit.client.0.smithi070.stdout:5/640: dwrite d2/d7/d88/f83 [0,4194304] 0 2024-09-20T20:31:42.959 INFO:tasks.workunit.client.0.smithi070.stdout:6/697: dwrite d4/d8/d10/d54/f6b [0,4194304] 0 2024-09-20T20:31:42.960 INFO:tasks.workunit.client.0.smithi070.stdout:6/698: symlink d4/d8/d3a/lf7 0 2024-09-20T20:31:42.965 INFO:tasks.workunit.client.0.smithi070.stdout:6/699: truncate d4/d8/d17/d33/d36/f37 2386818 0 2024-09-20T20:31:42.965 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:42.965 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:42.966 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:42.966 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:42.966 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:42.968 INFO:tasks.workunit.client.0.smithi070.stdout:5/641: truncate d2/d4/d98/d5b/f5e 5149663 0 2024-09-20T20:31:42.971 INFO:tasks.workunit.client.0.smithi070.stdout:6/700: dwrite d4/d8/d10/d54/d55/d72/faf [0,4194304] 0 2024-09-20T20:31:42.972 INFO:tasks.workunit.client.0.smithi070.stdout:5/642: dread d2/d4/d98/fc0 [0,4194304] 0 2024-09-20T20:31:42.975 INFO:tasks.workunit.client.0.smithi070.stdout:1/678: dread d4/d1f/f7a [0,4194304] 0 2024-09-20T20:31:42.977 INFO:tasks.workunit.client.0.smithi070.stdout:1/679: mknod d4/d6/d11/d63/de7/d44/d4b/d87/cf8 0 2024-09-20T20:31:42.978 INFO:tasks.workunit.client.0.smithi070.stdout:6/701: dwrite d4/d8/d17/d33/d61/f9b [0,4194304] 0 2024-09-20T20:31:42.979 INFO:tasks.workunit.client.0.smithi070.stdout:5/643: dwrite d2/d4/de/d47/fa6 [0,4194304] 0 2024-09-20T20:31:42.979 INFO:tasks.workunit.client.0.smithi070.stdout:6/702: symlink d4/d8/d10/d54/dec/lf8 0 2024-09-20T20:31:42.982 INFO:tasks.workunit.client.0.smithi070.stdout:1/680: dread d4/d6/f47 [0,4194304] 0 2024-09-20T20:31:42.982 INFO:tasks.workunit.client.0.smithi070.stdout:5/644: link d2/d7/d60/dbd/dcd/ld7 d2/df/d40/lda 0 2024-09-20T20:31:42.982 INFO:tasks.workunit.client.0.smithi070.stdout:6/703: read d4/d8/d1e/d7e/fd3 [104103,68555] 0 2024-09-20T20:31:42.983 INFO:tasks.workunit.client.0.smithi070.stdout:1/681: write d4/d6/d11/d7b/d83/f95 [4406543,66440] 0 2024-09-20T20:31:42.985 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:42.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:42.989 INFO:tasks.workunit.client.0.smithi070.stdout:6/704: dwrite d4/f9 [4194304,4194304] 0 2024-09-20T20:31:42.989 INFO:tasks.workunit.client.0.smithi070.stdout:5/645: dwrite d2/d7/d60/dbd/fcc [0,4194304] 0 2024-09-20T20:31:42.993 INFO:tasks.workunit.client.0.smithi070.stdout:5/646: mkdir d2/d4/d98/d4c/ddb 0 2024-09-20T20:31:42.993 INFO:tasks.workunit.client.0.smithi070.stdout:6/705: creat d4/d8/db4/db6/ff9 x:0 0 0 2024-09-20T20:31:42.993 INFO:tasks.workunit.client.0.smithi070.stdout:5/647: mknod d2/df/d77/cdc 0 2024-09-20T20:31:42.994 INFO:tasks.workunit.client.0.smithi070.stdout:6/706: write d4/d8/d38/f85 [6345,73939] 0 2024-09-20T20:31:42.994 INFO:tasks.workunit.client.0.smithi070.stdout:5/648: readlink d2/d4/d53/l80 0 2024-09-20T20:31:42.996 INFO:tasks.workunit.client.0.smithi070.stdout:6/707: getdents d4/d8/d10/d54/d55/d72 0 2024-09-20T20:31:42.996 INFO:tasks.workunit.client.0.smithi070.stdout:6/708: mknod d4/d8/d38/cfa 0 2024-09-20T20:31:42.997 INFO:tasks.workunit.client.0.smithi070.stdout:6/709: write d4/d8/d38/f7d [2520423,74743] 0 2024-09-20T20:31:42.998 INFO:tasks.workunit.client.0.smithi070.stdout:6/710: creat d4/d8/d3a/ffb x:0 0 0 2024-09-20T20:31:42.999 INFO:tasks.workunit.client.0.smithi070.stdout:6/711: symlink d4/d8/d38/d50/lfc 0 2024-09-20T20:31:43.005 INFO:tasks.workunit.client.0.smithi070.stdout:6/712: dwrite d4/d8/d10/f2b [4194304,4194304] 0 2024-09-20T20:31:43.008 INFO:tasks.workunit.client.0.smithi070.stdout:4/642: sync 2024-09-20T20:31:43.008 INFO:tasks.workunit.client.0.smithi070.stdout:7/524: sync 2024-09-20T20:31:43.009 INFO:tasks.workunit.client.0.smithi070.stdout:0/660: sync 2024-09-20T20:31:43.009 INFO:tasks.workunit.client.0.smithi070.stdout:2/634: sync 2024-09-20T20:31:43.009 INFO:tasks.workunit.client.0.smithi070.stdout:9/651: sync 2024-09-20T20:31:43.009 INFO:tasks.workunit.client.0.smithi070.stdout:3/566: sync 2024-09-20T20:31:43.009 INFO:tasks.workunit.client.0.smithi070.stdout:4/643: chown d6/d5e/fb0 258359 1 2024-09-20T20:31:43.010 INFO:tasks.workunit.client.0.smithi070.stdout:7/525: fdatasync d2/d8/f3b 0 2024-09-20T20:31:43.010 INFO:tasks.workunit.client.0.smithi070.stdout:2/635: write d3/d4c/d5c/fd7 [865957,121709] 0 2024-09-20T20:31:43.011 INFO:tasks.workunit.client.0.smithi070.stdout:4/644: chown d6/d7/dc/f52 4067 1 2024-09-20T20:31:43.011 INFO:tasks.workunit.client.0.smithi070.stdout:0/661: readlink d4/d8/d12/d23/d26/d1d/d7e/l8a 0 2024-09-20T20:31:43.012 INFO:tasks.workunit.client.0.smithi070.stdout:3/567: chown d7/d15/d1a/d48/d66/d69/d13/d1d/c22 1412 1 2024-09-20T20:31:43.012 INFO:tasks.workunit.client.0.smithi070.stdout:4/645: write d6/d43/f60 [4114158,49228] 0 2024-09-20T20:31:43.013 INFO:tasks.workunit.client.0.smithi070.stdout:1/682: dread d4/d6/d26/f70 [0,4194304] 0 2024-09-20T20:31:43.013 INFO:tasks.workunit.client.0.smithi070.stdout:5/649: truncate d2/d7/d88/f83 1285388 0 2024-09-20T20:31:43.013 INFO:tasks.workunit.client.0.smithi070.stdout:9/652: mkdir d1/df/d25/d69/d80/dee 0 2024-09-20T20:31:43.015 INFO:tasks.workunit.client.0.smithi070.stdout:3/568: creat d7/d15/d1a/d4a/d51/d5b/fb3 x:0 0 0 2024-09-20T20:31:43.015 INFO:tasks.workunit.client.0.smithi070.stdout:2/636: write d3/d5/dd/f89 [653316,27680] 0 2024-09-20T20:31:43.015 INFO:tasks.workunit.client.0.smithi070.stdout:4/646: unlink d6/d5e/f95 0 2024-09-20T20:31:43.016 INFO:tasks.workunit.client.0.smithi070.stdout:1/683: symlink d4/d32/de6/lf9 0 2024-09-20T20:31:43.016 INFO:tasks.workunit.client.0.smithi070.stdout:2/637: read d3/d5/f34 [2359350,127478] 0 2024-09-20T20:31:43.016 INFO:tasks.workunit.client.0.smithi070.stdout:5/650: chown d2/d4/d53/d59/f8f 168 1 2024-09-20T20:31:43.016 INFO:tasks.workunit.client.0.smithi070.stdout:1/684: fsync d4/d6/d11/d63/de7/d44/d4b/d87/fd4 0 2024-09-20T20:31:43.017 INFO:tasks.workunit.client.0.smithi070.stdout:5/651: rmdir d2 39 2024-09-20T20:31:43.017 INFO:tasks.workunit.client.0.smithi070.stdout:3/569: rename d7/d15/d1a/d4a/f83 to d7/d15/d1a/d48/d66/d69/d13/fb4 0 2024-09-20T20:31:43.019 INFO:tasks.workunit.client.0.smithi070.stdout:7/526: unlink d2/d30/f3f 0 2024-09-20T20:31:43.021 INFO:tasks.workunit.client.0.smithi070.stdout:5/652: getdents d2/d4/de/d47/d67 0 2024-09-20T20:31:43.023 INFO:tasks.workunit.client.0.smithi070.stdout:6/713: dwrite d4/d8/d17/f24 [0,4194304] 0 2024-09-20T20:31:43.023 INFO:tasks.workunit.client.0.smithi070.stdout:9/653: dwrite d1/df/d25/f96 [0,4194304] 0 2024-09-20T20:31:43.024 INFO:tasks.workunit.client.0.smithi070.stdout:0/662: dwrite d4/d8/d12/d23/d26/d1d/fc6 [0,4194304] 0 2024-09-20T20:31:43.026 INFO:tasks.workunit.client.0.smithi070.stdout:5/653: mkdir d2/df/d40/ddd 0 2024-09-20T20:31:43.026 INFO:tasks.workunit.client.0.smithi070.stdout:9/654: unlink d1/df/d25/d69/daf/de7/ca8 0 2024-09-20T20:31:43.027 INFO:tasks.workunit.client.0.smithi070.stdout:3/570: rename d7/d15/d1a/d48/d57/d75/laa to d7/d15/d1a/d48/d66/d69/lb5 0 2024-09-20T20:31:43.027 INFO:tasks.workunit.client.0.smithi070.stdout:1/685: dwrite d4/d32/dea/d3a/d78/f84 [0,4194304] 0 2024-09-20T20:31:43.027 INFO:tasks.workunit.client.0.smithi070.stdout:0/663: mknod d4/cd2 0 2024-09-20T20:31:43.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/571: mkdir d7/d15/d1e/d65/db6 0 2024-09-20T20:31:43.029 INFO:tasks.workunit.client.0.smithi070.stdout:1/686: rename d4/d32/dea/d3a/d9d/db7/cc2 to d4/d6/d11/dbc/cfa 0 2024-09-20T20:31:43.029 INFO:tasks.workunit.client.0.smithi070.stdout:3/572: fsync d7/d15/d1a/d4a/d51/d5b/fa3 0 2024-09-20T20:31:43.030 INFO:tasks.workunit.client.0.smithi070.stdout:5/654: dread d2/d4/f1e [0,4194304] 0 2024-09-20T20:31:43.031 INFO:tasks.workunit.client.0.smithi070.stdout:3/573: chown d7/d15/d1a/f32 3879 1 2024-09-20T20:31:43.031 INFO:tasks.workunit.client.0.smithi070.stdout:2/638: truncate d3/d5/d9/fcf 3873021 0 2024-09-20T20:31:43.031 INFO:tasks.workunit.client.0.smithi070.stdout:9/655: dread d1/df/d25/d9e/fcf [4194304,4194304] 0 2024-09-20T20:31:43.032 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:43.027+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:43.032 INFO:tasks.workunit.client.0.smithi070.stdout:5/655: dread - d2/d4/d98/fab zero size 2024-09-20T20:31:43.033 INFO:tasks.workunit.client.0.smithi070.stdout:2/639: fsync d3/d5/dd/f89 0 2024-09-20T20:31:43.034 INFO:tasks.workunit.client.0.smithi070.stdout:3/574: rename d7/d15/d1a/d48/d57/d75/lad to d7/d15/d1a/d80/lb7 0 2024-09-20T20:31:43.034 INFO:tasks.workunit.client.0.smithi070.stdout:5/656: mkdir d2/d4/d98/d4c/dad/dba/dde 0 2024-09-20T20:31:43.035 INFO:tasks.workunit.client.0.smithi070.stdout:9/656: creat d1/df/d25/d69/d85/dad/fef x:0 0 0 2024-09-20T20:31:43.035 INFO:tasks.workunit.client.0.smithi070.stdout:2/640: mkdir d3/d4c/d5c/d86/dd5/de3 0 2024-09-20T20:31:43.035 INFO:tasks.workunit.client.0.smithi070.stdout:5/657: rmdir d2/d7 39 2024-09-20T20:31:43.035 INFO:tasks.workunit.client.0.smithi070.stdout:0/664: dwrite d4/f7 [0,4194304] 0 2024-09-20T20:31:43.036 INFO:tasks.workunit.client.0.smithi070.stdout:0/665: chown d4 0 1 2024-09-20T20:31:43.036 INFO:tasks.workunit.client.0.smithi070.stdout:2/641: creat d3/d5/dd/d99/fe4 x:0 0 0 2024-09-20T20:31:43.037 INFO:tasks.workunit.client.0.smithi070.stdout:9/657: symlink d1/df/d25/d69/d85/d9f/db9/lf0 0 2024-09-20T20:31:43.037 INFO:tasks.workunit.client.0.smithi070.stdout:0/666: creat d4/d48/d67/da5/fd3 x:0 0 0 2024-09-20T20:31:43.037 INFO:tasks.workunit.client.0.smithi070.stdout:3/575: getdents d7/d15/d1a/d48/d66 0 2024-09-20T20:31:43.037 INFO:tasks.workunit.client.0.smithi070.stdout:2/642: creat d3/d5/dd/d99/dae/fe5 x:0 0 0 2024-09-20T20:31:43.037 INFO:tasks.workunit.client.0.smithi070.stdout:7/527: write d2/d30/f59 [601001,56641] 0 2024-09-20T20:31:43.038 INFO:tasks.workunit.client.0.smithi070.stdout:5/658: rename d2/d4/d98/d4c/f3a to d2/d4/d53/d59/fdf 0 2024-09-20T20:31:43.038 INFO:tasks.workunit.client.0.smithi070.stdout:8/688: sync 2024-09-20T20:31:43.038 INFO:tasks.workunit.client.0.smithi070.stdout:7/528: fsync d2/f26 0 2024-09-20T20:31:43.039 INFO:tasks.workunit.client.0.smithi070.stdout:5/659: creat d2/d4/de/d47/d5f/fe0 x:0 0 0 2024-09-20T20:31:43.041 INFO:tasks.workunit.client.0.smithi070.stdout:3/576: write d7/d15/d1e/d65/d9d/fb2 [656512,74116] 0 2024-09-20T20:31:43.041 INFO:tasks.workunit.client.0.smithi070.stdout:1/687: dread d4/d32/dea/d3a/d78/db0/fe1 [0,4194304] 0 2024-09-20T20:31:43.042 INFO:tasks.workunit.client.0.smithi070.stdout:2/643: mknod d3/d5/d9/ce6 0 2024-09-20T20:31:43.043 INFO:tasks.workunit.client.0.smithi070.stdout:5/660: link d2/d4/d53/c97 d2/d4/d98/d4c/ce1 0 2024-09-20T20:31:43.044 INFO:tasks.workunit.client.0.smithi070.stdout:3/577: dread - d7/d15/d1a/d4a/d51/d5b/fa3 zero size 2024-09-20T20:31:43.046 INFO:tasks.workunit.client.0.smithi070.stdout:5/661: truncate d2/d4/d98/fd6 311640 0 2024-09-20T20:31:43.046 INFO:tasks.workunit.client.0.smithi070.stdout:1/688: rename d4/d6/d11/d63/de7/d44/d5a/le0 to d4/d32/dea/d3a/d78/lfb 0 2024-09-20T20:31:43.046 INFO:tasks.workunit.client.0.smithi070.stdout:2/644: getdents d3/d5/d9/d1c/d47/d7e 0 2024-09-20T20:31:43.046 INFO:tasks.workunit.client.0.smithi070.stdout:0/667: dwrite d4/d8/d12/d23/d26/d1d/d37/f60 [0,4194304] 0 2024-09-20T20:31:43.047 INFO:tasks.workunit.client.0.smithi070.stdout:9/658: dwrite d1/df/d18/d44/da2/dcc/fe1 [0,4194304] 0 2024-09-20T20:31:43.047 INFO:tasks.workunit.client.0.smithi070.stdout:3/578: truncate d7/d15/d1a/d80/f8c 722267 0 2024-09-20T20:31:43.050 INFO:tasks.workunit.client.0.smithi070.stdout:5/662: mkdir d2/d4/de/d47/d67/d92/de2 0 2024-09-20T20:31:43.051 INFO:tasks.workunit.client.0.smithi070.stdout:2/645: read - d3/d5/d9/d1c/d47/d7e/f84 zero size 2024-09-20T20:31:43.051 INFO:tasks.workunit.client.0.smithi070.stdout:9/659: rmdir d1/df/d25/d9e 39 2024-09-20T20:31:43.052 INFO:tasks.workunit.client.0.smithi070.stdout:5/663: rmdir d2/d7/d60/dc3 0 2024-09-20T20:31:43.053 INFO:tasks.workunit.client.0.smithi070.stdout:9/660: chown d1/df/d18/fc9 201 1 2024-09-20T20:31:43.055 INFO:tasks.workunit.client.0.smithi070.stdout:5/664: write d2/d4/de/f34 [1007945,50310] 0 2024-09-20T20:31:43.055 INFO:tasks.workunit.client.0.smithi070.stdout:7/529: dread d2/f26 [0,4194304] 0 2024-09-20T20:31:43.056 INFO:tasks.workunit.client.0.smithi070.stdout:0/668: dwrite d4/d19/fb9 [0,4194304] 0 2024-09-20T20:31:43.057 INFO:tasks.workunit.client.0.smithi070.stdout:0/669: chown d4/d8/d12/d23/d26/d1d/d37/d38/fb7 48 1 2024-09-20T20:31:43.057 INFO:tasks.workunit.client.0.smithi070.stdout:2/646: symlink d3/d5/d9/d1c/d1f/d3e/dbe/le7 0 2024-09-20T20:31:43.057 INFO:tasks.workunit.client.0.smithi070.stdout:9/661: mknod d1/df/d25/db2/cf1 0 2024-09-20T20:31:43.057 INFO:tasks.workunit.client.0.smithi070.stdout:7/530: unlink d2/d8/l9e 0 2024-09-20T20:31:43.058 INFO:tasks.workunit.client.0.smithi070.stdout:5/665: getdents d2/db7 0 2024-09-20T20:31:43.059 INFO:tasks.workunit.client.0.smithi070.stdout:9/662: write d1/df/d38/fc1 [689855,94348] 0 2024-09-20T20:31:43.059 INFO:tasks.workunit.client.0.smithi070.stdout:2/647: rename d3/d4c/d5c/fc5 to d3/d5/d9/d1c/d1f/d3e/dbe/fe8 0 2024-09-20T20:31:43.060 INFO:tasks.workunit.client.0.smithi070.stdout:5/666: write d2/d7/d60/f91 [90600,115975] 0 2024-09-20T20:31:43.061 INFO:tasks.workunit.client.0.smithi070.stdout:2/648: unlink d3/d5/d9/d10/fb5 0 2024-09-20T20:31:43.063 INFO:tasks.workunit.client.0.smithi070.stdout:8/689: truncate d4/db/fd4 214012 0 2024-09-20T20:31:43.065 INFO:tasks.workunit.client.0.smithi070.stdout:0/670: dwrite d4/d8/d12/d23/d26/d1d/fc6 [0,4194304] 0 2024-09-20T20:31:43.066 INFO:tasks.workunit.client.0.smithi070.stdout:2/649: read f2 [14067650,69351] 0 2024-09-20T20:31:43.067 INFO:tasks.workunit.client.0.smithi070.stdout:5/667: dwrite d2/d4/d98/fd6 [0,4194304] 0 2024-09-20T20:31:43.068 INFO:tasks.workunit.client.0.smithi070.stdout:2/650: unlink d3/d5/ce0 0 2024-09-20T20:31:43.068 INFO:tasks.workunit.client.0.smithi070.stdout:0/671: link c3 d4/d8/d55/d7c/cd4 0 2024-09-20T20:31:43.069 INFO:tasks.workunit.client.0.smithi070.stdout:0/672: write d4/d8/d12/d23/d26/d1f/fae [872398,109825] 0 2024-09-20T20:31:43.071 INFO:tasks.workunit.client.0.smithi070.stdout:0/673: rmdir d4/d48/d67/da5 39 2024-09-20T20:31:43.071 INFO:tasks.workunit.client.0.smithi070.stdout:0/674: fdatasync d4/d1b/f98 0 2024-09-20T20:31:43.079 INFO:tasks.workunit.client.0.smithi070.stdout:1/689: dread d4/d32/dea/d3b/f3e [0,4194304] 0 2024-09-20T20:31:43.082 INFO:tasks.workunit.client.0.smithi070.stdout:9/663: truncate d1/df/d25/d69/d85/dad/f94 271925 0 2024-09-20T20:31:43.083 INFO:tasks.workunit.client.0.smithi070.stdout:8/690: truncate d4/d27/d2a/d75/f77 833263 0 2024-09-20T20:31:43.083 INFO:tasks.workunit.client.0.smithi070.stdout:9/664: unlink d1/f1f 0 2024-09-20T20:31:43.085 INFO:tasks.workunit.client.0.smithi070.stdout:8/691: stat d4/d27/d2a/d5b/d98/da9/db5/dc0/lc8 0 2024-09-20T20:31:43.085 INFO:tasks.workunit.client.0.smithi070.stdout:9/665: mknod d1/df/d84/dc0/cf2 0 2024-09-20T20:31:43.085 INFO:tasks.workunit.client.0.smithi070.stdout:7/531: dread d2/d8/f64 [0,4194304] 0 2024-09-20T20:31:43.086 INFO:tasks.workunit.client.0.smithi070.stdout:7/532: dread - d2/d19/d25/d42/d77/f8b zero size 2024-09-20T20:31:43.086 INFO:tasks.workunit.client.0.smithi070.stdout:8/692: symlink d4/d27/d2a/d3e/d39/ddf/lec 0 2024-09-20T20:31:43.086 INFO:tasks.workunit.client.0.smithi070.stdout:1/690: dwrite d4/d6/d11/d7b/fb1 [0,4194304] 0 2024-09-20T20:31:43.090 INFO:tasks.workunit.client.0.smithi070.stdout:2/651: chown d3/de/f39 14 1 2024-09-20T20:31:43.092 INFO:tasks.workunit.client.0.smithi070.stdout:5/668: dread d2/d7/f31 [0,4194304] 0 2024-09-20T20:31:43.093 INFO:tasks.workunit.client.0.smithi070.stdout:2/652: creat d3/d5/d9/d1c/d47/d7e/fe9 x:0 0 0 2024-09-20T20:31:43.093 INFO:tasks.workunit.client.0.smithi070.stdout:9/666: dwrite d1/f2a [0,4194304] 0 2024-09-20T20:31:43.096 INFO:tasks.workunit.client.0.smithi070.stdout:2/653: fsync d3/d5/d9/d1c/d1f/d3e/d61/db2/fb8 0 2024-09-20T20:31:43.097 INFO:tasks.workunit.client.0.smithi070.stdout:8/693: dwrite d4/db/f1b [0,4194304] 0 2024-09-20T20:31:43.099 INFO:tasks.workunit.client.0.smithi070.stdout:1/691: dwrite d4/d6/fc4 [0,4194304] 0 2024-09-20T20:31:43.101 INFO:tasks.workunit.client.0.smithi070.stdout:9/667: dwrite d1/f2a [0,4194304] 0 2024-09-20T20:31:43.103 INFO:tasks.workunit.client.0.smithi070.stdout:9/668: rename d1/df/d25/d69/d80/dee to d1/df/d25/d69/d85/d9f/db9/de3/df3 0 2024-09-20T20:31:43.104 INFO:tasks.workunit.client.0.smithi070.stdout:5/669: read d2/d4/d98/dc7/fb3 [670470,12136] 0 2024-09-20T20:31:43.105 INFO:tasks.workunit.client.0.smithi070.stdout:2/654: dwrite d3/d5/d9/d42/f59 [4194304,4194304] 0 2024-09-20T20:31:43.109 INFO:tasks.workunit.client.0.smithi070.stdout:5/670: truncate d2/df/d40/f5d 385486 0 2024-09-20T20:31:43.109 INFO:tasks.workunit.client.0.smithi070.stdout:5/671: write d2/d7/d60/fb1 [653388,71519] 0 2024-09-20T20:31:43.110 INFO:tasks.workunit.client.0.smithi070.stdout:5/672: mknod d2/df/ce3 0 2024-09-20T20:31:43.111 INFO:tasks.workunit.client.0.smithi070.stdout:2/655: truncate d3/de/d12/f8d 819418 0 2024-09-20T20:31:43.111 INFO:tasks.workunit.client.0.smithi070.stdout:2/656: truncate d3/de/d12/d1a/fc6 936911 0 2024-09-20T20:31:43.112 INFO:tasks.workunit.client.0.smithi070.stdout:5/673: getdents d2/d7/d88 0 2024-09-20T20:31:43.113 INFO:tasks.workunit.client.0.smithi070.stdout:5/674: creat d2/d7/d60/dbd/fe4 x:0 0 0 2024-09-20T20:31:43.113 INFO:tasks.workunit.client.0.smithi070.stdout:1/692: truncate d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f5f 2803772 0 2024-09-20T20:31:43.114 INFO:tasks.workunit.client.0.smithi070.stdout:9/669: truncate d1/df/f19 1005144 0 2024-09-20T20:31:43.114 INFO:tasks.workunit.client.0.smithi070.stdout:5/675: creat d2/d4/de/d47/d67/d92/fe5 x:0 0 0 2024-09-20T20:31:43.114 INFO:tasks.workunit.client.0.smithi070.stdout:1/693: chown d4/d32/dea/cac 1290 1 2024-09-20T20:31:43.116 INFO:tasks.workunit.client.0.smithi070.stdout:9/670: getdents d1/df/d25/d69/d80 0 2024-09-20T20:31:43.117 INFO:tasks.workunit.client.0.smithi070.stdout:9/671: chown d1/df/d18/deb 4 1 2024-09-20T20:31:43.119 INFO:tasks.workunit.client.0.smithi070.stdout:2/657: dwrite d3/de/d12/f7d [0,4194304] 0 2024-09-20T20:31:43.119 INFO:tasks.workunit.client.0.smithi070.stdout:9/672: rename d1/df/d18/d44/c4c to d1/df/d25/d69/d80/cf4 0 2024-09-20T20:31:43.120 INFO:tasks.workunit.client.0.smithi070.stdout:5/676: dread d2/d4/de/d47/fa6 [0,4194304] 0 2024-09-20T20:31:43.121 INFO:tasks.workunit.client.0.smithi070.stdout:2/658: mknod d3/d5/dd/d5a/cea 0 2024-09-20T20:31:43.121 INFO:tasks.workunit.client.0.smithi070.stdout:9/673: fsync d1/df/d18/d46/f81 0 2024-09-20T20:31:43.122 INFO:tasks.workunit.client.0.smithi070.stdout:5/677: fdatasync d2/d4/d98/d5b/f42 0 2024-09-20T20:31:43.123 INFO:tasks.workunit.client.0.smithi070.stdout:9/674: rename d1/df/d84/dc0 to d1/df/d25/dc4/df5 0 2024-09-20T20:31:43.123 INFO:tasks.workunit.client.0.smithi070.stdout:8/694: dread d4/db/d64/d95/da5/fab [0,4194304] 0 2024-09-20T20:31:43.124 INFO:tasks.workunit.client.0.smithi070.stdout:1/694: dwrite d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f31 [0,4194304] 0 2024-09-20T20:31:43.126 INFO:tasks.workunit.client.0.smithi070.stdout:7/533: dread d2/d19/d2e/f41 [0,4194304] 0 2024-09-20T20:31:43.128 INFO:tasks.workunit.client.0.smithi070.stdout:7/534: mkdir d2/d19/d25/da2 0 2024-09-20T20:31:43.128 INFO:tasks.workunit.client.0.smithi070.stdout:9/675: rmdir d1/df/d25/d69/d85/d9f/db9/de3/de5 39 2024-09-20T20:31:43.128 INFO:tasks.workunit.client.0.smithi070.stdout:2/659: dwrite d3/de/d12/f7d [0,4194304] 0 2024-09-20T20:31:43.129 INFO:tasks.workunit.client.0.smithi070.stdout:1/695: dread d4/d32/dea/d3a/d78/db0/fe1 [0,4194304] 0 2024-09-20T20:31:43.129 INFO:tasks.workunit.client.0.smithi070.stdout:7/535: creat d2/d65/fa3 x:0 0 0 2024-09-20T20:31:43.130 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:43.124+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:43.131 INFO:tasks.workunit.client.0.smithi070.stdout:1/696: dread - d4/d32/fd1 zero size 2024-09-20T20:31:43.131 INFO:tasks.workunit.client.0.smithi070.stdout:8/695: dwrite d4/db/f5e [0,4194304] 0 2024-09-20T20:31:43.132 INFO:tasks.workunit.client.0.smithi070.stdout:1/697: fsync d4/d6/d11/d63/de7/d44/d4b/d87/fa2 0 2024-09-20T20:31:43.133 INFO:tasks.workunit.client.0.smithi070.stdout:8/696: mknod d4/d27/d2a/d5b/d6c/da6/ced 0 2024-09-20T20:31:43.134 INFO:tasks.workunit.client.0.smithi070.stdout:9/676: dread d1/df/d25/d69/d85/dad/f57 [0,4194304] 0 2024-09-20T20:31:43.134 INFO:tasks.workunit.client.0.smithi070.stdout:1/698: write d4/d32/d60/dca/ff7 [398790,72860] 0 2024-09-20T20:31:43.134 INFO:tasks.workunit.client.0.smithi070.stdout:4/647: sync 2024-09-20T20:31:43.134 INFO:tasks.workunit.client.0.smithi070.stdout:6/714: sync 2024-09-20T20:31:43.134 INFO:tasks.workunit.client.0.smithi070.stdout:0/675: sync 2024-09-20T20:31:43.136 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:43.136 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:43.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:43.136 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:43.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.136 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:373 3.2 3:4272d415:::200.0000000b:head [write 778889~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.136 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.177065786, 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105808761, 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953113+0000", 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5999999999999999e-06 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953122+0000", 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0729999999999994e-06 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953145+0000", 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3312999999999999e-05 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953162+0000", 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6402999999999999e-05 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054491+0000", 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10132910000000001 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054636+0000", 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014555699999999999 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054826+0000", 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019007299999999999 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058425+0000", 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035988589999999998 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058640+0000", 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021432800000000001 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058775+0000", 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013597500000000001 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058920+0000", 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014448 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:374 3.2 3:4272d415:::200.0000000b:head [write 780291~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1762488900000001, 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.106652574, 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.142 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953930+0000", 2024-09-20T20:31:43.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1900000000000002e-06 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953942+0000", 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1355999999999999e-05 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953968+0000", 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6380000000000002e-05 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953983+0000", 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4686e-05 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055691+0000", 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101707783 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055801+0000", 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110568 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055978+0000", 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000177119 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058598+0000", 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002620196 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060327+0000", 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017290210000000001 2024-09-20T20:31:43.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060476+0000", 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000148527 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060581+0000", 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010474799999999999 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:375 3.2 3:4272d415:::200.0000000b:head [write 781692~2432 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1744037900000004, 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.106557868, 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955776+0000", 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4569999999999999e-06 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955790+0000", 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4532000000000001e-05 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955845+0000", 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4401999999999999e-05 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955887+0000", 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2648999999999998e-05 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056678+0000", 2024-09-20T20:31:43.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100791148 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056801+0000", 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012273399999999999 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056976+0000", 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017484299999999999 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062015+0000", 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050385459999999996 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062053+0000", 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8569000000000003e-05 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062221+0000", 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016815299999999999 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062331+0000", 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010983499999999999 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:376 3.2 3:4272d415:::200.0000000b:head [write 784124~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1740922769999997, 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.108173241, 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.153 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956087+0000", 2024-09-20T20:31:43.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0870000000000001e-06 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956116+0000", 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9042000000000001e-05 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956142+0000", 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6452999999999999e-05 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956155+0000", 2024-09-20T20:31:43.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2306e-05 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059009+0000", 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10285475199999999 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059206+0000", 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019710300000000001 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059539+0000", 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033236600000000001 2024-09-20T20:31:43.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062493+0000", 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029542629999999999 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.063998+0000", 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001504921 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064139+0000", 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000141347 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064258+0000", 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000118601 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:377 3.2 3:4272d415:::200.0000000b:head [write 785531~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.158 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.173536436, 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.109408697, 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956643+0000", 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1299999999999999e-06 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956654+0000", 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.115e-05 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956681+0000", 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6726000000000001e-05 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956695+0000", 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4893e-05 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060694+0000", 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103998043 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060878+0000", 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018448499999999999 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.061167+0000", 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000289194 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065734+0000", 2024-09-20T20:31:43.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045670190000000003 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065780+0000", 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5658999999999998e-05 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065933+0000", 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015302 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066049+0000", 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116378 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:378 3.2 3:4272d415:::200.0000000b:head [write 786941~2442 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1734311909999997, 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.111232968, 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956747+0000", 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7999999999999993e-07 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956760+0000", 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3696000000000001e-05 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956774+0000", 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3266e-05 2024-09-20T20:31:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956783+0000", 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8899999999999996e-06 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062642+0000", 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10585894999999999 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062863+0000", 2024-09-20T20:31:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022100200000000001 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.063215+0000", 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035195000000000002 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066222+0000", 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003007904 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067697+0000", 2024-09-20T20:31:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014745629999999999 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067866+0000", 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000168849 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067979+0000", 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011291800000000001 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:379 3.2 3:4272d415:::200.0000000b:head [write 789383~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1731531579999999, 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11286650500000001, 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957025+0000", 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.33e-06 2024-09-20T20:31:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957037+0000", 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1936999999999999e-05 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957056+0000", 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8459999999999999e-05 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957066+0000", 2024-09-20T20:31:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0266e-05 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064381+0000", 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107315483 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064643+0000", 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026130800000000003 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064877+0000", 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023413899999999999 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069614+0000", 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0047370750000000003 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069654+0000", 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0541999999999999e-05 2024-09-20T20:31:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069786+0000", 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013186400000000001 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069890+0000", 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104101 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:380 3.2 3:4272d415:::200.0000000b:head [write 790782~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1730375029999998, 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11330689300000001, 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957141+0000", 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3400000000000001e-06 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957150+0000", 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8230000000000001e-06 2024-09-20T20:31:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957171+0000", 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1331999999999998e-05 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957231+0000", 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9698999999999999e-05 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066361+0000", 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.109130173 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066587+0000", 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022618599999999999 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066926+0000", 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033860299999999998 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069996+0000", 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003070672 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070196+0000", 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019970599999999999 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070339+0000", 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000143067 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070446+0000", 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107292 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:381 3.2 3:4272d415:::200.0000000b:head [write 792697~6542 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1728980829999998, 2024-09-20T20:31:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117989833, 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957286+0000", 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0829999999999998e-06 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957305+0000", 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9216e-05 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957321+0000", 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5787e-05 2024-09-20T20:31:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957331+0000", 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068072+0000", 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11074125899999999 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068198+0000", 2024-09-20T20:31:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126007 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068391+0000", 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019251899999999999 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070149+0000", 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017585910000000001 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.074999+0000", 2024-09-20T20:31:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048502629999999996 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075145+0000", 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014563 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075269+0000", 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123628 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:382 3.2 3:4272d415:::200.0000000b:head [write 799239~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1717846769999998, 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117478417, 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958395+0000", 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1030000000000002e-06 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958409+0000", 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4059999999999999e-05 2024-09-20T20:31:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958442+0000", 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2085999999999997e-05 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958466+0000", 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070538+0000", 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11207286399999999 2024-09-20T20:31:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070770+0000", 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023195799999999999 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.071118+0000", 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034751299999999998 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075415+0000", 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042975080000000002 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075621+0000", 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000205622 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075757+0000", 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608399999999999 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075871+0000", 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113577 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:383 3.2 3:4272d415:::200.0000000b:head [write 800641~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1716084779999996, 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11757527299999999, 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.192 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958575+0000", 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6540000000000002e-06 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958586+0000", 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1293e-05 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958612+0000", 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5792e-05 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958634+0000", 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1287000000000001e-05 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072108+0000", 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.113474767 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072345+0000", 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000237178 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072615+0000", 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026950800000000001 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075583+0000", 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002967679 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075895+0000", 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031276699999999998 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076020+0000", 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012504700000000001 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076144+0000", 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123301 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:384 3.2 3:4272d415:::200.0000000b:head [write 802559~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:43.197 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1715167859999998, 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.119348309, 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958662+0000", 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3859999999999999e-06 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958678+0000", 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6779999999999999e-05 2024-09-20T20:31:43.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958705+0000", 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6403000000000001e-05 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958732+0000", 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6818999999999999e-05 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073242+0000", 2024-09-20T20:31:43.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.114510876 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073474+0000", 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023108499999999999 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073807+0000", 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033322700000000001 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076255+0000", 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024479860000000001 2024-09-20T20:31:43.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.077749+0000", 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014944820000000001 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.077892+0000", 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014243700000000001 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078009+0000", 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116828 2024-09-20T20:31:43.202 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:385 3.2 3:4272d415:::200.0000000b:head [write 804479~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1710417030000002, 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121337555, 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:43.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:43.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959137+0000", 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0499999999999999e-06 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959165+0000", 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7256000000000001e-05 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959238+0000", 2024-09-20T20:31:43.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2974999999999998e-05 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959259+0000", 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1005999999999998e-05 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076373+0000", 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117114513 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076598+0000", 2024-09-20T20:31:43.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022489100000000001 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076941+0000", 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034298999999999999 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080222+0000", 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032812589999999999 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080337+0000", 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115148 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080411+0000", 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3891000000000001e-05 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080473+0000", 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1575999999999995e-05 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.209 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:386 3.2 3:4272d415:::200.0000000b:head [write 806408~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1708667869999996, 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12330429499999999, 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:43.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959312+0000", 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1129999999999999e-06 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959322+0000", 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5570000000000001e-06 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959386+0000", 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3805000000000003e-05 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959407+0000", 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1583e-05 2024-09-20T20:31:43.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078149+0000", 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11874132900000001 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078289+0000", 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014025999999999999 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078474+0000", 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018509599999999999 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080317+0000", 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001842752 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082471+0000", 2024-09-20T20:31:43.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021539160000000001 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082550+0000", 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9515e-05 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082615+0000", 2024-09-20T20:31:43.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4369000000000007e-05 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:387 3.2 3:4272d415:::200.0000000b:head [write 807809~2445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1707455600000003, 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12458949499999999, 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959433+0000", 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-06 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959496+0000", 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2744999999999996e-05 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959525+0000", 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9346e-05 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959541+0000", 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6143000000000001e-05 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079333+0000", 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.119791804 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079451+0000", 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117821 2024-09-20T20:31:43.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079630+0000", 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017930999999999999 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082759+0000", 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031291050000000001 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083884+0000", 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011246699999999999 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083957+0000", 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3192e-05 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084021+0000", 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3995e-05 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:388 3.2 3:4272d415:::200.0000000b:head [write 810254~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1706118290000003, 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12698309799999999, 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959566+0000", 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.316e-06 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959584+0000", 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7183000000000001e-05 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959603+0000", 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9474e-05 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959618+0000", 2024-09-20T20:31:43.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4491999999999999e-05 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080537+0000", 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120919765 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080655+0000", 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011762 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080836+0000", 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018099699999999999 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083744+0000", 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029083220000000001 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086406+0000", 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026616650000000001 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086484+0000", 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7511999999999999e-05 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086548+0000", 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4752000000000006e-05 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:389 3.2 3:4272d415:::200.0000000b:head [write 811657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:43.227 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1705167650000003, 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12703187799999999, 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959661+0000", 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7000000000000004e-07 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959678+0000", 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7357e-05 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959691+0000", 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2176e-05 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959699+0000", 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4030000000000007e-06 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081607+0000", 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121908401 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081736+0000", 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857999999999999 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081922+0000", 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018580300000000001 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083854+0000", 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019327669999999999 2024-09-20T20:31:43.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086573+0000", 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027184370000000002 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086642+0000", 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8841e-05 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086692+0000", 2024-09-20T20:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0343000000000002e-05 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:390 3.2 3:4272d415:::200.0000000b:head [write 813056~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1704658859999997, 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12969470299999999, 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.233 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959712+0000", 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4e-07 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959716+0000", 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2570000000000001e-06 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959733+0000", 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959744+0000", 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.049e-05 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082847+0000", 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123103439 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082956+0000", 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010941400000000001 2024-09-20T20:31:43.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083149+0000", 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000192843 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086278+0000", 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031285480000000001 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089265+0000", 2024-09-20T20:31:43.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029868920000000001 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089341+0000", 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6075000000000006e-05 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089406+0000", 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5001999999999999e-05 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.238 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 814477~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.170423617, 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12979708400000001, 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959754+0000", 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4000000000000001e-07 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959766+0000", 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2403e-05 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959782+0000", 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5224e-05 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959791+0000", 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2760000000000006e-06 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084105+0000", 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.124313734 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084235+0000", 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129877 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084418+0000", 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018307999999999999 2024-09-20T20:31:43.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086381+0000", 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019628890000000002 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089429+0000", 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030487800000000001 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089499+0000", 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9791999999999999e-05 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089550+0000", 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1388999999999999e-05 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 816399~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.1616822889999998, 2024-09-20T20:31:43.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12436905700000001, 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:43.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968497+0000", 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1859999999999999e-06 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968511+0000", 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3740000000000001e-05 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:43.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968540+0000", 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9039000000000001e-05 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968566+0000", 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6703000000000002e-05 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085239+0000", 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.116672501 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:43.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085380+0000", 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014088999999999999 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085619+0000", 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023910899999999999 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089129+0000", 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003510567 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092708+0000", 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003578566 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092798+0000", 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0241000000000006e-05 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092864+0000", 2024-09-20T20:31:43.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5514999999999999e-05 2024-09-20T20:31:43.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.250 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.250 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:43.250 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:43.250 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:43.253 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:43.247+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:43.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:43.260 INFO:tasks.workunit.client.0.smithi070.stdout:9/677: chown d1/df/fd6 1411 1 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:2/660: truncate f2 6293370 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:4/648: chown d6/d26/d69/fbd 156410 1 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:6/715: getdents d4/d8/d10/d54/d55/d72 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/676: mkdir d4/d8/d12/d43/dd5 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:1/699: symlink d4/d6/d11/d63/da3/lfc 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:4/649: mkdir d6/d5e/d51/dc8 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:8/697: rename d4/db/d64/d7b/lbc to d4/d27/d2a/d43/d61/lee 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/677: unlink d4/d8/d12/f5d 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:4/650: symlink d6/d26/d69/d71/lc9 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:2/661: link d3/d5/d9/d10/fad d3/d5/d9/feb 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:7/536: dwrite d2/d52/f54 [0,4194304] 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:8/698: write d4/d27/d73/f99 [787813,123122] 0 2024-09-20T20:31:43.261 INFO:tasks.workunit.client.0.smithi070.stdout:0/678: write d4/d8/d12/d23/f73 [1082306,27032] 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/679: unlink d4/d8/d12/f86 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:8/699: write d4/d27/d2a/d3e/d31/d63/fdb [62564,36234] 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:2/662: mknod d3/d5/dd/d99/ddb/cec 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/680: rename d4/d8/d12/lc2 to d4/d48/ld6 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:4/651: dwrite d6/d26/d97/fc5 [0,4194304] 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:2/663: truncate d3/de/d12/d1a/f30 4573843 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:9/678: dwrite d1/df/d18/d44/da2/dcc/fe1 [0,4194304] 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:9/679: fdatasync d1/df/d38/fa3 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:9/680: readlink d1/lae 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:9/681: readlink d1/df/d18/d44/d77/l86 0 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/681: chown d4/d8/d12/d43/d9b/f9c 284760 1 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:9/682: chown d1/df/d84/fe8 290784 1 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/682: chown d4/d13/f76 1912863 1 2024-09-20T20:31:43.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/683: fsync d4/d8/d12/d23/d26/d2d/f6c 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:0/684: fsync d4/d48/d7b/d8c/f93 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:2/664: dwrite d3/de/f6d [0,4194304] 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:7/537: truncate d2/d19/d25/d42/d55/f71 3559721 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:8/700: write d4/d27/d2a/d43/d61/fe8 [884597,62491] 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:6/716: dread d4/d8/d17/f31 [0,4194304] 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:6/717: chown d4/df0/la2 43963732 1 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:9/683: rename d1/df/d38/ca5 to d1/df/d18/d44/da2/db6/dd9/cf6 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:4/652: creat d6/d5e/d75/d61/fca x:0 0 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:7/538: unlink d2/d19/d25/d2a/d4a/f62 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:6/718: symlink d4/d8/db4/db6/lfd 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:4/653: creat d6/d5e/d75/fcb x:0 0 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:2/665: getdents d3/d5/d9/d1c/d1f 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:7/539: unlink d2/d19/d25/d84/c98 0 2024-09-20T20:31:43.263 INFO:tasks.workunit.client.0.smithi070.stdout:6/719: write d4/d8/d10/d3c/f6a [717410,27916] 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:4/654: mkdir d6/d26/d69/d71/d4c/dcc 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:7/540: creat d2/d19/d25/da2/fa4 x:0 0 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:8/701: dwrite d4/d27/d2a/d5b/d98/da9/db5/dc0/fc3 [0,4194304] 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:4/655: dread d6/d5e/d75/d61/f96 [0,4194304] 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:9/684: dwrite d1/df/d18/d44/fba [0,4194304] 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:7/541: mknod d2/d30/d63/ca5 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:8/702: rmdir d4/db/d66/d8d 39 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:7/542: stat d2/d30/d63/d69 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:1/700: dread d4/d32/dea/d3a/f68 [4194304,4194304] 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:4/656: getdents d6/d5e/d75 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:1/701: readlink d4/l16 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:7/543: creat d2/d30/d63/d69/fa6 x:0 0 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:6/720: dwrite d4/d8/f2f [0,4194304] 0 2024-09-20T20:31:43.264 INFO:tasks.workunit.client.0.smithi070.stdout:8/703: creat d4/fef x:0 0 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:8/704: fsync d4/d27/d73/fd7 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:6/721: chown d4/d8/d10/d3c/l4b 3010 1 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:4/657: rename d6/d5e/d6b/d74/f98 to d6/d5e/d51/d63/fcd 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:1/702: creat d4/d32/dea/d3a/d9d/db7/ffd x:0 0 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:6/722: mknod d4/d8/db4/cfe 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:4/658: dread - d6/d26/fc1 zero size 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:2/666: dwrite d3/f75 [0,4194304] 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:8/705: chown d4/d27/d2a/d43/d61/fe8 81118 1 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:2/667: chown d3/cb9 0 1 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:6/723: write d4/d8/d10/d3c/f6a [838179,126933] 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:0/685: dread d4/d8/d12/d23/d26/d1d/d37/d38/f5c [0,4194304] 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:7/544: rename d2/d19/d25/d2a/d5c/f5d to d2/d19/d25/da2/fa7 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:6/724: creat d4/d8/fff x:0 0 0 2024-09-20T20:31:43.265 INFO:tasks.workunit.client.0.smithi070.stdout:6/725: fsync d4/d8/d10/d3c/f8d 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:0/686: write d4/d8/d12/d23/d26/d1d/d37/d38/f57 [1431759,128500] 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:6/726: mknod d4/d8/d10/d3c/c100 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:1/703: rename d4/l7c to d4/d6/d11/dbc/lfe 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:6/727: fsync d4/f9c 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:1/704: dread - d4/d6/fbd zero size 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:7/545: write d2/d19/d25/d42/f5a [709848,1700] 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:6/728: symlink d4/d8/d10/d54/d55/d72/l101 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:1/705: rmdir d4/d32/dea/d3a/d9d 39 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:7/546: chown d2/d19/d25/d2a/l97 13 1 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:8/706: rename d4/l4e to d4/db/d64/d95/lf0 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:6/729: creat d4/d8/d17/d33/d61/f102 x:0 0 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:4/659: rename d6/d5e/d75/d61/fca to d6/d5e/d51/d78/dbc/fce 0 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:8/707: chown d4/db/d64/d95/da5 1661 1 2024-09-20T20:31:43.266 INFO:tasks.workunit.client.0.smithi070.stdout:6/730: fsync d4/d8/d17/f49 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:7/547: creat d2/d8/fa8 x:0 0 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:8/708: dread - d4/d27/d73/fd7 zero size 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:7/548: dread - d2/d30/d63/f93 zero size 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:6/731: rename d4/d8/d17/l4d to d4/d8/d17/db2/deb/l103 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:9/685: dread d1/df/f22 [0,4194304] 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:7/549: mknod d2/d8/ca9 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:8/709: creat d4/d27/d2a/d5b/ff1 x:0 0 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:4/660: dread d6/d26/d69/d71/f79 [0,4194304] 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:6/732: mkdir d4/d8/db4/db6/d104 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:7/550: mkdir d2/d19/d2e/daa 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:8/710: creat d4/d27/d2a/d5b/d98/da9/db5/ff2 x:0 0 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:1/706: dwrite d4/d32/dea/d3a/d9d/db7/ffd [0,4194304] 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:9/686: rename d1/d76/l92 to d1/df/d84/lf7 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:6/733: fdatasync d4/d8/d10/f92 0 2024-09-20T20:31:43.267 INFO:tasks.workunit.client.0.smithi070.stdout:4/661: mknod d6/d5e/d75/ccf 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:8/711: chown d4/db/d64/d7b/ceb 0 1 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:5/678: sync 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:6/734: fsync d4/d8/d17/d33/fc4 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:3/579: sync 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:8/712: readlink d4/db/l23 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:1/707: link d4/d6/d11/d63/de7/d44/d48/f5e d4/d32/d60/dca/fff 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:5/679: stat d2/d4/d98/d5b/d90/da0 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:9/687: rename d1/df/d18/d44/c64 to d1/df/d25/d69/cf8 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:6/735: creat d4/d8/d1e/db7/f105 x:0 0 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:5/680: write d2/d7/d60/f91 [235090,78981] 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:4/662: stat d6/d5e/d75/d61 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:6/736: write d4/f9 [8214107,115194] 0 2024-09-20T20:31:43.268 INFO:tasks.workunit.client.0.smithi070.stdout:4/663: creat d6/d5e/d75/d40/fd0 x:0 0 0 2024-09-20T20:31:43.269 INFO:tasks.workunit.client.0.smithi070.stdout:1/708: getdents d4/d6/d11/d63/de7/d44/d4b/d87/da9 0 2024-09-20T20:31:43.269 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:43.269 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:43.272 INFO:tasks.workunit.client.0.smithi070.stdout:4/664: readlink d6/d5e/d51/d63/la7 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:1/709: write d4/d6/d11/d7b/fb1 [13229,95023] 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:8/713: dwrite d4/f38 [0,4194304] 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:7/551: dwrite d2/d8/f3b [0,4194304] 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:8/714: chown d4/db/d66 1887 1 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:7/552: chown c0 74842337 1 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:9/688: dwrite d1/df/d38/fc3 [0,4194304] 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:5/681: dwrite d2/d4/d53/d59/f61 [0,4194304] 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:7/553: fdatasync d2/d19/d25/d84/f8c 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:4/665: creat d6/d7/dc/d20/fd1 x:0 0 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:3/580: truncate d7/d15/d1e/d65/f3c 5600720 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:3/581: stat d7/d15/d1e/d65/f27 0 2024-09-20T20:31:43.273 INFO:tasks.workunit.client.0.smithi070.stdout:9/689: fsync d1/df/d25/d69/f8d 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:3/582: creat d7/d71/fb8 x:0 0 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:3/583: creat d7/d15/d1a/d80/fb9 x:0 0 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:9/690: mknod d1/df/d25/d69/d85/cf9 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:7/554: dwrite d2/d19/d25/d42/f91 [0,4194304] 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:6/737: truncate d4/d8/ff 663634 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:8/715: truncate d4/db/f1b 2568727 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:1/710: dwrite d4/d32/d60/dca/fff [0,4194304] 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:8/716: rename d4/db/d66/f81 to d4/db/d64/ff3 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:6/738: symlink d4/d8/d10/l106 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:3/584: write d7/d15/d1a/d4a/f4d [2617164,113439] 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:9/691: symlink d1/df/d25/d69/d85/d9f/db9/de3/de5/lfa 0 2024-09-20T20:31:43.274 INFO:tasks.workunit.client.0.smithi070.stdout:8/717: fsync d4/d27/d2a/d3e/f6d 0 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:6/739: mknod d4/d8/d3a/c107 0 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:9/692: creat d1/df/d18/d46/ffb x:0 0 0 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:5/682: dwrite d2/d7/f31 [0,4194304] 0 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:3/585: symlink d7/d15/d1a/d48/d57/d75/lba 0 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:6/740: symlink d4/d8/d17/d33/d61/l108 0 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:9/693: write d1/df/d18/d46/f55 [16738,17020] 0 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:5/683: dread - d2/d4/de/d47/d5f/fa7 zero size 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:6/741: fdatasync d4/d8/d1e/fdd 0 2024-09-20T20:31:43.275 INFO:tasks.workunit.client.0.smithi070.stdout:5/684: fsync d2/d4/d98/f9e 0 2024-09-20T20:31:43.275 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:43.276 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:43.279 INFO:tasks.workunit.client.0.smithi070.stdout:8/718: symlink d4/d27/d2a/d43/lf4 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:1/711: creat d4/d6/d11/d63/de7/d44/d4b/d87/f100 x:0 0 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:6/742: write d4/d8/d38/d50/fe8 [741285,103669] 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:9/694: chown d1/df/d25/d69/d85/dad/f94 32994927 1 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:5/685: mkdir d2/d7/d60/dbd/de6 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:6/743: stat d4/d8/d10 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:3/586: link d7/d15/d1a/d4a/f4d d7/d15/d1a/d4a/fbb 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:1/712: mknod d4/c101 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:8/719: write d4/d27/d42/f54 [8324416,51339] 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:6/744: write d4/d8/db4/db6/fca [416954,2533] 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:6/745: mkdir d4/d8/d1e/d7e/dd6/d109 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:6/746: readlink d4/d8/d10/d54/la1 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:1/713: write d4/d32/d60/dca/fff [4501389,129398] 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:9/695: link d1/df/d18/d44/d77/db8/lc7 d1/df/d18/d44/da2/dab/lfc 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:3/587: rename d7/d15/d1e/d65/f3c to d7/d15/d1a/d4a/d51/d5b/d9e/fbc 0 2024-09-20T20:31:43.280 INFO:tasks.workunit.client.0.smithi070.stdout:1/714: unlink d4/d32/de6/lf9 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:2/668: sync 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:0/687: sync 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:6/747: mkdir d4/d8/d17/d33/d61/d73/d10a 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:3/588: creat d7/d15/d1e/da9/fbd x:0 0 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:2/669: dread - d3/d5/d9/d79/f7b zero size 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:6/748: mknod d4/d8/d38/d50/c10b 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:1/715: symlink d4/d32/d60/dca/l102 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:5/686: dread d2/df/d40/f5d [0,4194304] 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:8/720: dwrite d4/d27/d73/fd7 [0,4194304] 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:1/716: chown d4/d32/d60/c9f 933 1 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:3/589: chown d7/d15/d1a/d48/d66/d69/f42 332362 1 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:1/717: fdatasync d4/f62 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:3/590: chown d7/d15/d1a/d48/d66 6266578 1 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:5/687: creat d2/d4/d98/d5b/fe7 x:0 0 0 2024-09-20T20:31:43.281 INFO:tasks.workunit.client.0.smithi070.stdout:0/688: link d4/d8/d12/d23/d26/d1d/d37/d38/f5c d4/d48/d7b/d8c/fd7 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:8/721: creat d4/db/d66/ff5 x:0 0 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:6/749: link d4/la3 d4/d8/d10/l10c 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:2/670: read - d3/d5/d9/feb zero size 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:1/718: creat d4/d6/d11/f103 x:0 0 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:3/591: mknod d7/d15/d1a/d48/d66/d69/d13/d1d/cbe 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:5/688: creat d2/d7/d60/dbd/fe8 x:0 0 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:6/750: readlink d4/d8/d10/d54/le1 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:8/722: fsync d4/db/d64/ff3 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:2/671: chown d3/d5/d9/d1c/d1f/d3e/d61/l9d 42857 1 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:2/672: dread - d3/de/d12/f7a zero size 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:1/719: link d4/d6/d11/d63/d6c/fbf d4/d6/d11/f104 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:1/720: rename d4/d32/dea/d3b/ca7 to d4/d32/de6/c105 0 2024-09-20T20:31:43.282 INFO:tasks.workunit.client.0.smithi070.stdout:6/751: dread d4/d8/f2f [0,4194304] 0 2024-09-20T20:31:43.283 INFO:tasks.workunit.client.0.smithi070.stdout:0/689: dwrite d4/d48/d67/da5/fd3 [0,4194304] 0 2024-09-20T20:31:43.283 INFO:tasks.workunit.client.0.smithi070.stdout:1/721: creat d4/d32/dea/d3b/f106 x:0 0 0 2024-09-20T20:31:43.283 INFO:tasks.workunit.client.0.smithi070.stdout:2/673: dwrite d3/d5/d9/d1c/d1f/d3e/d61/db2/fbc [0,4194304] 0 2024-09-20T20:31:43.283 INFO:tasks.workunit.client.0.smithi070.stdout:9/696: truncate d1/df/d25/d69/d85/d9f/db9/de3/de5/fe6 2121705 0 2024-09-20T20:31:43.283 INFO:tasks.workunit.client.0.smithi070.stdout:0/690: rename d4/d8/d12/d23/d26 to d4/d8/d55/dd8 0 2024-09-20T20:31:43.283 INFO:tasks.workunit.client.0.smithi070.stdout:1/722: readlink d4/d6/l1c 0 2024-09-20T20:31:43.283 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:43.284 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:4/666: dread d6/d7/f3b [0,4194304] 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:9/697: mknod d1/cfd 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:4/667: fsync d6/d43/f57 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:1/723: mknod d4/d32/dea/d3a/d9d/db7/c107 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:1/724: chown d4/d6/d11/d63/de7/d44/d4b/d87 1879605 1 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:1/725: fsync d4/d32/d60/f8e 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:3/592: truncate d7/d15/d1a/d48/d66/d69/d13/d1d/f34 1516542 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:2/674: mknod d3/d5/d9/d1c/d1f/d3e/d61/ced 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:0/691: getdents d4/d8/d55/dd8/d1d/d41 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:4/668: getdents d6/d26/d69 0 2024-09-20T20:31:43.286 INFO:tasks.workunit.client.0.smithi070.stdout:3/593: rename d7/d15/d1e/c1f to d7/d15/d1a/d4a/cbf 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:3/594: write d7/d15/d1a/d48/d66/d69/d13/d72/f73 [170573,124930] 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:5/689: dread f1 [0,4194304] 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:1/726: dwrite d4/d6/d11/d63/d6c/f85 [0,4194304] 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:1/727: readlink d4/d6/d11/d63/lf0 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:8/723: dread d4/d27/d2a/d5b/d6c/da6/fcc [0,4194304] 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:1/728: chown d4/d6/d11/d63/d6c/f85 1 1 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:5/690: creat d2/df/d40/da8/fe9 x:0 0 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:5/691: mkdir d2/dea 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:1/729: truncate d4/d6/d11/d63/de7/d44/d5a/fc1 1185313 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:5/692: rename d2/d4/d98/d5b/cc9 to d2/d4/d98/d4c/ceb 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:1/730: creat d4/d6/dae/f108 x:0 0 0 2024-09-20T20:31:43.287 INFO:tasks.workunit.client.0.smithi070.stdout:5/693: mkdir d2/d4/d98/dc7/da5/dec 0 2024-09-20T20:31:43.288 INFO:tasks.workunit.client.0.smithi070.stdout:3/595: dwrite d7/d15/d1a/d4a/f4d [4194304,4194304] 0 2024-09-20T20:31:43.288 INFO:tasks.workunit.client.0.smithi070.stdout:8/724: dwrite d4/db/d66/f84 [4194304,4194304] 0 2024-09-20T20:31:43.288 INFO:tasks.workunit.client.0.smithi070.stdout:6/752: dread d4/f23 [0,4194304] 0 2024-09-20T20:31:43.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/694: creat d2/d4/de/d47/d67/d92/de2/fed x:0 0 0 2024-09-20T20:31:43.289 INFO:tasks.workunit.client.0.smithi070.stdout:8/725: creat d4/db/d64/d95/ff6 x:0 0 0 2024-09-20T20:31:43.289 INFO:tasks.workunit.client.0.smithi070.stdout:3/596: getdents d7/d71 0 2024-09-20T20:31:43.290 INFO:tasks.workunit.client.0.smithi070.stdout:5/695: creat d2/d4/de/d47/d67/fee x:0 0 0 2024-09-20T20:31:43.290 INFO:tasks.workunit.client.0.smithi070.stdout:3/597: rmdir d7/d15/d1e 39 2024-09-20T20:31:43.291 INFO:tasks.workunit.client.0.smithi070.stdout:8/726: unlink d4/db/l47 0 2024-09-20T20:31:43.292 INFO:tasks.workunit.client.0.smithi070.stdout:8/727: fdatasync d4/d27/d42/f44 0 2024-09-20T20:31:43.293 INFO:tasks.workunit.client.0.smithi070.stdout:3/598: rmdir d7/d15/d1a/d48/d66 39 2024-09-20T20:31:43.293 INFO:tasks.workunit.client.0.smithi070.stdout:6/753: write d4/d8/d17/db2/db5/fde [125560,65445] 0 2024-09-20T20:31:43.295 INFO:tasks.workunit.client.0.smithi070.stdout:3/599: rmdir d7/d15/d1a/d48/d66/d69 39 2024-09-20T20:31:43.295 INFO:tasks.workunit.client.0.smithi070.stdout:8/728: dread - d4/d27/d2a/d5b/d98/da9/db5/ff2 zero size 2024-09-20T20:31:43.296 INFO:tasks.workunit.client.0.smithi070.stdout:6/754: link d4/d8/d17/d33/d61/f9b d4/d8/d1e/d7e/dd6/f10d 0 2024-09-20T20:31:43.297 INFO:tasks.workunit.client.0.smithi070.stdout:3/600: write d7/d15/d1a/d48/d66/d69/f24 [3092347,110776] 0 2024-09-20T20:31:43.298 INFO:tasks.workunit.client.0.smithi070.stdout:1/731: dwrite d4/d32/d60/dca/fe4 [0,4194304] 0 2024-09-20T20:31:43.299 INFO:tasks.workunit.client.0.smithi070.stdout:6/755: write d4/d8/d17/f31 [2514428,26346] 0 2024-09-20T20:31:43.300 INFO:tasks.workunit.client.0.smithi070.stdout:3/601: creat d7/d15/d1a/d48/d66/fc0 x:0 0 0 2024-09-20T20:31:43.301 INFO:tasks.workunit.client.0.smithi070.stdout:0/692: dread d4/d8/d12/d43/fc9 [0,4194304] 0 2024-09-20T20:31:43.302 INFO:tasks.workunit.client.0.smithi070.stdout:3/602: rename d7/d15/d1a/d4a/f94 to d7/d15/d1e/d60/fc1 0 2024-09-20T20:31:43.302 INFO:tasks.workunit.client.0.smithi070.stdout:0/693: unlink d4/d8/d55/dd8/d1d/d37/d38/fb7 0 2024-09-20T20:31:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:3/603: dwrite d7/d15/d1a/d48/d57/f70 [0,4194304] 0 2024-09-20T20:31:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:8/729: truncate d4/d27/d2a/d3e/f67 676744 0 2024-09-20T20:31:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:7/555: sync 2024-09-20T20:31:43.312 INFO:tasks.workunit.client.0.smithi070.stdout:1/732: truncate d4/d6/f14 1375672 0 2024-09-20T20:31:43.312 INFO:tasks.workunit.client.0.smithi070.stdout:5/696: dread d2/d4/f39 [0,4194304] 0 2024-09-20T20:31:43.312 INFO:tasks.workunit.client.0.smithi070.stdout:0/694: truncate d4/d8/f30 4898442 0 2024-09-20T20:31:43.312 INFO:tasks.workunit.client.0.smithi070.stdout:8/730: unlink d4/d27/d2a/d5b/d98/fad 0 2024-09-20T20:31:43.313 INFO:tasks.workunit.client.0.smithi070.stdout:7/556: write d2/d19/d25/d2a/f44 [1509245,43986] 0 2024-09-20T20:31:43.313 INFO:tasks.workunit.client.0.smithi070.stdout:0/695: chown d4/f16 1028 1 2024-09-20T20:31:43.313 INFO:tasks.workunit.client.0.smithi070.stdout:1/733: creat d4/d32/dea/d3a/d9d/db7/f109 x:0 0 0 2024-09-20T20:31:43.314 INFO:tasks.workunit.client.0.smithi070.stdout:7/557: readlink d2/d8/l2c 0 2024-09-20T20:31:43.314 INFO:tasks.workunit.client.0.smithi070.stdout:8/731: write d4/d27/d2a/d5b/d98/fa8 [1907949,87332] 0 2024-09-20T20:31:43.314 INFO:tasks.workunit.client.0.smithi070.stdout:1/734: stat d4/d32/dea/d3b/f74 0 2024-09-20T20:31:43.315 INFO:tasks.workunit.client.0.smithi070.stdout:0/696: unlink d4/d8/d55/dd8/d1f/f53 0 2024-09-20T20:31:43.315 INFO:tasks.workunit.client.0.smithi070.stdout:7/558: creat d2/d19/d7c/fab x:0 0 0 2024-09-20T20:31:43.315 INFO:tasks.workunit.client.0.smithi070.stdout:8/732: write d4/d27/d2a/d3e/f30 [446254,97714] 0 2024-09-20T20:31:43.315 INFO:tasks.workunit.client.0.smithi070.stdout:1/735: write d4/d6/dae/f108 [907773,28851] 0 2024-09-20T20:31:43.316 INFO:tasks.workunit.client.0.smithi070.stdout:7/559: mknod d2/d19/d7c/cac 0 2024-09-20T20:31:43.316 INFO:tasks.workunit.client.0.smithi070.stdout:0/697: write d4/d8/d55/dd8/d2d/fb1 [891207,16118] 0 2024-09-20T20:31:43.316 INFO:tasks.workunit.client.0.smithi070.stdout:8/733: readlink d4/d27/d2a/d3e/d39/ddf/lec 0 2024-09-20T20:31:43.317 INFO:tasks.workunit.client.0.smithi070.stdout:0/698: fsync d4/d8/d12/f25 0 2024-09-20T20:31:43.317 INFO:tasks.workunit.client.0.smithi070.stdout:8/734: fsync d4/db/d64/d7b/f8f 0 2024-09-20T20:31:43.318 INFO:tasks.workunit.client.0.smithi070.stdout:0/699: rmdir d4/d8/d55/d7c 39 2024-09-20T20:31:43.318 INFO:tasks.workunit.client.0.smithi070.stdout:1/736: link d4/d6/d11/f24 d4/d6/d11/d63/d6c/f10a 0 2024-09-20T20:31:43.318 INFO:tasks.workunit.client.0.smithi070.stdout:8/735: creat d4/d27/d2a/d3e/d31/d63/ff7 x:0 0 0 2024-09-20T20:31:43.318 INFO:tasks.workunit.client.0.smithi070.stdout:6/756: dread d4/d8/d17/d33/d36/f53 [4194304,4194304] 0 2024-09-20T20:31:43.319 INFO:tasks.workunit.client.0.smithi070.stdout:6/757: readlink d4/d8/d10/d54/dec/lf8 0 2024-09-20T20:31:43.323 INFO:tasks.workunit.client.0.smithi070.stdout:3/604: dread d7/d15/d1a/d48/d66/d69/f11 [0,4194304] 0 2024-09-20T20:31:43.325 INFO:tasks.workunit.client.0.smithi070.stdout:3/605: creat d7/d15/fc2 x:0 0 0 2024-09-20T20:31:43.325 INFO:tasks.workunit.client.0.smithi070.stdout:6/758: dwrite d4/d8/d3a/ffb [0,4194304] 0 2024-09-20T20:31:43.325 INFO:tasks.workunit.client.0.smithi070.stdout:6/759: chown d4 572045 1 2024-09-20T20:31:43.326 INFO:tasks.workunit.client.0.smithi070.stdout:7/560: truncate d2/d19/d25/d42/f5a 623709 0 2024-09-20T20:31:43.327 INFO:tasks.workunit.client.0.smithi070.stdout:7/561: mkdir d2/d30/dad 0 2024-09-20T20:31:43.328 INFO:tasks.workunit.client.0.smithi070.stdout:7/562: creat d2/d30/d63/d69/fae x:0 0 0 2024-09-20T20:31:43.329 INFO:tasks.workunit.client.0.smithi070.stdout:7/563: rename d2/d8/f33 to d2/d52/faf 0 2024-09-20T20:31:43.329 INFO:tasks.workunit.client.0.smithi070.stdout:8/736: write d4/db/f1b [3530649,5229] 0 2024-09-20T20:31:43.330 INFO:tasks.workunit.client.0.smithi070.stdout:7/564: creat d2/d19/d25/fb0 x:0 0 0 2024-09-20T20:31:43.331 INFO:tasks.workunit.client.0.smithi070.stdout:7/565: write d2/d19/d25/d42/d77/fa1 [954177,97499] 0 2024-09-20T20:31:43.333 INFO:tasks.workunit.client.0.smithi070.stdout:1/737: dread d4/d6/d11/d63/d6c/fbe [0,4194304] 0 2024-09-20T20:31:43.334 INFO:tasks.workunit.client.0.smithi070.stdout:1/738: symlink d4/d6/l10b 0 2024-09-20T20:31:43.335 INFO:tasks.workunit.client.0.smithi070.stdout:1/739: truncate d4/d32/dea/d3a/d9d/db7/ffd 5021680 0 2024-09-20T20:31:43.338 INFO:tasks.workunit.client.0.smithi070.stdout:7/566: truncate d2/d30/f59 316633 0 2024-09-20T20:31:43.339 INFO:tasks.workunit.client.0.smithi070.stdout:1/740: dread d4/d6/d11/d63/de7/d44/d48/f5e [4194304,4194304] 0 2024-09-20T20:31:43.339 INFO:tasks.workunit.client.0.smithi070.stdout:7/567: write d2/d19/d25/da2/fa4 [25578,89028] 0 2024-09-20T20:31:43.340 INFO:tasks.workunit.client.0.smithi070.stdout:6/760: dread d4/d8/d10/d54/f6b [0,4194304] 0 2024-09-20T20:31:43.340 INFO:tasks.workunit.client.0.smithi070.stdout:7/568: chown d2/d30/d63/f93 1 1 2024-09-20T20:31:43.341 INFO:tasks.workunit.client.0.smithi070.stdout:3/606: dread d7/d15/d1a/d48/d66/d69/d13/d1d/f34 [0,4194304] 0 2024-09-20T20:31:43.341 INFO:tasks.workunit.client.0.smithi070.stdout:1/741: mknod d4/d6/d11/d63/de7/d44/d4b/c10c 0 2024-09-20T20:31:43.341 INFO:tasks.workunit.client.0.smithi070.stdout:6/761: symlink d4/d8/d17/d33/l10e 0 2024-09-20T20:31:43.341 INFO:tasks.workunit.client.0.smithi070.stdout:7/569: creat d2/d19/d25/d61/fb1 x:0 0 0 2024-09-20T20:31:43.342 INFO:tasks.workunit.client.0.smithi070.stdout:1/742: creat d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f10d x:0 0 0 2024-09-20T20:31:43.342 INFO:tasks.workunit.client.0.smithi070.stdout:7/570: rmdir d2/d19/d25/d61/d95 0 2024-09-20T20:31:43.342 INFO:tasks.workunit.client.0.smithi070.stdout:6/762: creat d4/d8/d1e/d7e/dd6/d109/f10f x:0 0 0 2024-09-20T20:31:43.343 INFO:tasks.workunit.client.0.smithi070.stdout:6/763: stat d4/d8/d17/d33/d36/f37 0 2024-09-20T20:31:43.343 INFO:tasks.workunit.client.0.smithi070.stdout:6/764: mknod d4/d8/d38/c110 0 2024-09-20T20:31:43.344 INFO:tasks.workunit.client.0.smithi070.stdout:6/765: rename d4/f6 to d4/d8/d1e/f111 0 2024-09-20T20:31:43.345 INFO:tasks.workunit.client.0.smithi070.stdout:3/607: truncate d7/d15/d1a/d4a/fbb 1134023 0 2024-09-20T20:31:43.346 INFO:tasks.workunit.client.0.smithi070.stdout:3/608: link d7/d71/fb8 d7/d15/d1a/d80/fc3 0 2024-09-20T20:31:43.348 INFO:tasks.workunit.client.0.smithi070.stdout:3/609: chown d7/d15/d1a/d48/d66/d69/d13/d7a/l95 55 1 2024-09-20T20:31:43.348 INFO:tasks.workunit.client.0.smithi070.stdout:7/571: dwrite d2/d19/d25/f4c [0,4194304] 0 2024-09-20T20:31:43.350 INFO:tasks.workunit.client.0.smithi070.stdout:6/766: dwrite d4/d8/d17/d33/f52 [0,4194304] 0 2024-09-20T20:31:43.351 INFO:tasks.workunit.client.0.smithi070.stdout:3/610: symlink d7/d15/d1e/d65/d9d/lc4 0 2024-09-20T20:31:43.351 INFO:tasks.workunit.client.0.smithi070.stdout:7/572: rmdir d2/d19/d25/d61 39 2024-09-20T20:31:43.352 INFO:tasks.workunit.client.0.smithi070.stdout:6/767: unlink d4/df0/cd0 0 2024-09-20T20:31:43.353 INFO:tasks.workunit.client.0.smithi070.stdout:7/573: mknod d2/d30/d63/cb2 0 2024-09-20T20:31:43.353 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:43.349+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:43.354 INFO:tasks.workunit.client.0.smithi070.stdout:6/768: mkdir d4/d8/d17/d33/d61/d73/d10a/d112 0 2024-09-20T20:31:43.354 INFO:tasks.workunit.client.0.smithi070.stdout:7/574: creat d2/d19/d25/d2a/d4a/fb3 x:0 0 0 2024-09-20T20:31:43.354 INFO:tasks.workunit.client.0.smithi070.stdout:7/575: readlink d2/d8/l2c 0 2024-09-20T20:31:43.354 INFO:tasks.workunit.client.0.smithi070.stdout:6/769: write d4/d8/d10/fe7 [223961,115569] 0 2024-09-20T20:31:43.354 INFO:tasks.workunit.client.0.smithi070.stdout:7/576: mkdir d2/d30/d63/db4 0 2024-09-20T20:31:43.355 INFO:tasks.workunit.client.0.smithi070.stdout:6/770: write d4/d8/d17/f1a [2447123,41761] 0 2024-09-20T20:31:43.355 INFO:tasks.workunit.client.0.smithi070.stdout:7/577: creat d2/d19/d25/d42/d55/fb5 x:0 0 0 2024-09-20T20:31:43.357 INFO:tasks.workunit.client.0.smithi070.stdout:6/771: dread d4/d8/d10/d3c/f6a [4194304,4194304] 0 2024-09-20T20:31:43.358 INFO:tasks.workunit.client.0.smithi070.stdout:6/772: mknod d4/d8/d10/d54/db1/c113 0 2024-09-20T20:31:43.360 INFO:tasks.workunit.client.0.smithi070.stdout:6/773: rename d4/d8/d38/fdc to d4/d8/d10/d54/dec/f114 0 2024-09-20T20:31:43.360 INFO:tasks.workunit.client.0.smithi070.stdout:7/578: dwrite d2/d8/f18 [0,4194304] 0 2024-09-20T20:31:43.361 INFO:tasks.workunit.client.0.smithi070.stdout:7/579: chown d2/d30/c7b 123153580 1 2024-09-20T20:31:43.363 INFO:tasks.workunit.client.0.smithi070.stdout:7/580: creat d2/d8/fb6 x:0 0 0 2024-09-20T20:31:43.363 INFO:tasks.workunit.client.0.smithi070.stdout:6/774: dread d4/d8/d17/f31 [0,4194304] 0 2024-09-20T20:31:43.364 INFO:tasks.workunit.client.0.smithi070.stdout:6/775: creat d4/d8/d10/f115 x:0 0 0 2024-09-20T20:31:43.365 INFO:tasks.workunit.client.0.smithi070.stdout:6/776: write d4/d8/d1e/d7e/fd3 [1167860,79998] 0 2024-09-20T20:31:43.366 INFO:tasks.workunit.client.0.smithi070.stdout:6/777: fdatasync d4/d8/d10/f92 0 2024-09-20T20:31:43.366 INFO:tasks.workunit.client.0.smithi070.stdout:6/778: fsync d4/d8/d1e/d7e/fac 0 2024-09-20T20:31:43.367 INFO:tasks.workunit.client.0.smithi070.stdout:6/779: creat d4/d8/d38/f116 x:0 0 0 2024-09-20T20:31:43.371 INFO:tasks.workunit.client.0.smithi070.stdout:6/780: getdents d4/d8/d17/d33/d61/d73/d10a 0 2024-09-20T20:31:43.375 INFO:tasks.workunit.client.0.smithi070.stdout:6/781: dread d4/d8/d17/d33/f52 [0,4194304] 0 2024-09-20T20:31:43.377 INFO:tasks.workunit.client.0.smithi070.stdout:9/698: sync 2024-09-20T20:31:43.380 INFO:tasks.workunit.client.0.smithi070.stdout:6/782: dwrite d4/d8/d1e/f26 [0,4194304] 0 2024-09-20T20:31:43.381 INFO:tasks.workunit.client.0.smithi070.stdout:6/783: mknod d4/d8/d17/db2/deb/c117 0 2024-09-20T20:31:43.382 INFO:tasks.workunit.client.0.smithi070.stdout:6/784: creat d4/d8/d38/d50/f118 x:0 0 0 2024-09-20T20:31:43.383 INFO:tasks.workunit.client.0.smithi070.stdout:7/581: dread d2/d19/d25/d2a/f44 [4194304,4194304] 0 2024-09-20T20:31:43.385 INFO:tasks.workunit.client.0.smithi070.stdout:7/582: creat d2/d30/d63/d69/fb7 x:0 0 0 2024-09-20T20:31:43.385 INFO:tasks.workunit.client.0.smithi070.stdout:7/583: creat d2/d30/d63/db4/fb8 x:0 0 0 2024-09-20T20:31:43.386 INFO:tasks.workunit.client.0.smithi070.stdout:7/584: write d2/d8/f1d [4879144,47567] 0 2024-09-20T20:31:43.387 INFO:tasks.workunit.client.0.smithi070.stdout:7/585: getdents d2/d52 0 2024-09-20T20:31:43.387 INFO:tasks.workunit.client.0.smithi070.stdout:7/586: dread - d2/d19/d25/d61/fb1 zero size 2024-09-20T20:31:43.388 INFO:tasks.workunit.client.0.smithi070.stdout:6/785: truncate d4/d8/d17/d33/f52 2429011 0 2024-09-20T20:31:43.392 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:43.392 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:43.393 INFO:tasks.workunit.client.0.smithi070.stdout:7/587: dwrite d2/d19/d25/d61/fb1 [0,4194304] 0 2024-09-20T20:31:43.393 INFO:tasks.workunit.client.0.smithi070.stdout:7/588: chown d2/d19/d25/d2a/l97 822027 1 2024-09-20T20:31:43.393 INFO:tasks.workunit.client.0.smithi070.stdout:6/786: dwrite d4/d8/d1e/db7/f105 [0,4194304] 0 2024-09-20T20:31:43.395 INFO:tasks.workunit.client.0.smithi070.stdout:7/589: creat d2/d19/d25/d2a/d4a/fb9 x:0 0 0 2024-09-20T20:31:43.400 INFO:tasks.workunit.client.0.smithi070.stdout:6/787: dwrite d4/d8/d1e/fc3 [0,4194304] 0 2024-09-20T20:31:43.401 INFO:tasks.workunit.client.0.smithi070.stdout:6/788: chown d4/d8/d17/d33/d36/ddb 0 1 2024-09-20T20:31:43.402 INFO:tasks.workunit.client.0.smithi070.stdout:6/789: unlink d4/d8/d17/d33/d36/l8a 0 2024-09-20T20:31:43.402 INFO:tasks.workunit.client.0.smithi070.stdout:6/790: creat d4/df0/f119 x:0 0 0 2024-09-20T20:31:43.402 INFO:tasks.workunit.client.0.smithi070.stdout:6/791: mkdir d4/df0/d11a 0 2024-09-20T20:31:43.405 INFO:tasks.workunit.client.0.smithi070.stdout:6/792: link d4/d8/d3a/c107 d4/d8/d10/d54/db1/c11b 0 2024-09-20T20:31:43.406 INFO:tasks.workunit.client.0.smithi070.stdout:6/793: chown d4/d8/d10/d3c/d99 1248250 1 2024-09-20T20:31:43.406 INFO:tasks.workunit.client.0.smithi070.stdout:6/794: chown d4/d8/d1e/fe2 44 1 2024-09-20T20:31:43.407 INFO:tasks.workunit.client.0.smithi070.stdout:6/795: truncate f0 924809 0 2024-09-20T20:31:43.408 INFO:tasks.workunit.client.0.smithi070.stdout:6/796: write d4/d8/d10/d54/dec/fad [1758462,23194] 0 2024-09-20T20:31:43.413 INFO:tasks.workunit.client.0.smithi070.stdout:7/590: dread d2/f1b [0,4194304] 0 2024-09-20T20:31:43.414 INFO:tasks.workunit.client.0.smithi070.stdout:6/797: write d4/d8/d17/d33/d36/f63 [2052597,114336] 0 2024-09-20T20:31:43.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:43.415 INFO:tasks.workunit.client.0.smithi070.stdout:6/798: creat d4/d8/d17/f11c x:0 0 0 2024-09-20T20:31:43.415 INFO:tasks.workunit.client.0.smithi070.stdout:6/799: rename d4/d8/d1e/f5b to d4/d8/d1e/d7e/dd6/f11d 0 2024-09-20T20:31:43.416 INFO:tasks.workunit.client.0.smithi070.stdout:6/800: creat d4/d8/d1e/db7/f11e x:0 0 0 2024-09-20T20:31:43.416 INFO:tasks.workunit.client.0.smithi070.stdout:6/801: chown d4/d8/d68/l87 0 1 2024-09-20T20:31:43.418 INFO:tasks.workunit.client.0.smithi070.stdout:6/802: rename d4/d8/d10/d54/db1/c11b to d4/d8/d17/c11f 0 2024-09-20T20:31:43.418 INFO:tasks.workunit.client.0.smithi070.stdout:6/803: creat d4/d8/d38/f120 x:0 0 0 2024-09-20T20:31:43.419 INFO:tasks.workunit.client.0.smithi070.stdout:6/804: rename d4/d8/d17/db2/db5/fde to d4/d8/d17/d33/d61/d73/f121 0 2024-09-20T20:31:43.419 INFO:tasks.workunit.client.0.smithi070.stdout:6/805: creat d4/d8/d10/d54/d7a/f122 x:0 0 0 2024-09-20T20:31:43.420 INFO:tasks.workunit.client.0.smithi070.stdout:6/806: dread - d4/d8/d17/d33/d61/d73/fae zero size 2024-09-20T20:31:43.420 INFO:tasks.workunit.client.0.smithi070.stdout:6/807: read d4/d8/d10/fe7 [282840,104909] 0 2024-09-20T20:31:43.421 INFO:tasks.workunit.client.0.smithi070.stdout:7/591: truncate d2/f35 5872689 0 2024-09-20T20:31:43.425 INFO:tasks.workunit.client.0.smithi070.stdout:4/669: sync 2024-09-20T20:31:43.425 INFO:tasks.workunit.client.0.smithi070.stdout:2/675: sync 2024-09-20T20:31:43.426 INFO:tasks.workunit.client.0.smithi070.stdout:4/670: write d6/d5e/d51/d78/fc7 [151567,100232] 0 2024-09-20T20:31:43.426 INFO:tasks.workunit.client.0.smithi070.stdout:2/676: write d3/d5/d9/d1c/d1f/fb3 [1757218,98763] 0 2024-09-20T20:31:43.427 INFO:tasks.workunit.client.0.smithi070.stdout:2/677: mknod d3/d5/dd/d99/cee 0 2024-09-20T20:31:43.427 INFO:tasks.workunit.client.0.smithi070.stdout:2/678: write d3/f4a [63377,72641] 0 2024-09-20T20:31:43.428 INFO:tasks.workunit.client.0.smithi070.stdout:7/592: dread d2/d19/f27 [0,4194304] 0 2024-09-20T20:31:43.429 INFO:tasks.workunit.client.0.smithi070.stdout:7/593: symlink d2/d19/d25/d2a/d5c/lba 0 2024-09-20T20:31:43.431 INFO:tasks.workunit.client.0.smithi070.stdout:7/594: dread d2/f26 [0,4194304] 0 2024-09-20T20:31:43.432 INFO:tasks.workunit.client.0.smithi070.stdout:4/671: dwrite d6/d5e/d51/d78/f93 [0,4194304] 0 2024-09-20T20:31:43.433 INFO:tasks.workunit.client.0.smithi070.stdout:7/595: creat d2/d19/d25/da2/fbb x:0 0 0 2024-09-20T20:31:43.433 INFO:tasks.workunit.client.0.smithi070.stdout:2/679: dwrite d3/de/d12/f7a [0,4194304] 0 2024-09-20T20:31:43.434 INFO:tasks.workunit.client.0.smithi070.stdout:4/672: symlink d6/d5e/d51/ld2 0 2024-09-20T20:31:43.434 INFO:tasks.workunit.client.0.smithi070.stdout:7/596: fdatasync d2/d19/d25/f86 0 2024-09-20T20:31:43.437 INFO:tasks.workunit.client.0.smithi070.stdout:7/597: symlink d2/d19/d25/lbc 0 2024-09-20T20:31:43.437 INFO:tasks.workunit.client.0.smithi070.stdout:7/598: write d2/d8/f1d [3336673,16223] 0 2024-09-20T20:31:43.438 INFO:tasks.workunit.client.0.smithi070.stdout:7/599: unlink d2/d19/d25/d42/d77/f8b 0 2024-09-20T20:31:43.439 INFO:tasks.workunit.client.0.smithi070.stdout:7/600: mknod d2/d19/d25/d42/cbd 0 2024-09-20T20:31:43.440 INFO:tasks.workunit.client.0.smithi070.stdout:7/601: mkdir d2/d19/dbe 0 2024-09-20T20:31:43.440 INFO:tasks.workunit.client.0.smithi070.stdout:2/680: dwrite d3/d5/d9/d10/f11 [0,4194304] 0 2024-09-20T20:31:43.440 INFO:tasks.workunit.client.0.smithi070.stdout:7/602: unlink c0 0 2024-09-20T20:31:43.441 INFO:tasks.workunit.client.0.smithi070.stdout:2/681: stat d3/d5/d9/d1c/d4e/lbb 0 2024-09-20T20:31:43.441 INFO:tasks.workunit.client.0.smithi070.stdout:7/603: write d2/d52/f6d [2376992,1902] 0 2024-09-20T20:31:43.444 INFO:tasks.workunit.client.0.smithi070.stdout:2/682: dread d3/de/d12/f7d [0,4194304] 0 2024-09-20T20:31:43.445 INFO:tasks.workunit.client.0.smithi070.stdout:2/683: symlink d3/de/lef 0 2024-09-20T20:31:43.445 INFO:tasks.workunit.client.0.smithi070.stdout:4/673: write d6/f86 [5017697,2737] 0 2024-09-20T20:31:43.445 INFO:tasks.workunit.client.0.smithi070.stdout:2/684: readlink d3/de/lef 0 2024-09-20T20:31:43.446 INFO:tasks.workunit.client.0.smithi070.stdout:2/685: write d3/d5/d9/d42/f59 [6669583,62319] 0 2024-09-20T20:31:43.446 INFO:tasks.workunit.client.0.smithi070.stdout:4/674: write d6/d26/d69/d71/f79 [1397546,54456] 0 2024-09-20T20:31:43.446 INFO:tasks.workunit.client.0.smithi070.stdout:7/604: truncate d2/d19/f1a 2808197 0 2024-09-20T20:31:43.447 INFO:tasks.workunit.client.0.smithi070.stdout:4/675: mkdir d6/d5e/d6b/d74/dd3 0 2024-09-20T20:31:43.447 INFO:tasks.workunit.client.0.smithi070.stdout:7/605: rename d2/d19/f4d to d2/d30/d78/fbf 0 2024-09-20T20:31:43.447 INFO:tasks.workunit.client.0.smithi070.stdout:2/686: creat d3/d5/d9/d1c/d1f/d3e/d61/db2/ff0 x:0 0 0 2024-09-20T20:31:43.447 INFO:tasks.workunit.client.0.smithi070.stdout:7/606: mknod d2/d19/cc0 0 2024-09-20T20:31:43.448 INFO:tasks.workunit.client.0.smithi070.stdout:4/676: link d6/d5e/d75/f28 d6/d26/d97/fd4 0 2024-09-20T20:31:43.452 INFO:tasks.workunit.client.0.smithi070.stdout:7/607: dwrite d2/d30/d63/d69/fae [0,4194304] 0 2024-09-20T20:31:43.454 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:43.447+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:43.455 INFO:tasks.workunit.client.0.smithi070.stdout:7/608: creat d2/d30/d63/fc1 x:0 0 0 2024-09-20T20:31:43.455 INFO:tasks.workunit.client.0.smithi070.stdout:7/609: creat d2/d19/d2e/fc2 x:0 0 0 2024-09-20T20:31:43.458 INFO:tasks.workunit.client.0.smithi070.stdout:7/610: dread d2/d8/f3b [0,4194304] 0 2024-09-20T20:31:43.459 INFO:tasks.workunit.client.0.smithi070.stdout:7/611: rename d2/f26 to d2/d65/fc3 0 2024-09-20T20:31:43.459 INFO:tasks.workunit.client.0.smithi070.stdout:7/612: mknod d2/d30/cc4 0 2024-09-20T20:31:43.460 INFO:tasks.workunit.client.0.smithi070.stdout:7/613: creat d2/d19/d25/d2a/d5c/fc5 x:0 0 0 2024-09-20T20:31:43.461 INFO:tasks.workunit.client.0.smithi070.stdout:7/614: link d2/d8/l23 d2/d19/d25/d61/lc6 0 2024-09-20T20:31:43.461 INFO:tasks.workunit.client.0.smithi070.stdout:7/615: readlink d2/d8/l23 0 2024-09-20T20:31:43.462 INFO:tasks.workunit.client.0.smithi070.stdout:7/616: rmdir d2/d19/d25/d2a/d5c 39 2024-09-20T20:31:43.462 INFO:tasks.workunit.client.0.smithi070.stdout:7/617: creat d2/d52/fc7 x:0 0 0 2024-09-20T20:31:43.463 INFO:tasks.workunit.client.0.smithi070.stdout:7/618: stat d2/d19/d25/da2/fbb 0 2024-09-20T20:31:43.464 INFO:tasks.workunit.client.0.smithi070.stdout:7/619: mknod d2/d30/d78/cc8 0 2024-09-20T20:31:43.464 INFO:tasks.workunit.client.0.smithi070.stdout:4/677: dread d6/d7/f59 [4194304,4194304] 0 2024-09-20T20:31:43.465 INFO:tasks.workunit.client.0.smithi070.stdout:4/678: write d6/d26/f27 [8775760,73368] 0 2024-09-20T20:31:43.465 INFO:tasks.workunit.client.0.smithi070.stdout:7/620: rename d2/d19/d25/d42/c8d to d2/d30/d63/db4/cc9 0 2024-09-20T20:31:43.465 INFO:tasks.workunit.client.0.smithi070.stdout:7/621: chown d2/d30/f59 33 1 2024-09-20T20:31:43.470 INFO:tasks.workunit.client.0.smithi070.stdout:7/622: dwrite d2/d19/d2e/f41 [0,4194304] 0 2024-09-20T20:31:43.471 INFO:tasks.workunit.client.0.smithi070.stdout:7/623: mknod d2/cca 0 2024-09-20T20:31:43.472 INFO:tasks.workunit.client.0.smithi070.stdout:7/624: creat d2/d8/fcb x:0 0 0 2024-09-20T20:31:43.474 INFO:tasks.workunit.client.0.smithi070.stdout:7/625: link d2/d8/f18 d2/d30/dad/fcc 0 2024-09-20T20:31:43.474 INFO:tasks.workunit.client.0.smithi070.stdout:7/626: unlink d2/d19/d25/d42/d55/c89 0 2024-09-20T20:31:43.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/679: write d6/d5e/d75/d40/f56 [748892,2391] 0 2024-09-20T20:31:43.475 INFO:tasks.workunit.client.0.smithi070.stdout:4/680: readlink d6/d7/dc/d4a/lb8 0 2024-09-20T20:31:43.476 INFO:tasks.workunit.client.0.smithi070.stdout:4/681: rename d6/d5e/d6b/d74/l7b to d6/d5e/d51/dc8/ld5 0 2024-09-20T20:31:43.476 INFO:tasks.workunit.client.0.smithi070.stdout:4/682: chown d6/d7/dc/d4a 253924 1 2024-09-20T20:31:43.477 INFO:tasks.workunit.client.0.smithi070.stdout:4/683: symlink d6/d5e/d6b/d74/dd3/ld6 0 2024-09-20T20:31:43.478 INFO:tasks.workunit.client.0.smithi070.stdout:4/684: fdatasync d6/d5e/d75/f21 0 2024-09-20T20:31:43.478 INFO:tasks.workunit.client.0.smithi070.stdout:7/627: truncate d2/d19/d2e/f41 4112735 0 2024-09-20T20:31:43.479 INFO:tasks.workunit.client.0.smithi070.stdout:4/685: truncate d6/d5e/d75/f2d 265070 0 2024-09-20T20:31:43.479 INFO:tasks.workunit.client.0.smithi070.stdout:4/686: stat d6/d5e/d51/d63/fcd 0 2024-09-20T20:31:43.479 INFO:tasks.workunit.client.0.smithi070.stdout:7/628: symlink d2/d19/d25/d2a/lcd 0 2024-09-20T20:31:43.480 INFO:tasks.workunit.client.0.smithi070.stdout:7/629: write d2/d19/d7c/fab [877618,35855] 0 2024-09-20T20:31:43.481 INFO:tasks.workunit.client.0.smithi070.stdout:7/630: symlink d2/d30/d63/lce 0 2024-09-20T20:31:43.481 INFO:tasks.workunit.client.0.smithi070.stdout:4/687: read d6/d7/dc/f8a [862848,61067] 0 2024-09-20T20:31:43.482 INFO:tasks.workunit.client.0.smithi070.stdout:4/688: rename d6/d5e/d75/d61 to d6/d26/dd7 0 2024-09-20T20:31:43.483 INFO:tasks.workunit.client.0.smithi070.stdout:4/689: rmdir d6/d5e 39 2024-09-20T20:31:43.483 INFO:tasks.workunit.client.0.smithi070.stdout:5/697: sync 2024-09-20T20:31:43.483 INFO:tasks.workunit.client.0.smithi070.stdout:3/611: sync 2024-09-20T20:31:43.484 INFO:tasks.workunit.client.0.smithi070.stdout:0/700: sync 2024-09-20T20:31:43.484 INFO:tasks.workunit.client.0.smithi070.stdout:8/737: sync 2024-09-20T20:31:43.484 INFO:tasks.workunit.client.0.smithi070.stdout:6/808: sync 2024-09-20T20:31:43.484 INFO:tasks.workunit.client.0.smithi070.stdout:1/743: sync 2024-09-20T20:31:43.484 INFO:tasks.workunit.client.0.smithi070.stdout:9/699: sync 2024-09-20T20:31:43.484 INFO:tasks.workunit.client.0.smithi070.stdout:2/687: sync 2024-09-20T20:31:43.484 INFO:tasks.workunit.client.0.smithi070.stdout:2/688: readlink d3/d5/d9/la6 0 2024-09-20T20:31:43.484 INFO:tasks.workunit.client.0.smithi070.stdout:4/690: link d6/d26/d69/d71/d4c/f8f d6/d7/dc/d20/fd8 0 2024-09-20T20:31:43.485 INFO:tasks.workunit.client.0.smithi070.stdout:1/744: fsync d4/d6/d11/d63/de7/d44/f55 0 2024-09-20T20:31:43.485 INFO:tasks.workunit.client.0.smithi070.stdout:6/809: symlink d4/d8/d3a/da7/l123 0 2024-09-20T20:31:43.485 INFO:tasks.workunit.client.0.smithi070.stdout:0/701: fdatasync d4/d8/d55/dd8/d1d/d41/f97 0 2024-09-20T20:31:43.485 INFO:tasks.workunit.client.0.smithi070.stdout:3/612: creat d7/d15/d1a/d4a/fc5 x:0 0 0 2024-09-20T20:31:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:1/745: rmdir d4 39 2024-09-20T20:31:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:9/700: rmdir d1/df/d25/d69/d85/d9f/db9/de3/df3 0 2024-09-20T20:31:43.486 INFO:tasks.workunit.client.0.smithi070.stdout:2/689: truncate d3/d5/d9/d10/fd9 1043563 0 2024-09-20T20:31:43.487 INFO:tasks.workunit.client.0.smithi070.stdout:3/613: unlink d7/d15/d1a/c43 0 2024-09-20T20:31:43.487 INFO:tasks.workunit.client.0.smithi070.stdout:5/698: link d2/d4/d98/d4c/ceb d2/d4/d98/cef 0 2024-09-20T20:31:43.487 INFO:tasks.workunit.client.0.smithi070.stdout:6/810: creat d4/d8/f124 x:0 0 0 2024-09-20T20:31:43.488 INFO:tasks.workunit.client.0.smithi070.stdout:5/699: readlink d2/df/l2a 0 2024-09-20T20:31:43.488 INFO:tasks.workunit.client.0.smithi070.stdout:1/746: write d4/d32/dea/d3b/f74 [1397948,98671] 0 2024-09-20T20:31:43.489 INFO:tasks.workunit.client.0.smithi070.stdout:6/811: fsync d4/d8/d10/d54/f6b 0 2024-09-20T20:31:43.491 INFO:tasks.workunit.client.0.smithi070.stdout:5/700: creat d2/d4/de/d47/d67/ff0 x:0 0 0 2024-09-20T20:31:43.492 INFO:tasks.workunit.client.0.smithi070.stdout:8/738: dwrite d4/d27/d2a/d43/d61/f62 [4194304,4194304] 0 2024-09-20T20:31:43.493 INFO:tasks.workunit.client.0.smithi070.stdout:0/702: dwrite f2 [0,4194304] 0 2024-09-20T20:31:43.494 INFO:tasks.workunit.client.0.smithi070.stdout:4/691: truncate d6/d7/dc/d20/fd8 610927 0 2024-09-20T20:31:43.495 INFO:tasks.workunit.client.0.smithi070.stdout:7/631: unlink d2/d19/d25/da2/fa7 0 2024-09-20T20:31:43.495 INFO:tasks.workunit.client.0.smithi070.stdout:8/739: creat d4/d27/d2a/d5b/d6c/da6/ff8 x:0 0 0 2024-09-20T20:31:43.495 INFO:tasks.workunit.client.0.smithi070.stdout:0/703: mknod d4/d48/cd9 0 2024-09-20T20:31:43.495 INFO:tasks.workunit.client.0.smithi070.stdout:8/740: stat d4/d27/d73 0 2024-09-20T20:31:43.496 INFO:tasks.workunit.client.0.smithi070.stdout:9/701: dwrite d1/df/d25/d9e/fa4 [0,4194304] 0 2024-09-20T20:31:43.496 INFO:tasks.workunit.client.0.smithi070.stdout:7/632: symlink d2/d30/d63/d69/lcf 0 2024-09-20T20:31:43.497 INFO:tasks.workunit.client.0.smithi070.stdout:0/704: chown d4/d48/d4e/f90 38 1 2024-09-20T20:31:43.497 INFO:tasks.workunit.client.0.smithi070.stdout:4/692: read d6/d26/f90 [140971,115686] 0 2024-09-20T20:31:43.498 INFO:tasks.workunit.client.0.smithi070.stdout:7/633: chown d2/d8/f64 0 1 2024-09-20T20:31:43.498 INFO:tasks.workunit.client.0.smithi070.stdout:9/702: write d1/df/d25/f58 [909683,116349] 0 2024-09-20T20:31:43.498 INFO:tasks.workunit.client.0.smithi070.stdout:8/741: write d4/db/fc9 [957862,20791] 0 2024-09-20T20:31:43.498 INFO:tasks.workunit.client.0.smithi070.stdout:4/693: mknod d6/d26/cd9 0 2024-09-20T20:31:43.498 INFO:tasks.workunit.client.0.smithi070.stdout:0/705: mknod d4/d8/cda 0 2024-09-20T20:31:43.498 INFO:tasks.workunit.client.0.smithi070.stdout:7/634: mkdir d2/d19/dbe/dd0 0 2024-09-20T20:31:43.500 INFO:tasks.workunit.client.0.smithi070.stdout:8/742: creat d4/d27/d2a/d43/de7/ff9 x:0 0 0 2024-09-20T20:31:43.500 INFO:tasks.workunit.client.0.smithi070.stdout:7/635: mknod d2/d30/d63/d69/cd1 0 2024-09-20T20:31:43.501 INFO:tasks.workunit.client.0.smithi070.stdout:0/706: write d4/d8/d12/d43/d3b/da9/fc1 [636709,102953] 0 2024-09-20T20:31:43.502 INFO:tasks.workunit.client.0.smithi070.stdout:2/690: truncate d3/de/f6d 2271205 0 2024-09-20T20:31:43.502 INFO:tasks.workunit.client.0.smithi070.stdout:7/636: unlink d2/d52/faf 0 2024-09-20T20:31:43.502 INFO:tasks.workunit.client.0.smithi070.stdout:1/747: write d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f5f [1692573,26000] 0 2024-09-20T20:31:43.502 INFO:tasks.workunit.client.0.smithi070.stdout:8/743: write d4/db/fc9 [475903,88160] 0 2024-09-20T20:31:43.503 INFO:tasks.workunit.client.0.smithi070.stdout:2/691: write d3/d5/d9/d1c/d1f/d3e/d61/fc3 [748655,43690] 0 2024-09-20T20:31:43.503 INFO:tasks.workunit.client.0.smithi070.stdout:0/707: fsync d4/d8/d55/dd8/d1d/d41/fba 0 2024-09-20T20:31:43.504 INFO:tasks.workunit.client.0.smithi070.stdout:7/637: unlink d2/d19/d2e/fc2 0 2024-09-20T20:31:43.504 INFO:tasks.workunit.client.0.smithi070.stdout:0/708: chown d4/d48/d4e/d81 6412071 1 2024-09-20T20:31:43.505 INFO:tasks.workunit.client.0.smithi070.stdout:4/694: dwrite d6/d5e/f33 [0,4194304] 0 2024-09-20T20:31:43.505 INFO:tasks.workunit.client.0.smithi070.stdout:7/638: chown d2/d8/f47 640 1 2024-09-20T20:31:43.505 INFO:tasks.workunit.client.0.smithi070.stdout:2/692: getdents d3/d5/d9/d42 0 2024-09-20T20:31:43.506 INFO:tasks.workunit.client.0.smithi070.stdout:0/709: creat d4/d48/d7b/fdb x:0 0 0 2024-09-20T20:31:43.508 INFO:tasks.workunit.client.0.smithi070.stdout:2/693: readlink d3/d5/d9/d79/la5 0 2024-09-20T20:31:43.508 INFO:tasks.workunit.client.0.smithi070.stdout:0/710: creat d4/d48/d67/da5/fdc x:0 0 0 2024-09-20T20:31:43.509 INFO:tasks.workunit.client.0.smithi070.stdout:4/695: creat d6/d26/fda x:0 0 0 2024-09-20T20:31:43.509 INFO:tasks.workunit.client.0.smithi070.stdout:8/744: dwrite d4/fc7 [0,4194304] 0 2024-09-20T20:31:43.509 INFO:tasks.workunit.client.0.smithi070.stdout:5/701: write d2/d4/de/d47/d67/d92/f84 [512979,2541] 0 2024-09-20T20:31:43.509 INFO:tasks.workunit.client.0.smithi070.stdout:3/614: dwrite d7/d15/d1a/d48/d66/d69/f42 [4194304,4194304] 0 2024-09-20T20:31:43.510 INFO:tasks.workunit.client.0.smithi070.stdout:7/639: write d2/d19/d25/d2a/d5c/f72 [1523717,43565] 0 2024-09-20T20:31:43.512 INFO:tasks.workunit.client.0.smithi070.stdout:9/703: dread d1/df/d18/d46/fbe [0,4194304] 0 2024-09-20T20:31:43.513 INFO:tasks.workunit.client.0.smithi070.stdout:3/615: write d7/d15/d1a/f4e [4356779,96853] 0 2024-09-20T20:31:43.513 INFO:tasks.workunit.client.0.smithi070.stdout:5/702: creat d2/d7/d60/dbd/dcd/ff1 x:0 0 0 2024-09-20T20:31:43.513 INFO:tasks.workunit.client.0.smithi070.stdout:0/711: creat d4/d8/d12/d43/dd5/fdd x:0 0 0 2024-09-20T20:31:43.514 INFO:tasks.workunit.client.0.smithi070.stdout:8/745: link d4/db/f16 d4/d27/ffa 0 2024-09-20T20:31:43.515 INFO:tasks.workunit.client.0.smithi070.stdout:7/640: rename d2/d30/d63/f66 to d2/d19/d25/d2a/d4a/fd2 0 2024-09-20T20:31:43.516 INFO:tasks.workunit.client.0.smithi070.stdout:8/746: write d4/d27/d2a/d5b/d98/da9/db5/dc0/fc3 [2083016,38853] 0 2024-09-20T20:31:43.516 INFO:tasks.workunit.client.0.smithi070.stdout:5/703: rmdir d2/d7/d88 39 2024-09-20T20:31:43.516 INFO:tasks.workunit.client.0.smithi070.stdout:2/694: dwrite d3/d5/dd/d99/dae/fb0 [0,4194304] 0 2024-09-20T20:31:43.517 INFO:tasks.workunit.client.0.smithi070.stdout:9/704: creat d1/df/d25/d69/d85/ffe x:0 0 0 2024-09-20T20:31:43.518 INFO:tasks.workunit.client.0.smithi070.stdout:5/704: mknod d2/d4/d98/dc7/da5/cf2 0 2024-09-20T20:31:43.519 INFO:tasks.workunit.client.0.smithi070.stdout:9/705: fsync d1/df/d25/d69/f6a 0 2024-09-20T20:31:43.519 INFO:tasks.workunit.client.0.smithi070.stdout:2/695: symlink d3/d5/d9/d1c/dda/lf1 0 2024-09-20T20:31:43.520 INFO:tasks.workunit.client.0.smithi070.stdout:0/712: rename d4/d8/d12/d43/d9b/f9c to d4/d48/d7b/d8c/dce/fde 0 2024-09-20T20:31:43.520 INFO:tasks.workunit.client.0.smithi070.stdout:5/705: write d2/d4/de/d47/d67/f9a [999024,130157] 0 2024-09-20T20:31:43.520 INFO:tasks.workunit.client.0.smithi070.stdout:4/696: dwrite d6/d26/d69/d71/f7e [4194304,4194304] 0 2024-09-20T20:31:43.522 INFO:tasks.workunit.client.0.smithi070.stdout:2/696: write d3/d5/d9/f29 [1753147,119814] 0 2024-09-20T20:31:43.523 INFO:tasks.workunit.client.0.smithi070.stdout:4/697: fdatasync d6/d7/dc/d4a/d81/fa3 0 2024-09-20T20:31:43.523 INFO:tasks.workunit.client.0.smithi070.stdout:9/706: creat d1/df/d25/fff x:0 0 0 2024-09-20T20:31:43.523 INFO:tasks.workunit.client.0.smithi070.stdout:5/706: dread - d2/d7/d60/dbd/dcd/ff1 zero size 2024-09-20T20:31:43.523 INFO:tasks.workunit.client.0.smithi070.stdout:4/698: unlink d6/d26/f27 0 2024-09-20T20:31:43.523 INFO:tasks.workunit.client.0.smithi070.stdout:8/747: dread d4/db/d66/f84 [4194304,4194304] 0 2024-09-20T20:31:43.524 INFO:tasks.workunit.client.0.smithi070.stdout:4/699: chown d6/d5e/l53 1945478 1 2024-09-20T20:31:43.524 INFO:tasks.workunit.client.0.smithi070.stdout:5/707: symlink d2/df/lf3 0 2024-09-20T20:31:43.525 INFO:tasks.workunit.client.0.smithi070.stdout:4/700: write d6/d26/fb2 [837770,68626] 0 2024-09-20T20:31:43.525 INFO:tasks.workunit.client.0.smithi070.stdout:6/812: dread d4/d8/f28 [0,4194304] 0 2024-09-20T20:31:43.525 INFO:tasks.workunit.client.0.smithi070.stdout:8/748: mkdir d4/db/d64/d95/da5/dfb 0 2024-09-20T20:31:43.525 INFO:tasks.workunit.client.0.smithi070.stdout:2/697: rename d3/d4c/d5c/db7 to d3/de/d12/df2 0 2024-09-20T20:31:43.526 INFO:tasks.workunit.client.0.smithi070.stdout:4/701: rmdir d6/d7/dc/d4a/d58 39 2024-09-20T20:31:43.526 INFO:tasks.workunit.client.0.smithi070.stdout:5/708: read d2/d4/de/d47/d67/d92/fa3 [103872,86110] 0 2024-09-20T20:31:43.526 INFO:tasks.workunit.client.0.smithi070.stdout:6/813: chown d4/d8/d17/d33/lb8 4004 1 2024-09-20T20:31:43.526 INFO:tasks.workunit.client.0.smithi070.stdout:8/749: unlink d4/d27/d2a/d43/d61/f62 0 2024-09-20T20:31:43.527 INFO:tasks.workunit.client.0.smithi070.stdout:4/702: chown d6/d5e/d75 30789 1 2024-09-20T20:31:43.527 INFO:tasks.workunit.client.0.smithi070.stdout:2/698: mkdir d3/d5/d9/d1c/d1f/d3e/d61/df3 0 2024-09-20T20:31:43.527 INFO:tasks.workunit.client.0.smithi070.stdout:8/750: creat d4/ffc x:0 0 0 2024-09-20T20:31:43.527 INFO:tasks.workunit.client.0.smithi070.stdout:5/709: unlink d2/d4/d98/dc7/da5/f7d 0 2024-09-20T20:31:43.528 INFO:tasks.workunit.client.0.smithi070.stdout:2/699: write d3/d5/d9/f29 [1196852,14931] 0 2024-09-20T20:31:43.528 INFO:tasks.workunit.client.0.smithi070.stdout:5/710: readlink d2/l36 0 2024-09-20T20:31:43.528 INFO:tasks.workunit.client.0.smithi070.stdout:6/814: creat d4/d8/d17/d33/d61/d73/f125 x:0 0 0 2024-09-20T20:31:43.528 INFO:tasks.workunit.client.0.smithi070.stdout:4/703: symlink d6/d26/d69/d71/d4c/dcc/ldb 0 2024-09-20T20:31:43.528 INFO:tasks.workunit.client.0.smithi070.stdout:2/700: write d3/de/d9f/fba [4879883,18109] 0 2024-09-20T20:31:43.529 INFO:tasks.workunit.client.0.smithi070.stdout:6/815: mknod d4/d8/d1e/d7e/c126 0 2024-09-20T20:31:43.529 INFO:tasks.workunit.client.0.smithi070.stdout:2/701: chown d3/d5/dd/f63 737841 1 2024-09-20T20:31:43.530 INFO:tasks.workunit.client.0.smithi070.stdout:6/816: write d4/d8/f28 [2347210,16466] 0 2024-09-20T20:31:43.531 INFO:tasks.workunit.client.0.smithi070.stdout:2/702: fsync d3/d5/d9/d1c/d4e/fe2 0 2024-09-20T20:31:43.532 INFO:tasks.workunit.client.0.smithi070.stdout:2/703: creat d3/d5/d9/dc1/ff4 x:0 0 0 2024-09-20T20:31:43.533 INFO:tasks.workunit.client.0.smithi070.stdout:4/704: dread d6/d5e/d51/d78/f93 [0,4194304] 0 2024-09-20T20:31:43.534 INFO:tasks.workunit.client.0.smithi070.stdout:4/705: dread - d6/d26/fc1 zero size 2024-09-20T20:31:43.535 INFO:tasks.workunit.client.0.smithi070.stdout:4/706: chown d6/d26/dd7/ca1 24654516 1 2024-09-20T20:31:43.536 INFO:tasks.workunit.client.0.smithi070.stdout:6/817: dwrite d4/d8/fff [0,4194304] 0 2024-09-20T20:31:43.537 INFO:tasks.workunit.client.0.smithi070.stdout:4/707: link d6/d7/dc/d4a/c7f d6/d7/dc/cdc 0 2024-09-20T20:31:43.538 INFO:tasks.workunit.client.0.smithi070.stdout:7/641: write d2/d30/f59 [22396,74134] 0 2024-09-20T20:31:43.538 INFO:tasks.workunit.client.0.smithi070.stdout:6/818: truncate d4/d8/d1e/fe2 623426 0 2024-09-20T20:31:43.538 INFO:tasks.workunit.client.0.smithi070.stdout:7/642: dread - d2/d30/d63/f80 zero size 2024-09-20T20:31:43.539 INFO:tasks.workunit.client.0.smithi070.stdout:7/643: sync 2024-09-20T20:31:43.539 INFO:tasks.workunit.client.0.smithi070.stdout:6/819: write d4/d8/d38/d50/fe8 [1191637,76974] 0 2024-09-20T20:31:43.539 INFO:tasks.workunit.client.0.smithi070.stdout:6/820: chown d4/d8/d3a/da7/cc9 940654 1 2024-09-20T20:31:43.540 INFO:tasks.workunit.client.0.smithi070.stdout:6/821: chown d4/d8/d1e/d7e 1146 1 2024-09-20T20:31:43.540 INFO:tasks.workunit.client.0.smithi070.stdout:6/822: symlink d4/d8/d10/d54/d7a/l127 0 2024-09-20T20:31:43.541 INFO:tasks.workunit.client.0.smithi070.stdout:6/823: creat d4/d8/d10/d54/d7a/f128 x:0 0 0 2024-09-20T20:31:43.542 INFO:tasks.workunit.client.0.smithi070.stdout:6/824: chown d4/d8/d17/d33/d61/d73/l98 20 1 2024-09-20T20:31:43.543 INFO:tasks.workunit.client.0.smithi070.stdout:6/825: unlink d4/d8/d68/laa 0 2024-09-20T20:31:43.543 INFO:tasks.workunit.client.0.smithi070.stdout:6/826: write d4/d8/d10/d54/d7a/f128 [369287,110901] 0 2024-09-20T20:31:43.544 INFO:tasks.workunit.client.0.smithi070.stdout:6/827: chown d4/d8/d10/d54/dec/l96 1066755164 1 2024-09-20T20:31:43.545 INFO:tasks.workunit.client.0.smithi070.stdout:6/828: truncate d4/d8/d17/f11c 477833 0 2024-09-20T20:31:43.546 INFO:tasks.workunit.client.0.smithi070.stdout:6/829: getdents d4/d8/db4 0 2024-09-20T20:31:43.547 INFO:tasks.workunit.client.0.smithi070.stdout:7/644: read d2/d30/d63/d69/f70 [544571,4320] 0 2024-09-20T20:31:43.547 INFO:tasks.workunit.client.0.smithi070.stdout:6/830: truncate d4/d8/d10/d3c/ff1 74714 0 2024-09-20T20:31:43.547 INFO:tasks.workunit.client.0.smithi070.stdout:7/645: fsync d2/d19/f1a 0 2024-09-20T20:31:43.548 INFO:tasks.workunit.client.0.smithi070.stdout:6/831: chown d4/d8/d10/l106 1056755256 1 2024-09-20T20:31:43.549 INFO:tasks.workunit.client.0.smithi070.stdout:6/832: rename d4/d8/d17/lbe to d4/d8/d10/d54/d7a/l129 0 2024-09-20T20:31:43.550 INFO:tasks.workunit.client.0.smithi070.stdout:7/646: dread d2/d19/f27 [0,4194304] 0 2024-09-20T20:31:43.550 INFO:tasks.workunit.client.0.smithi070.stdout:7/647: chown d2/d30/d63/d69/fa6 1916792877 1 2024-09-20T20:31:43.550 INFO:tasks.workunit.client.0.smithi070.stdout:7/648: sync 2024-09-20T20:31:43.552 INFO:tasks.workunit.client.0.smithi070.stdout:7/649: write d2/d30/d63/fc1 [409731,31641] 0 2024-09-20T20:31:43.552 INFO:tasks.workunit.client.0.smithi070.stdout:1/748: dread d4/d6/d26/f70 [0,4194304] 0 2024-09-20T20:31:43.552 INFO:tasks.workunit.client.0.smithi070.stdout:7/650: dread - d2/d19/d25/d2a/d5c/fc5 zero size 2024-09-20T20:31:43.553 INFO:tasks.workunit.client.0.smithi070.stdout:6/833: dread d4/d8/d10/d54/f6b [0,4194304] 0 2024-09-20T20:31:43.553 INFO:tasks.workunit.client.0.smithi070.stdout:1/749: chown d4/d6/d11/d63/lf0 5264002 1 2024-09-20T20:31:43.553 INFO:tasks.workunit.client.0.smithi070.stdout:7/651: mkdir d2/d19/dbe/dd0/dd3 0 2024-09-20T20:31:43.554 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:43.549+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:43.555 INFO:tasks.workunit.client.0.smithi070.stdout:7/652: rmdir d2/d19/d25/d42/d88 39 2024-09-20T20:31:43.556 INFO:tasks.workunit.client.0.smithi070.stdout:7/653: mkdir d2/d19/d25/d2a/dd4 0 2024-09-20T20:31:43.556 INFO:tasks.workunit.client.0.smithi070.stdout:9/707: write d1/f11 [3208485,95481] 0 2024-09-20T20:31:43.556 INFO:tasks.workunit.client.0.smithi070.stdout:8/751: dread d4/d27/d42/fb1 [0,4194304] 0 2024-09-20T20:31:43.558 INFO:tasks.workunit.client.0.smithi070.stdout:5/711: write d2/d4/d98/f5a [2187782,60928] 0 2024-09-20T20:31:43.558 INFO:tasks.workunit.client.0.smithi070.stdout:2/704: truncate d3/d4c/d5c/fa2 2649019 0 2024-09-20T20:31:43.559 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:43.559 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:43.559 INFO:tasks.workunit.client.0.smithi070.stdout:3/616: dread d7/d15/d1a/d48/d66/d69/d13/d1d/f7b [0,4194304] 0 2024-09-20T20:31:43.560 INFO:tasks.workunit.client.0.smithi070.stdout:8/752: fsync d4/db/fd4 0 2024-09-20T20:31:43.560 INFO:tasks.workunit.client.0.smithi070.stdout:2/705: write d3/f75 [2026062,119354] 0 2024-09-20T20:31:43.561 INFO:tasks.workunit.client.0.smithi070.stdout:8/753: chown d4/d27/d2a/d43/de7 0 1 2024-09-20T20:31:43.561 INFO:tasks.workunit.client.0.smithi070.stdout:4/708: dread d6/d5e/d75/f88 [4194304,4194304] 0 2024-09-20T20:31:43.561 INFO:tasks.workunit.client.0.smithi070.stdout:9/708: truncate d1/df/d18/d44/da2/dcc/fe0 338407 0 2024-09-20T20:31:43.562 INFO:tasks.workunit.client.0.smithi070.stdout:3/617: stat d7/d15/d1a/d48/d66/d69/c6e 0 2024-09-20T20:31:43.562 INFO:tasks.workunit.client.0.smithi070.stdout:4/709: mkdir d6/d43/d5a/ddd 0 2024-09-20T20:31:43.563 INFO:tasks.workunit.client.0.smithi070.stdout:1/750: dwrite d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f5f [0,4194304] 0 2024-09-20T20:31:43.563 INFO:tasks.workunit.client.0.smithi070.stdout:9/709: fdatasync d1/df/d18/d46/fbe 0 2024-09-20T20:31:43.563 INFO:tasks.workunit.client.0.smithi070.stdout:8/754: creat d4/d27/d2a/d5b/d98/ffd x:0 0 0 2024-09-20T20:31:43.563 INFO:tasks.workunit.client.0.smithi070.stdout:3/618: fsync d7/d15/d1a/d80/d8e/fa7 0 2024-09-20T20:31:43.564 INFO:tasks.workunit.client.0.smithi070.stdout:1/751: mkdir d4/d32/de6/d10e 0 2024-09-20T20:31:43.565 INFO:tasks.workunit.client.0.smithi070.stdout:4/710: mknod d6/d5e/d51/d84/cde 0 2024-09-20T20:31:43.566 INFO:tasks.workunit.client.0.smithi070.stdout:3/619: write d7/f14 [5013026,79523] 0 2024-09-20T20:31:43.566 INFO:tasks.workunit.client.0.smithi070.stdout:7/654: dread d2/d19/d25/d42/f91 [0,4194304] 0 2024-09-20T20:31:43.566 INFO:tasks.workunit.client.0.smithi070.stdout:8/755: creat d4/db/d64/d95/da5/dfb/ffe x:0 0 0 2024-09-20T20:31:43.567 INFO:tasks.workunit.client.0.smithi070.stdout:1/752: write d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f31 [509098,78725] 0 2024-09-20T20:31:43.567 INFO:tasks.workunit.client.0.smithi070.stdout:9/710: getdents d1/df/d18/d44/da2/dcc 0 2024-09-20T20:31:43.567 INFO:tasks.workunit.client.0.smithi070.stdout:8/756: stat d4/d27/d2a/d3e/d39 0 2024-09-20T20:31:43.568 INFO:tasks.workunit.client.0.smithi070.stdout:3/620: fdatasync d7/d15/d1a/d48/d66/d69/f19 0 2024-09-20T20:31:43.568 INFO:tasks.workunit.client.0.smithi070.stdout:4/711: readlink d6/d5e/d75/l36 0 2024-09-20T20:31:43.568 INFO:tasks.workunit.client.0.smithi070.stdout:5/712: dwrite d2/d4/d98/fab [0,4194304] 0 2024-09-20T20:31:43.569 INFO:tasks.workunit.client.0.smithi070.stdout:8/757: fsync d4/d27/d2a/d3e/f30 0 2024-09-20T20:31:43.569 INFO:tasks.workunit.client.0.smithi070.stdout:5/713: sync 2024-09-20T20:31:43.569 INFO:tasks.workunit.client.0.smithi070.stdout:8/758: chown d4/d27/f36 16599309 1 2024-09-20T20:31:43.569 INFO:tasks.workunit.client.0.smithi070.stdout:8/759: sync 2024-09-20T20:31:43.571 INFO:tasks.workunit.client.0.smithi070.stdout:6/834: link d4/d8/d3a/f66 d4/d8/d3a/da7/f12a 0 2024-09-20T20:31:43.571 INFO:tasks.workunit.client.0.smithi070.stdout:1/753: rmdir d4/d6/d11/d63/de7/d44/d4b 39 2024-09-20T20:31:43.571 INFO:tasks.workunit.client.0.smithi070.stdout:5/714: rmdir d2/df/d77 39 2024-09-20T20:31:43.571 INFO:tasks.workunit.client.0.smithi070.stdout:5/715: stat d2/df/d77 0 2024-09-20T20:31:43.572 INFO:tasks.workunit.client.0.smithi070.stdout:6/835: write d4/d8/d17/d33/d36/ddb/fdf [1874704,16071] 0 2024-09-20T20:31:43.572 INFO:tasks.workunit.client.0.smithi070.stdout:1/754: unlink d4/d6/d11/f104 0 2024-09-20T20:31:43.572 INFO:tasks.workunit.client.0.smithi070.stdout:3/621: link d7/d15/d1a/d48/d66/d69/f8d d7/d15/d1e/d65/fc6 0 2024-09-20T20:31:43.572 INFO:tasks.workunit.client.0.smithi070.stdout:5/716: mknod d2/d4/de/d47/d5f/cf4 0 2024-09-20T20:31:43.573 INFO:tasks.workunit.client.0.smithi070.stdout:4/712: rename d6/d5e/d75/d40/fd0 to d6/fdf 0 2024-09-20T20:31:43.573 INFO:tasks.workunit.client.0.smithi070.stdout:1/755: write d4/d6/d11/d63/de7/d44/fc8 [157589,1067] 0 2024-09-20T20:31:43.573 INFO:tasks.workunit.client.0.smithi070.stdout:6/836: rename d4/d8/db4/db6/lfd to d4/d8/d17/d33/d36/ddb/l12b 0 2024-09-20T20:31:43.574 INFO:tasks.workunit.client.0.smithi070.stdout:1/756: chown d4/d32 9 1 2024-09-20T20:31:43.574 INFO:tasks.workunit.client.0.smithi070.stdout:5/717: mkdir d2/d4/d98/dc7/df5 0 2024-09-20T20:31:43.575 INFO:tasks.workunit.client.0.smithi070.stdout:1/757: readlink d4/d32/d60/dca/l102 0 2024-09-20T20:31:43.575 INFO:tasks.workunit.client.0.smithi070.stdout:4/713: creat d6/d5e/d51/d78/dbc/fe0 x:0 0 0 2024-09-20T20:31:43.575 INFO:tasks.workunit.client.0.smithi070.stdout:5/718: chown d2/d7/d88 378 1 2024-09-20T20:31:43.575 INFO:tasks.workunit.client.0.smithi070.stdout:2/706: truncate d3/d5/d9/d10/f13 1232618 0 2024-09-20T20:31:43.576 INFO:tasks.workunit.client.0.smithi070.stdout:6/837: link d4/d8/d1e/fe2 d4/df0/d11a/f12c 0 2024-09-20T20:31:43.576 INFO:tasks.workunit.client.0.smithi070.stdout:5/719: mknod d2/d4/d98/d4c/dad/dba/cf6 0 2024-09-20T20:31:43.576 INFO:tasks.workunit.client.0.smithi070.stdout:2/707: write d3/d5/d9/d1c/f4d [1115610,79141] 0 2024-09-20T20:31:43.576 INFO:tasks.workunit.client.0.smithi070.stdout:2/708: sync 2024-09-20T20:31:43.577 INFO:tasks.workunit.client.0.smithi070.stdout:4/714: mknod d6/d5e/d51/d78/dbc/ce1 0 2024-09-20T20:31:43.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:43.579 INFO:tasks.workunit.client.0.smithi070.stdout:6/838: mknod d4/d8/d10/d54/d55/d72/c12d 0 2024-09-20T20:31:43.579 INFO:tasks.workunit.client.0.smithi070.stdout:5/720: rename d2 to d2/d4/de/d47/d67/d92/de2/df7 22 2024-09-20T20:31:43.579 INFO:tasks.workunit.client.0.smithi070.stdout:8/760: dread d4/d27/d2a/d3e/d31/d63/fdb [0,4194304] 0 2024-09-20T20:31:43.579 INFO:tasks.workunit.client.0.smithi070.stdout:2/709: mkdir d3/d4c/d5c/d86/dd5/de3/df5 0 2024-09-20T20:31:43.580 INFO:tasks.workunit.client.0.smithi070.stdout:4/715: write d6/d5e/d75/f2e [5634630,82977] 0 2024-09-20T20:31:43.580 INFO:tasks.workunit.client.0.smithi070.stdout:0/713: dread d4/d48/f72 [0,4194304] 0 2024-09-20T20:31:43.580 INFO:tasks.workunit.client.0.smithi070.stdout:5/721: chown d2/d4/de/cac 1 1 2024-09-20T20:31:43.580 INFO:tasks.workunit.client.0.smithi070.stdout:3/622: dwrite d7/d15/d1a/d4a/fc5 [0,4194304] 0 2024-09-20T20:31:43.581 INFO:tasks.workunit.client.0.smithi070.stdout:0/714: readlink d4/lf 0 2024-09-20T20:31:43.581 INFO:tasks.workunit.client.0.smithi070.stdout:5/722: chown d2/df/f68 21374177 1 2024-09-20T20:31:43.583 INFO:tasks.workunit.client.0.smithi070.stdout:2/710: mknod d3/d5/d9/d1c/d4e/da4/cf6 0 2024-09-20T20:31:43.583 INFO:tasks.workunit.client.0.smithi070.stdout:0/715: symlink d4/d48/d7b/d8c/dce/ldf 0 2024-09-20T20:31:43.584 INFO:tasks.workunit.client.0.smithi070.stdout:4/716: mknod d6/ce2 0 2024-09-20T20:31:43.584 INFO:tasks.workunit.client.0.smithi070.stdout:1/758: dread d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f5f [0,4194304] 0 2024-09-20T20:31:43.584 INFO:tasks.workunit.client.0.smithi070.stdout:5/723: creat d2/df/ff8 x:0 0 0 2024-09-20T20:31:43.585 INFO:tasks.workunit.client.0.smithi070.stdout:2/711: mkdir d3/d5/dd/d99/df7 0 2024-09-20T20:31:43.585 INFO:tasks.workunit.client.0.smithi070.stdout:3/623: stat d7/d15/d1a/d48/d66/d69/d13/d1d/f47 0 2024-09-20T20:31:43.585 INFO:tasks.workunit.client.0.smithi070.stdout:8/761: truncate d4/d27/d2a/d3e/f67 1262640 0 2024-09-20T20:31:43.586 INFO:tasks.workunit.client.0.smithi070.stdout:4/717: mknod d6/d43/d5a/ddd/ce3 0 2024-09-20T20:31:43.586 INFO:tasks.workunit.client.0.smithi070.stdout:4/718: sync 2024-09-20T20:31:43.586 INFO:tasks.workunit.client.0.smithi070.stdout:1/759: unlink d4/d32/dea/d3b/f74 0 2024-09-20T20:31:43.587 INFO:tasks.workunit.client.0.smithi070.stdout:2/712: creat d3/d5/dd/d99/ff8 x:0 0 0 2024-09-20T20:31:43.587 INFO:tasks.workunit.client.0.smithi070.stdout:5/724: mknod d2/d4/de/d47/d5f/cf9 0 2024-09-20T20:31:43.587 INFO:tasks.workunit.client.0.smithi070.stdout:3/624: symlink d7/d15/d1a/d4a/lc7 0 2024-09-20T20:31:43.587 INFO:tasks.workunit.client.0.smithi070.stdout:8/762: symlink d4/d27/d2a/d5b/d6c/lff 0 2024-09-20T20:31:43.588 INFO:tasks.workunit.client.0.smithi070.stdout:1/760: write d4/d6/dae/f108 [912635,123685] 0 2024-09-20T20:31:43.588 INFO:tasks.workunit.client.0.smithi070.stdout:4/719: rmdir d6/d5e/d51/d78 39 2024-09-20T20:31:43.588 INFO:tasks.workunit.client.0.smithi070.stdout:6/839: dwrite d4/d8/d17/d33/d36/f48 [0,4194304] 0 2024-09-20T20:31:43.589 INFO:tasks.workunit.client.0.smithi070.stdout:5/725: symlink d2/d4/d98/d5b/d90/lfa 0 2024-09-20T20:31:43.590 INFO:tasks.workunit.client.0.smithi070.stdout:1/761: write d4/d6/d11/d63/f76 [438718,29880] 0 2024-09-20T20:31:43.590 INFO:tasks.workunit.client.0.smithi070.stdout:4/720: write d6/d26/f90 [1207495,115570] 0 2024-09-20T20:31:43.591 INFO:tasks.workunit.client.0.smithi070.stdout:5/726: symlink d2/d4/d98/dc7/lfb 0 2024-09-20T20:31:43.593 INFO:tasks.workunit.client.0.smithi070.stdout:7/655: dread d2/f51 [0,4194304] 0 2024-09-20T20:31:43.593 INFO:tasks.workunit.client.0.smithi070.stdout:9/711: truncate d1/df/f7e 3507737 0 2024-09-20T20:31:43.594 INFO:tasks.workunit.client.0.smithi070.stdout:3/625: symlink d7/d15/d1a/d4a/d51/d5b/d88/lc8 0 2024-09-20T20:31:43.594 INFO:tasks.workunit.client.0.smithi070.stdout:7/656: mkdir d2/dd5 0 2024-09-20T20:31:43.595 INFO:tasks.workunit.client.0.smithi070.stdout:9/712: creat d1/df/d18/d44/d77/f100 x:0 0 0 2024-09-20T20:31:43.595 INFO:tasks.workunit.client.0.smithi070.stdout:4/721: chown d6/d7/dc/d4a/d58/f6c 1292588 1 2024-09-20T20:31:43.595 INFO:tasks.workunit.client.0.smithi070.stdout:2/713: dwrite d3/d5/d9/d1c/d47/d7e/f84 [0,4194304] 0 2024-09-20T20:31:43.600 INFO:tasks.workunit.client.0.smithi070.stdout:9/713: symlink d1/df/d18/d44/da2/dcc/l101 0 2024-09-20T20:31:43.601 INFO:tasks.workunit.client.0.smithi070.stdout:7/657: mknod d2/d19/d25/d2a/dd4/cd6 0 2024-09-20T20:31:43.602 INFO:tasks.workunit.client.0.smithi070.stdout:6/840: truncate d4/d8/d17/d33/d36/f48 3295238 0 2024-09-20T20:31:43.603 INFO:tasks.workunit.client.0.smithi070.stdout:7/658: rmdir d2/d30 39 2024-09-20T20:31:43.603 INFO:tasks.workunit.client.0.smithi070.stdout:3/626: dwrite d7/d15/d1a/d48/d66/d69/f42 [0,4194304] 0 2024-09-20T20:31:43.605 INFO:tasks.workunit.client.0.smithi070.stdout:2/714: dwrite d3/de/d12/d1a/f3f [0,4194304] 0 2024-09-20T20:31:43.605 INFO:tasks.workunit.client.0.smithi070.stdout:4/722: dwrite d6/d26/f9c [0,4194304] 0 2024-09-20T20:31:43.608 INFO:tasks.workunit.client.0.smithi070.stdout:5/727: dwrite d2/d4/de/d47/d67/d92/fd1 [0,4194304] 0 2024-09-20T20:31:43.609 INFO:tasks.workunit.client.0.smithi070.stdout:7/659: mkdir d2/d19/d25/d2a/dd4/dd7 0 2024-09-20T20:31:43.609 INFO:tasks.workunit.client.0.smithi070.stdout:4/723: mkdir d6/d7/dc/d4a/d81/de4 0 2024-09-20T20:31:43.610 INFO:tasks.workunit.client.0.smithi070.stdout:2/715: creat d3/d5/dd/d99/ddb/ff9 x:0 0 0 2024-09-20T20:31:43.610 INFO:tasks.workunit.client.0.smithi070.stdout:3/627: truncate d7/d15/d1a/d48/d57/f59 3272783 0 2024-09-20T20:31:43.610 INFO:tasks.workunit.client.0.smithi070.stdout:4/724: stat d6/d26/cd9 0 2024-09-20T20:31:43.610 INFO:tasks.workunit.client.0.smithi070.stdout:5/728: write d2/d4/de/fb2 [4827758,71688] 0 2024-09-20T20:31:43.611 INFO:tasks.workunit.client.0.smithi070.stdout:6/841: creat d4/d8/f12e x:0 0 0 2024-09-20T20:31:43.611 INFO:tasks.workunit.client.0.smithi070.stdout:9/714: dwrite d1/df/d18/d44/f6d [0,4194304] 0 2024-09-20T20:31:43.612 INFO:tasks.workunit.client.0.smithi070.stdout:7/660: write d2/d30/d63/db4/fb8 [983867,105127] 0 2024-09-20T20:31:43.613 INFO:tasks.workunit.client.0.smithi070.stdout:2/716: symlink d3/d4c/d5c/d86/lfa 0 2024-09-20T20:31:43.613 INFO:tasks.workunit.client.0.smithi070.stdout:7/661: write d2/d8/f1d [2386187,121626] 0 2024-09-20T20:31:43.613 INFO:tasks.workunit.client.0.smithi070.stdout:6/842: mkdir d4/d8/d17/d33/d61/d12f 0 2024-09-20T20:31:43.614 INFO:tasks.workunit.client.0.smithi070.stdout:5/729: rmdir d2/d4/d98/d4c/ddb 0 2024-09-20T20:31:43.615 INFO:tasks.workunit.client.0.smithi070.stdout:9/715: creat d1/df/d25/d69/d85/d9f/db9/de3/de5/f102 x:0 0 0 2024-09-20T20:31:43.615 INFO:tasks.workunit.client.0.smithi070.stdout:1/762: dread d4/d6/d11/d63/de7/d44/d48/f5e [0,4194304] 0 2024-09-20T20:31:43.615 INFO:tasks.workunit.client.0.smithi070.stdout:7/662: readlink d2/d30/l7a 0 2024-09-20T20:31:43.615 INFO:tasks.workunit.client.0.smithi070.stdout:0/716: dread d4/f16 [0,4194304] 0 2024-09-20T20:31:43.615 INFO:tasks.workunit.client.0.smithi070.stdout:2/717: symlink d3/d5/d9/d1c/d47/lfb 0 2024-09-20T20:31:43.615 INFO:tasks.workunit.client.0.smithi070.stdout:6/843: mkdir d4/d8/d10/d130 0 2024-09-20T20:31:43.615 INFO:tasks.workunit.client.0.smithi070.stdout:4/725: mkdir d6/d5e/d51/d78/de5 0 2024-09-20T20:31:43.616 INFO:tasks.workunit.client.0.smithi070.stdout:1/763: readlink d4/d1f/l2e 0 2024-09-20T20:31:43.616 INFO:tasks.workunit.client.0.smithi070.stdout:0/717: write d4/d8/d12/d43/f75 [1003185,95123] 0 2024-09-20T20:31:43.617 INFO:tasks.workunit.client.0.smithi070.stdout:2/718: mknod d3/cfc 0 2024-09-20T20:31:43.617 INFO:tasks.workunit.client.0.smithi070.stdout:7/663: chown d2/d19/d25/d2a/d4a/fd2 453843222 1 2024-09-20T20:31:43.617 INFO:tasks.workunit.client.0.smithi070.stdout:8/763: dread d4/db/d66/f84 [0,4194304] 0 2024-09-20T20:31:43.619 INFO:tasks.workunit.client.0.smithi070.stdout:4/726: mknod d6/d7/dc/d20/ce6 0 2024-09-20T20:31:43.619 INFO:tasks.workunit.client.0.smithi070.stdout:1/764: write d4/d1f/f7a [4487812,81435] 0 2024-09-20T20:31:43.619 INFO:tasks.workunit.client.0.smithi070.stdout:7/664: symlink d2/d30/ld8 0 2024-09-20T20:31:43.619 INFO:tasks.workunit.client.0.smithi070.stdout:8/764: symlink d4/d27/d2a/d5b/d98/da9/db5/dc0/l100 0 2024-09-20T20:31:43.620 INFO:tasks.workunit.client.0.smithi070.stdout:6/844: creat d4/d8/f131 x:0 0 0 2024-09-20T20:31:43.620 INFO:tasks.workunit.client.0.smithi070.stdout:9/716: dread d1/df/d18/d44/da2/dcc/fe0 [0,4194304] 0 2024-09-20T20:31:43.622 INFO:tasks.workunit.client.0.smithi070.stdout:7/665: mknod d2/d19/d2e/cd9 0 2024-09-20T20:31:43.622 INFO:tasks.workunit.client.0.smithi070.stdout:4/727: creat d6/d43/fe7 x:0 0 0 2024-09-20T20:31:43.623 INFO:tasks.workunit.client.0.smithi070.stdout:5/730: dwrite d2/d4/d98/dc7/fb3 [0,4194304] 0 2024-09-20T20:31:43.623 INFO:tasks.workunit.client.0.smithi070.stdout:9/717: unlink d1/df/d25/d69/d85/ffe 0 2024-09-20T20:31:43.628 INFO:tasks.workunit.client.0.smithi070.stdout:1/765: creat d4/d6/d11/d63/de7/d44/d4b/f10f x:0 0 0 2024-09-20T20:31:43.628 INFO:tasks.workunit.client.0.smithi070.stdout:8/765: symlink d4/d27/d2a/d5b/d98/da9/db5/dd8/l101 0 2024-09-20T20:31:43.628 INFO:tasks.workunit.client.0.smithi070.stdout:4/728: chown d6/d5e/d6b/d74/dd3/ld6 62840 1 2024-09-20T20:31:43.628 INFO:tasks.workunit.client.0.smithi070.stdout:1/766: truncate d4/d6/d11/f38 4182223 0 2024-09-20T20:31:43.628 INFO:tasks.workunit.client.0.smithi070.stdout:8/766: write d4/d27/d2a/d43/d61/fe8 [1067231,54396] 0 2024-09-20T20:31:43.628 INFO:tasks.workunit.client.0.smithi070.stdout:2/719: dwrite d3/d5/dd/d99/dae/fe5 [0,4194304] 0 2024-09-20T20:31:43.628 INFO:tasks.workunit.client.0.smithi070.stdout:6/845: dread d4/d8/d1e/db7/f105 [0,4194304] 0 2024-09-20T20:31:43.628 INFO:tasks.workunit.client.0.smithi070.stdout:4/729: creat d6/d5e/fe8 x:0 0 0 2024-09-20T20:31:43.629 INFO:tasks.workunit.client.0.smithi070.stdout:1/767: mkdir d4/d6/d11/d63/de7/d44/d110 0 2024-09-20T20:31:43.630 INFO:tasks.workunit.client.0.smithi070.stdout:8/767: fdatasync d4/d27/d2a/d3e/f67 0 2024-09-20T20:31:43.632 INFO:tasks.workunit.client.0.smithi070.stdout:1/768: creat d4/d32/dea/d3a/d78/dde/f111 x:0 0 0 2024-09-20T20:31:43.636 INFO:tasks.workunit.client.0.smithi070.stdout:5/731: dwrite d2/d7/f9 [0,4194304] 0 2024-09-20T20:31:43.638 INFO:tasks.workunit.client.0.smithi070.stdout:7/666: dwrite d2/d8/f47 [4194304,4194304] 0 2024-09-20T20:31:43.639 INFO:tasks.workunit.client.0.smithi070.stdout:1/769: mknod d4/d32/dea/c112 0 2024-09-20T20:31:43.641 INFO:tasks.workunit.client.0.smithi070.stdout:7/667: dread - d2/d8/fcb zero size 2024-09-20T20:31:43.641 INFO:tasks.workunit.client.0.smithi070.stdout:6/846: dwrite d4/d8/d3a/fe9 [0,4194304] 0 2024-09-20T20:31:43.642 INFO:tasks.workunit.client.0.smithi070.stdout:9/718: dwrite d1/df/fd6 [0,4194304] 0 2024-09-20T20:31:43.642 INFO:tasks.workunit.client.0.smithi070.stdout:3/628: dread d7/f9 [0,4194304] 0 2024-09-20T20:31:43.642 INFO:tasks.workunit.client.0.smithi070.stdout:8/768: dwrite d4/d27/d2a/d5b/d98/fa8 [0,4194304] 0 2024-09-20T20:31:43.642 INFO:tasks.workunit.client.0.smithi070.stdout:5/732: getdents d2/d4/d53 0 2024-09-20T20:31:43.642 INFO:tasks.workunit.client.0.smithi070.stdout:7/668: readlink d2/d19/d2e/l3d 0 2024-09-20T20:31:43.643 INFO:tasks.workunit.client.0.smithi070.stdout:9/719: write d1/df/d18/f3c [843848,22029] 0 2024-09-20T20:31:43.643 INFO:tasks.workunit.client.0.smithi070.stdout:8/769: chown d4/d27/d2a/d5b/d98/da9/db5 23230 1 2024-09-20T20:31:43.643 INFO:tasks.workunit.client.0.smithi070.stdout:8/770: dread - d4/ffc zero size 2024-09-20T20:31:43.644 INFO:tasks.workunit.client.0.smithi070.stdout:1/770: creat d4/d6/d11/d63/f113 x:0 0 0 2024-09-20T20:31:43.644 INFO:tasks.workunit.client.0.smithi070.stdout:5/733: rename d2/d4/de/d47/d67/ff0 to d2/d7/d60/dbd/ffc 0 2024-09-20T20:31:43.644 INFO:tasks.workunit.client.0.smithi070.stdout:3/629: link d7/d15/f3f d7/d15/d1a/d48/d57/d75/fc9 0 2024-09-20T20:31:43.646 INFO:tasks.workunit.client.0.smithi070.stdout:5/734: dread - d2/d4/d98/faa zero size 2024-09-20T20:31:43.647 INFO:tasks.workunit.client.0.smithi070.stdout:9/720: rmdir d1/df/d18/deb 0 2024-09-20T20:31:43.647 INFO:tasks.workunit.client.0.smithi070.stdout:3/630: mkdir d7/d15/d1a/d4a/d51/d5b/dca 0 2024-09-20T20:31:43.647 INFO:tasks.workunit.client.0.smithi070.stdout:5/735: creat d2/d7/d60/dbd/dcd/ffd x:0 0 0 2024-09-20T20:31:43.647 INFO:tasks.workunit.client.0.smithi070.stdout:8/771: rename d4/d27/d2a/d3e/f5c to d4/d27/d2a/d5b/d98/da9/db5/dd8/f102 0 2024-09-20T20:31:43.648 INFO:tasks.workunit.client.0.smithi070.stdout:3/631: symlink d7/d15/d1a/d48/d66/d69/d13/d7a/lcb 0 2024-09-20T20:31:43.649 INFO:tasks.workunit.client.0.smithi070.stdout:0/718: dread d4/d19/fb9 [0,4194304] 0 2024-09-20T20:31:43.650 INFO:tasks.workunit.client.0.smithi070.stdout:5/736: rmdir d2/dea 0 2024-09-20T20:31:43.651 INFO:tasks.workunit.client.0.smithi070.stdout:9/721: link d1/df/d18/d44/da2/db6/lda d1/df/d18/d44/d77/db8/l103 0 2024-09-20T20:31:43.651 INFO:tasks.workunit.client.0.smithi070.stdout:7/669: read d2/d8/f64 [894713,37349] 0 2024-09-20T20:31:43.652 INFO:tasks.workunit.client.0.smithi070.stdout:8/772: dread d4/d27/d2a/d3e/d31/d63/fc2 [0,4194304] 0 2024-09-20T20:31:43.652 INFO:tasks.workunit.client.0.smithi070.stdout:3/632: read d7/d15/d1a/d4a/f4d [632818,28410] 0 2024-09-20T20:31:43.654 INFO:tasks.workunit.client.0.smithi070.stdout:5/737: symlink d2/d4/d98/dc7/da5/lfe 0 2024-09-20T20:31:43.654 INFO:tasks.workunit.client.0.smithi070.stdout:9/722: mknod d1/df/d25/d69/d85/d9f/c104 0 2024-09-20T20:31:43.654 INFO:tasks.workunit.client.0.smithi070.stdout:0/719: link d4/d13/f76 d4/d8/d55/dd8/d1d/fe0 0 2024-09-20T20:31:43.655 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:43.647+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:43.655 INFO:tasks.workunit.client.0.smithi070.stdout:9/723: dread - d1/df/d25/fff zero size 2024-09-20T20:31:43.655 INFO:tasks.workunit.client.0.smithi070.stdout:8/773: rename d4/d27/d2a/d75 to d4/d27/d42/d103 0 2024-09-20T20:31:43.656 INFO:tasks.workunit.client.0.smithi070.stdout:3/633: link d7/d15/d1e/d65/l3a d7/d15/d1a/d4a/lcc 0 2024-09-20T20:31:43.656 INFO:tasks.workunit.client.0.smithi070.stdout:5/738: rename d2/lcf to d2/d4/d98/d5b/d90/da0/lff 0 2024-09-20T20:31:43.656 INFO:tasks.workunit.client.0.smithi070.stdout:9/724: creat d1/d76/f105 x:0 0 0 2024-09-20T20:31:43.657 INFO:tasks.workunit.client.0.smithi070.stdout:3/634: dread - d7/d71/fb8 zero size 2024-09-20T20:31:43.658 INFO:tasks.workunit.client.0.smithi070.stdout:2/720: sync 2024-09-20T20:31:43.658 INFO:tasks.workunit.client.0.smithi070.stdout:5/739: dread - d2/d7/d60/dbd/dcd/ffd zero size 2024-09-20T20:31:43.658 INFO:tasks.workunit.client.0.smithi070.stdout:6/847: dread d4/d8/d1e/d7e/dd6/f11d [0,4194304] 0 2024-09-20T20:31:43.658 INFO:tasks.workunit.client.0.smithi070.stdout:9/725: symlink d1/df/d25/d9e/l106 0 2024-09-20T20:31:43.659 INFO:tasks.workunit.client.0.smithi070.stdout:2/721: rmdir d3/d4c/d5c/d86/dd5 39 2024-09-20T20:31:43.659 INFO:tasks.workunit.client.0.smithi070.stdout:7/670: dwrite d2/d19/d25/d42/d55/fb5 [0,4194304] 0 2024-09-20T20:31:43.660 INFO:tasks.workunit.client.0.smithi070.stdout:9/726: rename d1/f7 to d1/df/d18/d44/d77/db8/f107 0 2024-09-20T20:31:43.660 INFO:tasks.workunit.client.0.smithi070.stdout:5/740: creat d2/df/d40/ddd/f100 x:0 0 0 2024-09-20T20:31:43.660 INFO:tasks.workunit.client.0.smithi070.stdout:2/722: readlink d3/d5/d9/d1c/d47/lfb 0 2024-09-20T20:31:43.661 INFO:tasks.workunit.client.0.smithi070.stdout:7/671: stat d2/d30/d63/f81 0 2024-09-20T20:31:43.661 INFO:tasks.workunit.client.0.smithi070.stdout:6/848: truncate d4/d8/d17/fc0 866 0 2024-09-20T20:31:43.661 INFO:tasks.workunit.client.0.smithi070.stdout:9/727: dread - d1/df/d25/d69/fdd zero size 2024-09-20T20:31:43.662 INFO:tasks.workunit.client.0.smithi070.stdout:5/741: write d2/d4/d53/d59/f8f [1133356,117355] 0 2024-09-20T20:31:43.662 INFO:tasks.workunit.client.0.smithi070.stdout:2/723: unlink d3/d5/d9/d1c/dda/lf1 0 2024-09-20T20:31:43.663 INFO:tasks.workunit.client.0.smithi070.stdout:6/849: mknod d4/d8/d17/d33/d61/d73/d10a/c132 0 2024-09-20T20:31:43.663 INFO:tasks.workunit.client.0.smithi070.stdout:7/672: link d2/d8/f47 d2/d19/dbe/dd0/dd3/fda 0 2024-09-20T20:31:43.664 INFO:tasks.workunit.client.0.smithi070.stdout:8/774: dwrite d4/d27/d2a/d5b/d98/da9/fd0 [0,4194304] 0 2024-09-20T20:31:43.665 INFO:tasks.workunit.client.0.smithi070.stdout:2/724: truncate d3/d5/d9/d1c/d47/d7e/fe9 652375 0 2024-09-20T20:31:43.667 INFO:tasks.workunit.client.0.smithi070.stdout:7/673: rmdir d2/d30/d63/d69 39 2024-09-20T20:31:43.667 INFO:tasks.workunit.client.0.smithi070.stdout:8/775: creat d4/d27/d2a/d5b/d98/da9/db5/f104 x:0 0 0 2024-09-20T20:31:43.668 INFO:tasks.workunit.client.0.smithi070.stdout:2/725: symlink d3/d5/d9/d1c/d1f/d3e/lfd 0 2024-09-20T20:31:43.668 INFO:tasks.workunit.client.0.smithi070.stdout:6/850: creat d4/d8/d10/f133 x:0 0 0 2024-09-20T20:31:43.668 INFO:tasks.workunit.client.0.smithi070.stdout:9/728: dwrite d1/df/d18/f66 [0,4194304] 0 2024-09-20T20:31:43.668 INFO:tasks.workunit.client.0.smithi070.stdout:7/674: stat d2/d19/d25/d2a/d5c 0 2024-09-20T20:31:43.668 INFO:tasks.workunit.client.0.smithi070.stdout:2/726: fdatasync d3/d5/d9/d10/fd9 0 2024-09-20T20:31:43.669 INFO:tasks.workunit.client.0.smithi070.stdout:6/851: chown d4/d8/f131 811 1 2024-09-20T20:31:43.669 INFO:tasks.workunit.client.0.smithi070.stdout:9/729: stat d1/df/d84/f91 0 2024-09-20T20:31:43.670 INFO:tasks.workunit.client.0.smithi070.stdout:1/771: write d4/d6/d11/d63/d6c/fbf [2032823,22793] 0 2024-09-20T20:31:43.670 INFO:tasks.workunit.client.0.smithi070.stdout:8/776: rmdir d4/d27/d2a/d43 39 2024-09-20T20:31:43.670 INFO:tasks.workunit.client.0.smithi070.stdout:2/727: mknod d3/d5/d9/d1c/dda/cfe 0 2024-09-20T20:31:43.671 INFO:tasks.workunit.client.0.smithi070.stdout:7/675: fsync d2/f1b 0 2024-09-20T20:31:43.671 INFO:tasks.workunit.client.0.smithi070.stdout:0/720: truncate d4/d8/d55/dd8/d1d/d41/fd0 1306152 0 2024-09-20T20:31:43.671 INFO:tasks.workunit.client.0.smithi070.stdout:6/852: creat d4/d8/d17/d33/d36/f134 x:0 0 0 2024-09-20T20:31:43.671 INFO:tasks.workunit.client.0.smithi070.stdout:2/728: stat d3/l2f 0 2024-09-20T20:31:43.671 INFO:tasks.workunit.client.0.smithi070.stdout:5/742: write d2/d7/d60/f6f [385102,96775] 0 2024-09-20T20:31:43.672 INFO:tasks.workunit.client.0.smithi070.stdout:7/676: dread - d2/d19/d25/da2/fbb zero size 2024-09-20T20:31:43.672 INFO:tasks.workunit.client.0.smithi070.stdout:1/772: creat d4/d6/d11/d63/d6c/f114 x:0 0 0 2024-09-20T20:31:43.672 INFO:tasks.workunit.client.0.smithi070.stdout:5/743: read - d2/df/ff8 zero size 2024-09-20T20:31:43.672 INFO:tasks.workunit.client.0.smithi070.stdout:6/853: mknod d4/d8/d17/d33/d61/d73/c135 0 2024-09-20T20:31:43.673 INFO:tasks.workunit.client.0.smithi070.stdout:7/677: symlink d2/d19/d25/d2a/ldb 0 2024-09-20T20:31:43.673 INFO:tasks.workunit.client.0.smithi070.stdout:0/721: rename d4/d8/d55/dd8/d1d/d7e/cc8 to d4/d8/d12/d23/ce1 0 2024-09-20T20:31:43.673 INFO:tasks.workunit.client.0.smithi070.stdout:1/773: truncate d4/f71 54215 0 2024-09-20T20:31:43.673 INFO:tasks.workunit.client.0.smithi070.stdout:8/777: getdents d4/db/d64/d95/da5 0 2024-09-20T20:31:43.674 INFO:tasks.workunit.client.0.smithi070.stdout:5/744: chown d2/d4/d98/d4c/dad/dba/fc6 68 1 2024-09-20T20:31:43.674 INFO:tasks.workunit.client.0.smithi070.stdout:0/722: write d4/d48/d4e/f5a [173677,87275] 0 2024-09-20T20:31:43.674 INFO:tasks.workunit.client.0.smithi070.stdout:7/678: chown d2/d19/d25/d42/f5a 26663547 1 2024-09-20T20:31:43.674 INFO:tasks.workunit.client.0.smithi070.stdout:8/778: readlink d4/d27/d2a/d3e/d39/ddf/lec 0 2024-09-20T20:31:43.675 INFO:tasks.workunit.client.0.smithi070.stdout:1/774: symlink d4/d32/dea/d3a/d78/dde/l115 0 2024-09-20T20:31:43.675 INFO:tasks.workunit.client.0.smithi070.stdout:7/679: symlink d2/d19/d25/d42/d77/ldc 0 2024-09-20T20:31:43.676 INFO:tasks.workunit.client.0.smithi070.stdout:8/779: mknod d4/d27/d73/c105 0 2024-09-20T20:31:43.676 INFO:tasks.workunit.client.0.smithi070.stdout:6/854: read d4/d8/d10/fe7 [117790,91346] 0 2024-09-20T20:31:43.676 INFO:tasks.workunit.client.0.smithi070.stdout:9/730: write d1/df/d18/d44/da2/dcc/fe0 [595219,45046] 0 2024-09-20T20:31:43.677 INFO:tasks.workunit.client.0.smithi070.stdout:5/745: write d2/d4/de/d47/d67/d92/f84 [1071284,112484] 0 2024-09-20T20:31:43.678 INFO:tasks.workunit.client.0.smithi070.stdout:4/730: dread d6/d7/f3b [0,4194304] 0 2024-09-20T20:31:43.678 INFO:tasks.workunit.client.0.smithi070.stdout:7/680: mknod d2/d30/cdd 0 2024-09-20T20:31:43.679 INFO:tasks.workunit.client.0.smithi070.stdout:9/731: write d1/df/d25/f58 [4806590,99059] 0 2024-09-20T20:31:43.679 INFO:tasks.workunit.client.0.smithi070.stdout:4/731: creat d6/d26/dd7/fe9 x:0 0 0 2024-09-20T20:31:43.680 INFO:tasks.workunit.client.0.smithi070.stdout:8/780: read - d4/d27/d2a/d3e/d39/fe4 zero size 2024-09-20T20:31:43.680 INFO:tasks.workunit.client.0.smithi070.stdout:7/681: fdatasync d2/d19/f1a 0 2024-09-20T20:31:43.682 INFO:tasks.workunit.client.0.smithi070.stdout:7/682: mkdir d2/d19/d7c/dde 0 2024-09-20T20:31:43.682 INFO:tasks.workunit.client.0.smithi070.stdout:2/729: dwrite d3/d5/d9/d10/f13 [0,4194304] 0 2024-09-20T20:31:43.682 INFO:tasks.workunit.client.0.smithi070.stdout:9/732: mknod d1/df/d18/d44/c108 0 2024-09-20T20:31:43.685 INFO:tasks.workunit.client.0.smithi070.stdout:4/732: getdents d6/d26/d69/d71 0 2024-09-20T20:31:43.685 INFO:tasks.workunit.client.0.smithi070.stdout:0/723: dwrite d4/d8/d12/d23/f73 [0,4194304] 0 2024-09-20T20:31:43.687 INFO:tasks.workunit.client.0.smithi070.stdout:9/733: symlink d1/df/d18/l109 0 2024-09-20T20:31:43.688 INFO:tasks.workunit.client.0.smithi070.stdout:2/730: mkdir d3/d5/d9/d1c/d1f/d3e/d61/db2/dff 0 2024-09-20T20:31:43.688 INFO:tasks.workunit.client.0.smithi070.stdout:4/733: rename d6/d7/f9 to d6/d7/dc/d4a/d81/fea 0 2024-09-20T20:31:43.688 INFO:tasks.workunit.client.0.smithi070.stdout:9/734: chown d1/df/d25/d69/d80/cd7 1027837507 1 2024-09-20T20:31:43.689 INFO:tasks.workunit.client.0.smithi070.stdout:2/731: chown d3/d5/d9/d1c/d1f/d3e 3580 1 2024-09-20T20:31:43.689 INFO:tasks.workunit.client.0.smithi070.stdout:0/724: getdents d4/d48/d67 0 2024-09-20T20:31:43.690 INFO:tasks.workunit.client.0.smithi070.stdout:4/734: rename d6/d7/d77 to d6/d26/deb 0 2024-09-20T20:31:43.690 INFO:tasks.workunit.client.0.smithi070.stdout:9/735: creat d1/df/d25/db2/f10a x:0 0 0 2024-09-20T20:31:43.690 INFO:tasks.workunit.client.0.smithi070.stdout:0/725: chown d4/d8/d55/dd8 0 1 2024-09-20T20:31:43.691 INFO:tasks.workunit.client.0.smithi070.stdout:4/735: unlink d6/d7/dc/d20/cad 0 2024-09-20T20:31:43.691 INFO:tasks.workunit.client.0.smithi070.stdout:4/736: chown d6/d43 98 1 2024-09-20T20:31:43.693 INFO:tasks.workunit.client.0.smithi070.stdout:4/737: creat d6/d5e/d6b/d74/fec x:0 0 0 2024-09-20T20:31:43.694 INFO:tasks.workunit.client.0.smithi070.stdout:7/683: dwrite d2/d8/fcb [0,4194304] 0 2024-09-20T20:31:43.695 INFO:tasks.workunit.client.0.smithi070.stdout:4/738: mknod d6/d5e/ced 0 2024-09-20T20:31:43.697 INFO:tasks.workunit.client.0.smithi070.stdout:2/732: dwrite d3/d4c/d5c/fd7 [0,4194304] 0 2024-09-20T20:31:43.699 INFO:tasks.workunit.client.0.smithi070.stdout:1/775: dread d4/d6/d11/d63/de7/d44/d4b/d87/fd4 [0,4194304] 0 2024-09-20T20:31:43.699 INFO:tasks.workunit.client.0.smithi070.stdout:0/726: dwrite d4/d8/d55/dd8/f33 [0,4194304] 0 2024-09-20T20:31:43.699 INFO:tasks.workunit.client.0.smithi070.stdout:2/733: write d3/d5/d9/d1c/d47/d7e/f84 [1704667,56704] 0 2024-09-20T20:31:43.700 INFO:tasks.workunit.client.0.smithi070.stdout:9/736: write d1/df/d18/d46/fbe [783833,117256] 0 2024-09-20T20:31:43.701 INFO:tasks.workunit.client.0.smithi070.stdout:0/727: readlink d4/d48/d7b/d8c/dce/ldf 0 2024-09-20T20:31:43.701 INFO:tasks.workunit.client.0.smithi070.stdout:1/776: mkdir d4/d32/d116 0 2024-09-20T20:31:43.701 INFO:tasks.workunit.client.0.smithi070.stdout:9/737: mkdir d1/df/d25/d69/d80/d10b 0 2024-09-20T20:31:43.702 INFO:tasks.workunit.client.0.smithi070.stdout:2/734: creat d3/d5/dd/f100 x:0 0 0 2024-09-20T20:31:43.702 INFO:tasks.workunit.client.0.smithi070.stdout:1/777: creat d4/d32/f117 x:0 0 0 2024-09-20T20:31:43.702 INFO:tasks.workunit.client.0.smithi070.stdout:9/738: mkdir d1/df/d25/d69/d10c 0 2024-09-20T20:31:43.703 INFO:tasks.workunit.client.0.smithi070.stdout:9/739: unlink d1/df/l2c 0 2024-09-20T20:31:43.703 INFO:tasks.workunit.client.0.smithi070.stdout:2/735: creat d3/d5/d9/d1c/d1f/d3e/f101 x:0 0 0 2024-09-20T20:31:43.703 INFO:tasks.workunit.client.0.smithi070.stdout:7/684: dwrite d2/d19/d25/d2a/d4a/fb9 [0,4194304] 0 2024-09-20T20:31:43.706 INFO:tasks.workunit.client.0.smithi070.stdout:9/740: rmdir d1/df/d25 39 2024-09-20T20:31:43.706 INFO:tasks.workunit.client.0.smithi070.stdout:7/685: rmdir d2/d19/d25/da2 39 2024-09-20T20:31:43.707 INFO:tasks.workunit.client.0.smithi070.stdout:7/686: symlink d2/ldf 0 2024-09-20T20:31:43.709 INFO:tasks.workunit.client.0.smithi070.stdout:3/635: sync 2024-09-20T20:31:43.711 INFO:tasks.workunit.client.0.smithi070.stdout:3/636: write d7/d15/d1e/d65/d9d/fb2 [1182360,2045] 0 2024-09-20T20:31:43.711 INFO:tasks.workunit.client.0.smithi070.stdout:2/736: dwrite d3/d5/d9/d1c/f8c [0,4194304] 0 2024-09-20T20:31:43.712 INFO:tasks.workunit.client.0.smithi070.stdout:9/741: dwrite d1/df/d18/d46/ffb [0,4194304] 0 2024-09-20T20:31:43.715 INFO:tasks.workunit.client.0.smithi070.stdout:2/737: truncate d3/d5/f1e 495728 0 2024-09-20T20:31:43.716 INFO:tasks.workunit.client.0.smithi070.stdout:2/738: creat d3/d5/d9/d1c/d1f/d3e/f102 x:0 0 0 2024-09-20T20:31:43.718 INFO:tasks.workunit.client.0.smithi070.stdout:2/739: mknod d3/d5/d9/d79/c103 0 2024-09-20T20:31:43.718 INFO:tasks.workunit.client.0.smithi070.stdout:3/637: dwrite d7/d15/d1e/da9/fbd [0,4194304] 0 2024-09-20T20:31:43.719 INFO:tasks.workunit.client.0.smithi070.stdout:2/740: write d3/de/d12/d1a/f46 [1458713,88607] 0 2024-09-20T20:31:43.719 INFO:tasks.workunit.client.0.smithi070.stdout:3/638: fsync d7/d15/d1a/d48/d66/d69/f19 0 2024-09-20T20:31:43.720 INFO:tasks.workunit.client.0.smithi070.stdout:3/639: dread - d7/d15/d1a/d48/d66/d69/d13/d72/fb0 zero size 2024-09-20T20:31:43.725 INFO:tasks.workunit.client.0.smithi070.stdout:6/855: dread d4/d8/f4c [0,4194304] 0 2024-09-20T20:31:43.726 INFO:tasks.workunit.client.0.smithi070.stdout:6/856: write d4/d8/d17/f31 [2514416,102109] 0 2024-09-20T20:31:43.726 INFO:tasks.workunit.client.0.smithi070.stdout:8/781: dread d4/db/d64/ff3 [0,4194304] 0 2024-09-20T20:31:43.727 INFO:tasks.workunit.client.0.smithi070.stdout:6/857: symlink d4/d8/db4/db6/d104/l136 0 2024-09-20T20:31:43.727 INFO:tasks.workunit.client.0.smithi070.stdout:8/782: rename d4/f38 to d4/d27/d2a/d3e/f106 0 2024-09-20T20:31:43.728 INFO:tasks.workunit.client.0.smithi070.stdout:8/783: fdatasync d4/d27/d42/fb1 0 2024-09-20T20:31:43.729 INFO:tasks.workunit.client.0.smithi070.stdout:6/858: truncate d4/d8/d10/d54/dec/fad 2289848 0 2024-09-20T20:31:43.729 INFO:tasks.workunit.client.0.smithi070.stdout:8/784: chown d4/db/c2c 429242 1 2024-09-20T20:31:43.730 INFO:tasks.workunit.client.0.smithi070.stdout:8/785: creat d4/d27/d2a/d3e/d31/f107 x:0 0 0 2024-09-20T20:31:43.731 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:43.732 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:43.734 INFO:tasks.workunit.client.0.smithi070.stdout:6/859: dwrite d4/d8/db4/dbd/fed [0,4194304] 0 2024-09-20T20:31:43.737 INFO:tasks.workunit.client.0.smithi070.stdout:1/778: dread d4/d32/dea/d3b/f94 [0,4194304] 0 2024-09-20T20:31:43.738 INFO:tasks.workunit.client.0.smithi070.stdout:0/728: dread d4/d8/d55/dd8/d1d/d37/d38/f74 [0,4194304] 0 2024-09-20T20:31:43.739 INFO:tasks.workunit.client.0.smithi070.stdout:1/779: dread - d4/d32/dea/d3a/d9d/db7/f7f zero size 2024-09-20T20:31:43.739 INFO:tasks.workunit.client.0.smithi070.stdout:6/860: link d4/d8/d17/c11f d4/d8/d17/db2/c137 0 2024-09-20T20:31:43.739 INFO:tasks.workunit.client.0.smithi070.stdout:3/640: write d7/d15/d1e/f49 [509132,58592] 0 2024-09-20T20:31:43.739 INFO:tasks.workunit.client.0.smithi070.stdout:1/780: creat d4/d6/d11/d63/d6c/f118 x:0 0 0 2024-09-20T20:31:43.741 INFO:tasks.workunit.client.0.smithi070.stdout:1/781: creat d4/d32/dea/d3a/d9d/db7/f119 x:0 0 0 2024-09-20T20:31:43.741 INFO:tasks.workunit.client.0.smithi070.stdout:6/861: dread d4/d8/d1e/d7e/fac [0,4194304] 0 2024-09-20T20:31:43.741 INFO:tasks.workunit.client.0.smithi070.stdout:3/641: mkdir d7/d15/d1a/d48/d66/d69/d99/dcd 0 2024-09-20T20:31:43.742 INFO:tasks.workunit.client.0.smithi070.stdout:7/687: dread d2/d52/f54 [0,4194304] 0 2024-09-20T20:31:43.742 INFO:tasks.workunit.client.0.smithi070.stdout:4/739: dread d6/d5e/d75/d40/f56 [0,4194304] 0 2024-09-20T20:31:43.742 INFO:tasks.workunit.client.0.smithi070.stdout:1/782: chown d4/d6/d11/f24 2260 1 2024-09-20T20:31:43.742 INFO:tasks.workunit.client.0.smithi070.stdout:6/862: rmdir d4/d8/d17/d33/d36/ddb 39 2024-09-20T20:31:43.743 INFO:tasks.workunit.client.0.smithi070.stdout:7/688: write d2/d19/f83 [4648835,102832] 0 2024-09-20T20:31:43.743 INFO:tasks.workunit.client.0.smithi070.stdout:1/783: mknod d4/d32/dea/c11a 0 2024-09-20T20:31:43.743 INFO:tasks.workunit.client.0.smithi070.stdout:4/740: creat d6/d5e/d75/fee x:0 0 0 2024-09-20T20:31:43.743 INFO:tasks.workunit.client.0.smithi070.stdout:3/642: creat d7/d15/d1a/d48/d66/d69/d99/dcd/fce x:0 0 0 2024-09-20T20:31:43.744 INFO:tasks.workunit.client.0.smithi070.stdout:7/689: symlink d2/d65/le0 0 2024-09-20T20:31:43.744 INFO:tasks.workunit.client.0.smithi070.stdout:1/784: rmdir d4/d6/d11/d7b 39 2024-09-20T20:31:43.744 INFO:tasks.workunit.client.0.smithi070.stdout:7/690: creat d2/d19/dbe/dd0/fe1 x:0 0 0 2024-09-20T20:31:43.744 INFO:tasks.workunit.client.0.smithi070.stdout:4/741: truncate d6/d26/d69/d71/f79 2189268 0 2024-09-20T20:31:43.745 INFO:tasks.workunit.client.0.smithi070.stdout:4/742: fsync d6/d5e/d51/d78/dbc/fe0 0 2024-09-20T20:31:43.745 INFO:tasks.workunit.client.0.smithi070.stdout:7/691: creat d2/d8/fe2 x:0 0 0 2024-09-20T20:31:43.746 INFO:tasks.workunit.client.0.smithi070.stdout:4/743: stat d6/d7/f59 0 2024-09-20T20:31:43.746 INFO:tasks.workunit.client.0.smithi070.stdout:7/692: write d2/d19/d25/d61/fb1 [1368895,955] 0 2024-09-20T20:31:43.747 INFO:tasks.workunit.client.0.smithi070.stdout:7/693: creat d2/d30/fe3 x:0 0 0 2024-09-20T20:31:43.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:43.750 INFO:tasks.workunit.client.0.smithi070.stdout:7/694: unlink d2/d19/d25/d42/d55/fb5 0 2024-09-20T20:31:43.750 INFO:tasks.workunit.client.0.smithi070.stdout:7/695: readlink d2/d30/ld8 0 2024-09-20T20:31:43.751 INFO:tasks.workunit.client.0.smithi070.stdout:6/863: dwrite d4/d8/d10/d54/d55/d72/f79 [0,4194304] 0 2024-09-20T20:31:43.752 INFO:tasks.workunit.client.0.smithi070.stdout:6/864: rename d4/d8/d10/d3c/ca8 to d4/d8/d10/d54/db1/c138 0 2024-09-20T20:31:43.753 INFO:tasks.workunit.client.0.smithi070.stdout:4/744: dwrite d6/d7/dc/d20/f99 [0,4194304] 0 2024-09-20T20:31:43.755 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:43.747+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:43.755 INFO:tasks.workunit.client.0.smithi070.stdout:0/729: dread d4/d19/f29 [0,4194304] 0 2024-09-20T20:31:43.757 INFO:tasks.workunit.client.0.smithi070.stdout:0/730: chown d4/d48/d4e/f90 3 1 2024-09-20T20:31:43.758 INFO:tasks.workunit.client.0.smithi070.stdout:0/731: symlink d4/d19/d5b/le2 0 2024-09-20T20:31:43.758 INFO:tasks.workunit.client.0.smithi070.stdout:7/696: dwrite d2/d65/fa0 [0,4194304] 0 2024-09-20T20:31:43.758 INFO:tasks.workunit.client.0.smithi070.stdout:7/697: fsync d2/f68 0 2024-09-20T20:31:43.759 INFO:tasks.workunit.client.0.smithi070.stdout:7/698: chown d2/d19/d25/da2 4725 1 2024-09-20T20:31:43.759 INFO:tasks.workunit.client.0.smithi070.stdout:0/732: write d4/d8/d55/fb3 [69103,51352] 0 2024-09-20T20:31:43.760 INFO:tasks.workunit.client.0.smithi070.stdout:0/733: write d4/f11 [488767,62907] 0 2024-09-20T20:31:43.761 INFO:tasks.workunit.client.0.smithi070.stdout:7/699: mknod d2/d19/d25/d2a/ce4 0 2024-09-20T20:31:43.762 INFO:tasks.workunit.client.0.smithi070.stdout:7/700: stat d2/d30/d78/fbf 0 2024-09-20T20:31:43.763 INFO:tasks.workunit.client.0.smithi070.stdout:0/734: creat d4/d8/d55/dd8/d1d/fe3 x:0 0 0 2024-09-20T20:31:43.763 INFO:tasks.workunit.client.0.smithi070.stdout:0/735: fdatasync d4/d1b/f98 0 2024-09-20T20:31:43.764 INFO:tasks.workunit.client.0.smithi070.stdout:4/745: truncate d6/d7/f3b 534088 0 2024-09-20T20:31:43.764 INFO:tasks.workunit.client.0.smithi070.stdout:1/785: dread d4/d32/dea/d3a/d9d/db7/ffd [0,4194304] 0 2024-09-20T20:31:43.764 INFO:tasks.workunit.client.0.smithi070.stdout:4/746: creat d6/d5e/d51/dc8/fef x:0 0 0 2024-09-20T20:31:43.765 INFO:tasks.workunit.client.0.smithi070.stdout:0/736: link d4/d8/d55/dd8/d1d/d37/d38/f5c d4/d48/d7b/fe4 0 2024-09-20T20:31:43.765 INFO:tasks.workunit.client.0.smithi070.stdout:4/747: write d6/d7/dc/d4a/d58/f6c [2362008,50391] 0 2024-09-20T20:31:43.765 INFO:tasks.workunit.client.0.smithi070.stdout:4/748: chown d6/d5e 0 1 2024-09-20T20:31:43.766 INFO:tasks.workunit.client.0.smithi070.stdout:0/737: creat d4/d48/d7b/d8c/dce/fe5 x:0 0 0 2024-09-20T20:31:43.766 INFO:tasks.workunit.client.0.smithi070.stdout:0/738: write d4/d48/d7b/fc3 [158827,45633] 0 2024-09-20T20:31:43.766 INFO:tasks.workunit.client.0.smithi070.stdout:4/749: write d6/d26/d69/d71/f6d [2284809,67394] 0 2024-09-20T20:31:43.767 INFO:tasks.workunit.client.0.smithi070.stdout:0/739: chown d4/d8/d12/d23 19321891 1 2024-09-20T20:31:43.768 INFO:tasks.workunit.client.0.smithi070.stdout:0/740: rename d4/d13 to d4/d48/de6 0 2024-09-20T20:31:43.768 INFO:tasks.workunit.client.0.smithi070.stdout:4/750: read d6/d26/d69/d71/f79 [1167903,9720] 0 2024-09-20T20:31:43.769 INFO:tasks.workunit.client.0.smithi070.stdout:4/751: rename d6/d5e/lbf to d6/d26/deb/lf0 0 2024-09-20T20:31:43.772 INFO:tasks.workunit.client.0.smithi070.stdout:1/786: dread d4/d6/f47 [0,4194304] 0 2024-09-20T20:31:43.773 INFO:tasks.workunit.client.0.smithi070.stdout:1/787: stat d4/d6/d11/d63/de7/d44/d4b/d87/f100 0 2024-09-20T20:31:43.773 INFO:tasks.workunit.client.0.smithi070.stdout:7/701: write d2/d19/d25/d2a/f6b [4354174,68540] 0 2024-09-20T20:31:43.773 INFO:tasks.workunit.client.0.smithi070.stdout:0/741: dwrite d4/d8/d55/dd8/d1d/fe3 [0,4194304] 0 2024-09-20T20:31:43.774 INFO:tasks.workunit.client.0.smithi070.stdout:3/643: dread d7/f1b [0,4194304] 0 2024-09-20T20:31:43.774 INFO:tasks.workunit.client.0.smithi070.stdout:7/702: write d2/d65/fa3 [335398,77967] 0 2024-09-20T20:31:43.774 INFO:tasks.workunit.client.0.smithi070.stdout:7/703: dread - d2/d19/dbe/dd0/fe1 zero size 2024-09-20T20:31:43.776 INFO:tasks.workunit.client.0.smithi070.stdout:1/788: symlink d4/d6/d11/d63/da3/l11b 0 2024-09-20T20:31:43.777 INFO:tasks.workunit.client.0.smithi070.stdout:1/789: write d4/d6/d11/f42 [1237863,107198] 0 2024-09-20T20:31:43.779 INFO:tasks.workunit.client.0.smithi070.stdout:4/752: write d6/d7/dc/f8a [39017,21472] 0 2024-09-20T20:31:43.779 INFO:tasks.workunit.client.0.smithi070.stdout:0/742: dwrite d4/d48/de6/f68 [4194304,4194304] 0 2024-09-20T20:31:43.781 INFO:tasks.workunit.client.0.smithi070.stdout:4/753: unlink d6/d7/dc/d20/fd8 0 2024-09-20T20:31:43.784 INFO:tasks.workunit.client.0.smithi070.stdout:7/704: dwrite d2/d19/d25/d42/f91 [0,4194304] 0 2024-09-20T20:31:43.784 INFO:tasks.workunit.client.0.smithi070.stdout:4/754: dread d6/ff [0,4194304] 0 2024-09-20T20:31:43.785 INFO:tasks.workunit.client.0.smithi070.stdout:7/705: readlink d2/d30/d63/lce 0 2024-09-20T20:31:43.785 INFO:tasks.workunit.client.0.smithi070.stdout:4/755: read - d6/d5e/fe8 zero size 2024-09-20T20:31:43.786 INFO:tasks.workunit.client.0.smithi070.stdout:7/706: chown d2/d30/d78/cc8 6482984 1 2024-09-20T20:31:43.786 INFO:tasks.workunit.client.0.smithi070.stdout:0/743: dwrite d4/d48/d4e/f5a [0,4194304] 0 2024-09-20T20:31:43.786 INFO:tasks.workunit.client.0.smithi070.stdout:4/756: read d6/d43/f60 [3651142,92121] 0 2024-09-20T20:31:43.787 INFO:tasks.workunit.client.0.smithi070.stdout:3/644: truncate d7/d15/d1a/d48/d66/d69/d13/d1d/f47 3132521 0 2024-09-20T20:31:43.787 INFO:tasks.workunit.client.0.smithi070.stdout:0/744: creat d4/d8/d55/dd8/d1f/fe7 x:0 0 0 2024-09-20T20:31:43.788 INFO:tasks.workunit.client.0.smithi070.stdout:4/757: mkdir d6/d26/dd7/df1 0 2024-09-20T20:31:43.788 INFO:tasks.workunit.client.0.smithi070.stdout:7/707: rename d2/d19/d25/d2a/l2f to d2/d19/d25/d61/le5 0 2024-09-20T20:31:43.788 INFO:tasks.workunit.client.0.smithi070.stdout:0/745: write d4/d48/d7b/fbc [2676632,108451] 0 2024-09-20T20:31:43.789 INFO:tasks.workunit.client.0.smithi070.stdout:3/645: truncate d7/d15/d1a/d80/d8e/fa7 739358 0 2024-09-20T20:31:43.790 INFO:tasks.workunit.client.0.smithi070.stdout:0/746: write d4/d48/d7b/fdb [597099,24060] 0 2024-09-20T20:31:43.791 INFO:tasks.workunit.client.0.smithi070.stdout:7/708: read d2/d19/d2e/f41 [3069800,87142] 0 2024-09-20T20:31:43.791 INFO:tasks.workunit.client.0.smithi070.stdout:0/747: mknod d4/d48/d67/da5/ce8 0 2024-09-20T20:31:43.791 INFO:tasks.workunit.client.0.smithi070.stdout:1/790: dwrite d4/d6/d11/d63/de7/d44/d5a/fc1 [0,4194304] 0 2024-09-20T20:31:43.793 INFO:tasks.workunit.client.0.smithi070.stdout:3/646: dread d7/f1b [4194304,4194304] 0 2024-09-20T20:31:43.793 INFO:tasks.workunit.client.0.smithi070.stdout:0/748: symlink d4/d48/d7b/d8c/le9 0 2024-09-20T20:31:43.794 INFO:tasks.workunit.client.0.smithi070.stdout:0/749: fsync d4/d8/d12/f25 0 2024-09-20T20:31:43.794 INFO:tasks.workunit.client.0.smithi070.stdout:1/791: fsync d4/d6/d11/d63/de7/d44/fc8 0 2024-09-20T20:31:43.794 INFO:tasks.workunit.client.0.smithi070.stdout:0/750: readlink d4/d48/de6/lc7 0 2024-09-20T20:31:43.795 INFO:tasks.workunit.client.0.smithi070.stdout:4/758: dwrite d6/d26/fbe [0,4194304] 0 2024-09-20T20:31:43.797 INFO:tasks.workunit.client.0.smithi070.stdout:7/709: rename d2/d19/d25/d42/d55 to d2/d19/d25/d2a/dd4/dd7/de6 0 2024-09-20T20:31:43.797 INFO:tasks.workunit.client.0.smithi070.stdout:0/751: rmdir d4 39 2024-09-20T20:31:43.797 INFO:tasks.workunit.client.0.smithi070.stdout:5/746: sync 2024-09-20T20:31:43.797 INFO:tasks.workunit.client.0.smithi070.stdout:1/792: creat d4/d6/d11/d63/dd7/f11c x:0 0 0 2024-09-20T20:31:43.797 INFO:tasks.workunit.client.0.smithi070.stdout:4/759: creat d6/d7/dc/d4a/d81/ff2 x:0 0 0 2024-09-20T20:31:43.798 INFO:tasks.workunit.client.0.smithi070.stdout:7/710: fsync d2/f35 0 2024-09-20T20:31:43.799 INFO:tasks.workunit.client.0.smithi070.stdout:4/760: chown d6/d5e/l31 17900802 1 2024-09-20T20:31:43.800 INFO:tasks.workunit.client.0.smithi070.stdout:4/761: write d6/d26/fc1 [284090,32293] 0 2024-09-20T20:31:43.801 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:31:43.803 INFO:tasks.workunit.client.0.smithi070.stdout:4/762: mknod d6/d26/d69/d71/cf3 0 2024-09-20T20:31:43.803 INFO:tasks.workunit.client.0.smithi070.stdout:7/711: dread d2/d52/f6d [0,4194304] 0 2024-09-20T20:31:43.803 INFO:tasks.workunit.client.0.smithi070.stdout:4/763: fdatasync d6/f6f 0 2024-09-20T20:31:43.803 INFO:tasks.workunit.client.0.smithi070.stdout:4/764: chown d6/d7/f3e 2 1 2024-09-20T20:31:43.807 INFO:tasks.workunit.client.0.smithi070.stdout:3/647: truncate d7/f14 7733787 0 2024-09-20T20:31:43.808 INFO:tasks.workunit.client.0.smithi070.stdout:3/648: truncate d7/d15/d1a/d4a/fae 442763 0 2024-09-20T20:31:43.809 INFO:tasks.workunit.client.0.smithi070.stdout:0/752: fdatasync d4/d48/d7b/fdb 0 2024-09-20T20:31:43.809 INFO:tasks.workunit.client.0.smithi070.stdout:0/753: symlink d4/lea 0 2024-09-20T20:31:43.810 INFO:tasks.workunit.client.0.smithi070.stdout:0/754: chown d4/d8/f4a 9870 1 2024-09-20T20:31:43.810 INFO:tasks.workunit.client.0.smithi070.stdout:0/755: chown c3 4676785 1 2024-09-20T20:31:43.811 INFO:tasks.workunit.client.0.smithi070.stdout:0/756: symlink d4/d8/d12/d23/db2/leb 0 2024-09-20T20:31:43.812 INFO:tasks.workunit.client.0.smithi070.stdout:5/747: truncate d2/d7/d60/f6f 1406489 0 2024-09-20T20:31:43.816 INFO:tasks.workunit.client.0.smithi070.stdout:0/757: rename d4/d8/d55/dd8/d1d/fe0 to d4/d8/d12/d43/d3b/fec 0 2024-09-20T20:31:43.819 INFO:tasks.workunit.client.0.smithi070.stdout:1/793: dread d4/d32/d60/dca/fe4 [0,4194304] 0 2024-09-20T20:31:43.819 INFO:tasks.workunit.client.0.smithi070.stdout:5/748: dwrite d2/d4/d53/d59/f8f [0,4194304] 0 2024-09-20T20:31:43.822 INFO:tasks.workunit.client.0.smithi070.stdout:0/758: dread d4/d8/f30 [0,4194304] 0 2024-09-20T20:31:43.822 INFO:tasks.workunit.client.0.smithi070.stdout:5/749: truncate d2/d4/d98/d5b/d90/fd0 981596 0 2024-09-20T20:31:43.822 INFO:tasks.workunit.client.0.smithi070.stdout:1/794: mknod d4/d6/d11/d63/de7/d44/d4b/d87/da9/c11d 0 2024-09-20T20:31:43.822 INFO:tasks.workunit.client.0.smithi070.stdout:0/759: symlink d4/d19/led 0 2024-09-20T20:31:43.822 INFO:tasks.workunit.client.0.smithi070.stdout:5/750: creat d2/f101 x:0 0 0 2024-09-20T20:31:43.823 INFO:tasks.workunit.client.0.smithi070.stdout:4/765: dread d6/d7/dc/d4a/d81/fea [0,4194304] 0 2024-09-20T20:31:43.824 INFO:tasks.workunit.client.0.smithi070.stdout:3/649: dread d7/fd [0,4194304] 0 2024-09-20T20:31:43.826 INFO:tasks.workunit.client.0.smithi070.stdout:3/650: mknod d7/d15/d1a/d48/d66/d69/ccf 0 2024-09-20T20:31:43.828 INFO:tasks.workunit.client.0.smithi070.stdout:1/795: dwrite d4/d6/f17 [0,4194304] 0 2024-09-20T20:31:43.828 INFO:tasks.workunit.client.0.smithi070.stdout:0/760: dwrite d4/d8/d55/fb3 [0,4194304] 0 2024-09-20T20:31:43.829 INFO:tasks.workunit.client.0.smithi070.stdout:0/761: creat d4/d1b/fee x:0 0 0 2024-09-20T20:31:43.831 INFO:tasks.workunit.client.0.smithi070.stdout:4/766: dread d6/d26/d69/d71/d4c/f8f [0,4194304] 0 2024-09-20T20:31:43.832 INFO:tasks.workunit.client.0.smithi070.stdout:1/796: getdents d4/d6/d11/d63/de7/d44/d4b/d87/dbb 0 2024-09-20T20:31:43.832 INFO:tasks.workunit.client.0.smithi070.stdout:4/767: creat d6/d5e/d75/d40/ff4 x:0 0 0 2024-09-20T20:31:43.833 INFO:tasks.workunit.client.0.smithi070.stdout:4/768: stat d6/d26/fc1 0 2024-09-20T20:31:43.833 INFO:tasks.workunit.client.0.smithi070.stdout:4/769: fsync d6/d7/f45 0 2024-09-20T20:31:43.834 INFO:tasks.workunit.client.0.smithi070.stdout:1/797: symlink d4/d6/d11/d63/de7/d44/l11e 0 2024-09-20T20:31:43.834 INFO:tasks.workunit.client.0.smithi070.stdout:4/770: link d6/d5e/d6b/fac d6/d5e/d51/d63/ff5 0 2024-09-20T20:31:43.836 INFO:tasks.workunit.client.0.smithi070.stdout:1/798: link d4/d6/d11/d63/d6c/f10a d4/d6/d11/d63/de7/f11f 0 2024-09-20T20:31:43.836 INFO:tasks.workunit.client.0.smithi070.stdout:0/762: dread d4/d8/d55/dd8/f33 [0,4194304] 0 2024-09-20T20:31:43.837 INFO:tasks.workunit.client.0.smithi070.stdout:1/799: getdents d4/d32/dea 0 2024-09-20T20:31:43.837 INFO:tasks.workunit.client.0.smithi070.stdout:0/763: rename d4/d8/d55/dd8/f2a to d4/d8/d55/dd8/d1d/d37/d3e/fef 0 2024-09-20T20:31:43.838 INFO:tasks.workunit.client.0.smithi070.stdout:1/800: mkdir d4/d6/d11/d63/de7/d44/d120 0 2024-09-20T20:31:43.838 INFO:tasks.workunit.client.0.smithi070.stdout:1/801: write d4/f62 [2054159,68065] 0 2024-09-20T20:31:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:1/802: truncate d4/f96 6394926 0 2024-09-20T20:31:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:3/651: dread d7/f14 [4194304,4194304] 0 2024-09-20T20:31:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:1/803: readlink d4/d6/la 0 2024-09-20T20:31:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:5/751: dread d2/f13 [0,4194304] 0 2024-09-20T20:31:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:1/804: link d4/d1f/l2e d4/d32/l121 0 2024-09-20T20:31:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:3/652: getdents d7/d15/d1a/d80/d8e 0 2024-09-20T20:31:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:5/752: fsync d2/d4/d98/d4c/f44 0 2024-09-20T20:31:43.852 INFO:tasks.workunit.client.0.smithi070.stdout:3/653: creat d7/d15/d1a/d48/d66/d69/d13/d1d/fd0 x:0 0 0 2024-09-20T20:31:43.852 INFO:tasks.workunit.client.0.smithi070.stdout:5/753: mknod d2/d4/d98/d4c/dad/dba/c102 0 2024-09-20T20:31:43.853 INFO:tasks.workunit.client.0.smithi070.stdout:5/754: symlink d2/df/d40/l103 0 2024-09-20T20:31:43.853 INFO:tasks.workunit.client.0.smithi070.stdout:5/755: fdatasync d2/df/f55 0 2024-09-20T20:31:43.854 INFO:tasks.workunit.client.0.smithi070.stdout:3/654: rename d7/d15/d1e/d65/c68 to d7/d15/d1e/d65/db6/cd1 0 2024-09-20T20:31:43.855 INFO:tasks.workunit.client.0.smithi070.stdout:3/655: link d7/lf d7/d15/d1a/d48/d66/d69/d13/d72/ld2 0 2024-09-20T20:31:43.856 INFO:tasks.workunit.client.0.smithi070.stdout:0/764: dread d4/d48/de6/f9d [0,4194304] 0 2024-09-20T20:31:43.856 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:43.852+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:43.857 INFO:tasks.workunit.client.0.smithi070.stdout:3/656: dread - d7/d15/d1a/d48/d66/d69/d99/dcd/fce zero size 2024-09-20T20:31:43.857 INFO:tasks.workunit.client.0.smithi070.stdout:0/765: write d4/d48/de6/f9d [1787636,103397] 0 2024-09-20T20:31:43.857 INFO:tasks.workunit.client.0.smithi070.stdout:3/657: fdatasync d7/d15/d1a/d48/d57/f70 0 2024-09-20T20:31:43.858 INFO:tasks.workunit.client.0.smithi070.stdout:1/805: truncate d4/d6/fc4 2957277 0 2024-09-20T20:31:43.858 INFO:tasks.workunit.client.0.smithi070.stdout:3/658: chown d7/c46 5733122 1 2024-09-20T20:31:43.859 INFO:tasks.workunit.client.0.smithi070.stdout:0/766: rename d4/f11 to d4/d8/d55/dd8/d1d/d37/d3e/ff0 0 2024-09-20T20:31:43.860 INFO:tasks.workunit.client.0.smithi070.stdout:0/767: fsync d4/d8/d55/dd8/d1d/fe3 0 2024-09-20T20:31:43.860 INFO:tasks.workunit.client.0.smithi070.stdout:5/756: dwrite d2/d4/de/d47/d67/fee [0,4194304] 0 2024-09-20T20:31:43.861 INFO:tasks.workunit.client.0.smithi070.stdout:5/757: write d2/df/d77/fcb [937781,64594] 0 2024-09-20T20:31:43.862 INFO:tasks.workunit.client.0.smithi070.stdout:5/758: mknod d2/df/d40/da8/c104 0 2024-09-20T20:31:43.863 INFO:tasks.workunit.client.0.smithi070.stdout:1/806: write d4/d6/f14 [1770625,99808] 0 2024-09-20T20:31:43.863 INFO:tasks.workunit.client.0.smithi070.stdout:5/759: symlink d2/d4/d53/l105 0 2024-09-20T20:31:43.865 INFO:tasks.workunit.client.0.smithi070.stdout:3/659: dwrite d7/d15/d1a/d48/d66/f93 [0,4194304] 0 2024-09-20T20:31:43.865 INFO:tasks.workunit.client.0.smithi070.stdout:5/760: read d2/df/f22 [1158342,110205] 0 2024-09-20T20:31:43.866 INFO:tasks.workunit.client.0.smithi070.stdout:5/761: mkdir d2/df/d77/d106 0 2024-09-20T20:31:43.866 INFO:tasks.workunit.client.0.smithi070.stdout:1/807: link d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f31 d4/d32/de6/f122 0 2024-09-20T20:31:43.866 INFO:tasks.workunit.client.0.smithi070.stdout:3/660: fsync d7/d15/d1a/d48/d66/d69/f33 0 2024-09-20T20:31:43.867 INFO:tasks.workunit.client.0.smithi070.stdout:5/762: write d2/d4/de/fb2 [583219,101109] 0 2024-09-20T20:31:43.867 INFO:tasks.workunit.client.0.smithi070.stdout:3/661: rmdir d7/d15/d1a/d4a/d51/d5b/d88 39 2024-09-20T20:31:43.868 INFO:tasks.workunit.client.0.smithi070.stdout:5/763: creat d2/d7/d60/dbd/f107 x:0 0 0 2024-09-20T20:31:43.868 INFO:tasks.workunit.client.0.smithi070.stdout:1/808: rename d4/d6/d11/d63/de7/d44/d5a/cc0 to d4/d6/d11/d63/de7/dd3/c123 0 2024-09-20T20:31:43.869 INFO:tasks.workunit.client.0.smithi070.stdout:1/809: unlink d4/d32/dea/d3a/d78/dde/f111 0 2024-09-20T20:31:43.869 INFO:tasks.workunit.client.0.smithi070.stdout:1/810: fsync d4/d32/dea/d3a/d9d/db7/f109 0 2024-09-20T20:31:43.875 INFO:tasks.workunit.client.0.smithi070.stdout:1/811: dwrite d4/d32/dea/d3a/d78/db0/fe1 [0,4194304] 0 2024-09-20T20:31:43.875 INFO:tasks.workunit.client.0.smithi070.stdout:1/812: fdatasync d4/d32/dea/d3a/d9d/db7/f109 0 2024-09-20T20:31:43.876 INFO:tasks.workunit.client.0.smithi070.stdout:1/813: creat d4/d32/d60/f124 x:0 0 0 2024-09-20T20:31:43.877 INFO:tasks.workunit.client.0.smithi070.stdout:1/814: getdents d4/d32/dea/d3a 0 2024-09-20T20:31:43.877 INFO:tasks.workunit.client.0.smithi070.stdout:1/815: mkdir d4/d32/dea/d3a/d78/d125 0 2024-09-20T20:31:43.882 INFO:tasks.workunit.client.0.smithi070.stdout:1/816: dwrite d4/d32/dea/d3a/d9d/db7/f119 [0,4194304] 0 2024-09-20T20:31:43.883 INFO:tasks.workunit.client.0.smithi070.stdout:1/817: fdatasync d4/d6/d11/d63/d6c/fbf 0 2024-09-20T20:31:43.887 INFO:tasks.workunit.client.0.smithi070.stdout:3/662: dread d7/d15/fa6 [0,4194304] 0 2024-09-20T20:31:43.889 INFO:tasks.workunit.client.0.smithi070.stdout:9/742: sync 2024-09-20T20:31:43.891 INFO:tasks.workunit.client.0.smithi070.stdout:9/743: truncate d1/df/d25/d69/f8d 2343885 0 2024-09-20T20:31:43.892 INFO:tasks.workunit.client.0.smithi070.stdout:3/663: dwrite d7/d15/d1a/f44 [0,4194304] 0 2024-09-20T20:31:43.894 INFO:tasks.workunit.client.0.smithi070.stdout:1/818: read d4/d6/d11/d63/de7/f11f [2474550,92589] 0 2024-09-20T20:31:43.894 INFO:tasks.workunit.client.0.smithi070.stdout:1/819: chown d4/d6/fd6 85 1 2024-09-20T20:31:43.896 INFO:tasks.workunit.client.0.smithi070.stdout:1/820: creat d4/d6/d11/d63/de7/d44/d120/f126 x:0 0 0 2024-09-20T20:31:43.897 INFO:tasks.workunit.client.0.smithi070.stdout:9/744: dwrite d1/df/d25/d69/d85/dad/f57 [0,4194304] 0 2024-09-20T20:31:43.898 INFO:tasks.workunit.client.0.smithi070.stdout:9/745: chown d1/df/d18/d44/da2/dcc/fe1 13353 1 2024-09-20T20:31:43.899 INFO:tasks.workunit.client.0.smithi070.stdout:9/746: write d1/df/d18/d44/da2/dcc/fe1 [3864543,36712] 0 2024-09-20T20:31:43.900 INFO:tasks.workunit.client.0.smithi070.stdout:9/747: creat d1/df/d25/d69/d80/f10d x:0 0 0 2024-09-20T20:31:43.901 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:43.901 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:43.902 INFO:tasks.workunit.client.0.smithi070.stdout:9/748: creat d1/df/d18/d44/da2/dab/f10e x:0 0 0 2024-09-20T20:31:43.902 INFO:tasks.workunit.client.0.smithi070.stdout:1/821: dwrite d4/d6/d26/f5b [0,4194304] 0 2024-09-20T20:31:43.903 INFO:tasks.workunit.client.0.smithi070.stdout:9/749: creat d1/f10f x:0 0 0 2024-09-20T20:31:43.903 INFO:tasks.workunit.client.0.smithi070.stdout:1/822: symlink d4/d6/d11/d63/da3/l127 0 2024-09-20T20:31:43.903 INFO:tasks.workunit.client.0.smithi070.stdout:9/750: mknod d1/df/d25/dc4/c110 0 2024-09-20T20:31:43.903 INFO:tasks.workunit.client.0.smithi070.stdout:9/751: readlink d1/d76/l88 0 2024-09-20T20:31:43.903 INFO:tasks.workunit.client.0.smithi070.stdout:1/823: mknod d4/d32/d116/c128 0 2024-09-20T20:31:43.905 INFO:tasks.workunit.client.0.smithi070.stdout:9/752: read d1/df/f1b [685971,124046] 0 2024-09-20T20:31:43.906 INFO:tasks.workunit.client.0.smithi070.stdout:9/753: read d1/f14 [2417695,93357] 0 2024-09-20T20:31:43.907 INFO:tasks.workunit.client.0.smithi070.stdout:9/754: stat d1/df/d25/d69/daf 0 2024-09-20T20:31:43.909 INFO:tasks.workunit.client.0.smithi070.stdout:1/824: dwrite d4/f62 [0,4194304] 0 2024-09-20T20:31:43.910 INFO:tasks.workunit.client.0.smithi070.stdout:5/764: dread d2/d4/d53/d59/f8d [0,4194304] 0 2024-09-20T20:31:43.911 INFO:tasks.workunit.client.0.smithi070.stdout:1/825: rename d4/d6/d11/d63/da3/l127 to d4/d6/d11/d63/de7/d44/d120/l129 0 2024-09-20T20:31:43.911 INFO:tasks.workunit.client.0.smithi070.stdout:5/765: creat d2/d4/de/d47/d5f/f108 x:0 0 0 2024-09-20T20:31:43.912 INFO:tasks.workunit.client.0.smithi070.stdout:1/826: symlink d4/d6/d11/d63/de7/dd3/l12a 0 2024-09-20T20:31:43.912 INFO:tasks.workunit.client.0.smithi070.stdout:5/766: write d2/d4/de/d47/fa6 [3294406,85380] 0 2024-09-20T20:31:43.917 INFO:tasks.workunit.client.0.smithi070.stdout:5/767: dread d2/d4/de/d47/d67/fee [0,4194304] 0 2024-09-20T20:31:43.917 INFO:tasks.workunit.client.0.smithi070.stdout:5/768: dread - d2/d4/d53/fa4 zero size 2024-09-20T20:31:43.918 INFO:tasks.workunit.client.0.smithi070.stdout:5/769: creat d2/d4/d98/d5b/d90/da0/f109 x:0 0 0 2024-09-20T20:31:43.919 INFO:tasks.workunit.client.0.smithi070.stdout:5/770: write d2/d4/de/d47/d67/d92/de2/fed [516558,106907] 0 2024-09-20T20:31:43.919 INFO:tasks.workunit.client.0.smithi070.stdout:5/771: creat d2/d4/d98/d5b/d90/da0/f10a x:0 0 0 2024-09-20T20:31:43.920 INFO:tasks.workunit.client.0.smithi070.stdout:5/772: mkdir d2/d4/de/d47/d10b 0 2024-09-20T20:31:43.922 INFO:tasks.workunit.client.0.smithi070.stdout:3/664: dread d7/d15/d1e/f2f [0,4194304] 0 2024-09-20T20:31:43.926 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:43.926 INFO:tasks.workunit.client.0.smithi070.stdout:5/773: dwrite d2/d4/de/d47/d67/d92/f84 [0,4194304] 0 2024-09-20T20:31:43.927 INFO:tasks.workunit.client.0.smithi070.stdout:1/827: dwrite d4/d6/d11/d63/d6c/fbe [0,4194304] 0 2024-09-20T20:31:43.928 INFO:tasks.workunit.client.0.smithi070.stdout:1/828: write d4/d32/f117 [374815,73249] 0 2024-09-20T20:31:43.929 INFO:tasks.workunit.client.0.smithi070.stdout:5/774: unlink d2/l2b 0 2024-09-20T20:31:43.929 INFO:tasks.workunit.client.0.smithi070.stdout:1/829: mknod d4/d32/dea/d3a/d78/c12b 0 2024-09-20T20:31:43.930 INFO:tasks.workunit.client.0.smithi070.stdout:5/775: getdents d2/d4/de/d47/d5f 0 2024-09-20T20:31:43.930 INFO:tasks.workunit.client.0.smithi070.stdout:5/776: stat d2/d7/d60/dbd/cbe 0 2024-09-20T20:31:43.931 INFO:tasks.workunit.client.0.smithi070.stdout:5/777: getdents d2/df 0 2024-09-20T20:31:43.932 INFO:tasks.workunit.client.0.smithi070.stdout:5/778: creat d2/d4/d53/d59/f10c x:0 0 0 2024-09-20T20:31:43.933 INFO:tasks.workunit.client.0.smithi070.stdout:5/779: chown d2/d7/d60/dbd/f107 111428 1 2024-09-20T20:31:43.934 INFO:tasks.workunit.client.0.smithi070.stdout:5/780: creat d2/f10d x:0 0 0 2024-09-20T20:31:43.935 INFO:tasks.workunit.client.0.smithi070.stdout:1/830: dread d4/d6/d11/d63/de7/d44/fc8 [0,4194304] 0 2024-09-20T20:31:43.935 INFO:tasks.workunit.client.0.smithi070.stdout:1/831: readlink d4/l53 0 2024-09-20T20:31:43.936 INFO:tasks.workunit.client.0.smithi070.stdout:5/781: getdents d2/d4/d98/d4c/dad/dba 0 2024-09-20T20:31:43.936 INFO:tasks.workunit.client.0.smithi070.stdout:1/832: creat d4/d6/d11/d63/de7/dd3/f12c x:0 0 0 2024-09-20T20:31:43.937 INFO:tasks.workunit.client.0.smithi070.stdout:5/782: creat d2/d4/d98/dc7/f10e x:0 0 0 2024-09-20T20:31:43.940 INFO:tasks.workunit.client.0.smithi070.stdout:5/783: read d2/d7/d88/f83 [1171381,69758] 0 2024-09-20T20:31:43.941 INFO:tasks.workunit.client.0.smithi070.stdout:5/784: creat d2/d4/d98/dc7/f10f x:0 0 0 2024-09-20T20:31:43.941 INFO:tasks.workunit.client.0.smithi070.stdout:3/665: dread d7/d15/d1a/d4a/d51/d5b/f6c [0,4194304] 0 2024-09-20T20:31:43.942 INFO:tasks.workunit.client.0.smithi070.stdout:1/833: dwrite d4/d6/d11/d63/de7/d44/d4b/d87/fa2 [0,4194304] 0 2024-09-20T20:31:43.943 INFO:tasks.workunit.client.0.smithi070.stdout:1/834: readlink d4/d6/l20 0 2024-09-20T20:31:43.943 INFO:tasks.workunit.client.0.smithi070.stdout:5/785: dread d2/df/d40/f7c [0,4194304] 0 2024-09-20T20:31:43.944 INFO:tasks.workunit.client.0.smithi070.stdout:5/786: mknod d2/d4/d98/d4c/dad/c110 0 2024-09-20T20:31:43.945 INFO:tasks.workunit.client.0.smithi070.stdout:5/787: fsync d2/d4/de/d47/d5f/f108 0 2024-09-20T20:31:43.946 INFO:tasks.workunit.client.0.smithi070.stdout:5/788: creat d2/d4/f111 x:0 0 0 2024-09-20T20:31:43.947 INFO:tasks.workunit.client.0.smithi070.stdout:3/666: dwrite d7/d15/f2d [0,4194304] 0 2024-09-20T20:31:43.948 INFO:tasks.workunit.client.0.smithi070.stdout:3/667: write d7/d15/d1e/f49 [230445,66136] 0 2024-09-20T20:31:43.949 INFO:tasks.workunit.client.0.smithi070.stdout:3/668: chown f5 5 1 2024-09-20T20:31:43.949 INFO:tasks.workunit.client.0.smithi070.stdout:1/835: dwrite d4/d6/d11/d63/de7/d44/d4b/d87/dbb/fc9 [0,4194304] 0 2024-09-20T20:31:43.951 INFO:tasks.workunit.client.0.smithi070.stdout:1/836: mknod d4/d32/d60/dca/c12d 0 2024-09-20T20:31:43.952 INFO:tasks.workunit.client.0.smithi070.stdout:1/837: stat d4/d6/dae/lb8 0 2024-09-20T20:31:43.953 INFO:tasks.workunit.client.0.smithi070.stdout:9/755: dread d1/df/fd6 [0,4194304] 0 2024-09-20T20:31:43.953 INFO:tasks.workunit.client.0.smithi070.stdout:5/789: dwrite d2/d7/f31 [4194304,4194304] 0 2024-09-20T20:31:43.954 INFO:tasks.workunit.client.0.smithi070.stdout:1/838: getdents d4/d32/de6/d10e 0 2024-09-20T20:31:43.955 INFO:tasks.workunit.client.0.smithi070.stdout:9/756: mkdir d1/df/d25/d69/d85/d9f/db9/de3/d111 0 2024-09-20T20:31:43.955 INFO:tasks.workunit.client.0.smithi070.stdout:2/741: sync 2024-09-20T20:31:43.955 INFO:tasks.workunit.client.0.smithi070.stdout:7/712: sync 2024-09-20T20:31:43.955 INFO:tasks.workunit.client.0.smithi070.stdout:6/865: sync 2024-09-20T20:31:43.955 INFO:tasks.workunit.client.0.smithi070.stdout:8/786: sync 2024-09-20T20:31:43.956 INFO:tasks.workunit.client.0.smithi070.stdout:5/790: link d2/d4/de/d47/d67/d92/fe5 d2/df/d77/f112 0 2024-09-20T20:31:43.956 INFO:tasks.workunit.client.0.smithi070.stdout:7/713: mkdir d2/d30/d63/db4/de7 0 2024-09-20T20:31:43.956 INFO:tasks.workunit.client.0.smithi070.stdout:5/791: dread - d2/d4/d98/d5b/fe7 zero size 2024-09-20T20:31:43.957 INFO:tasks.workunit.client.0.smithi070.stdout:6/866: creat d4/d8/d17/db2/f139 x:0 0 0 2024-09-20T20:31:43.958 INFO:tasks.workunit.client.0.smithi070.stdout:5/792: write d2/d4/de/d47/d67/d92/fd1 [4912107,85339] 0 2024-09-20T20:31:43.958 INFO:tasks.workunit.client.0.smithi070.stdout:1/839: fsync d4/d6/d11/d63/de7/d44/d4b/d87/dbb/f5f 0 2024-09-20T20:31:43.958 INFO:tasks.workunit.client.0.smithi070.stdout:8/787: creat d4/d27/f108 x:0 0 0 2024-09-20T20:31:43.958 INFO:tasks.workunit.client.0.smithi070.stdout:7/714: symlink d2/d19/dbe/dd0/dd3/le8 0 2024-09-20T20:31:43.959 INFO:tasks.workunit.client.0.smithi070.stdout:5/793: unlink d2/d7/d88/l5c 0 2024-09-20T20:31:43.959 INFO:tasks.workunit.client.0.smithi070.stdout:7/715: fdatasync d2/d8/fe2 0 2024-09-20T20:31:43.959 INFO:tasks.workunit.client.0.smithi070.stdout:8/788: write d4/d27/d2a/d3e/d39/fe4 [306584,24760] 0 2024-09-20T20:31:43.960 INFO:tasks.workunit.client.0.smithi070.stdout:7/716: fdatasync d2/d19/d25/d42/f79 0 2024-09-20T20:31:43.960 INFO:tasks.workunit.client.0.smithi070.stdout:5/794: mkdir d2/d4/d53/d59/d113 0 2024-09-20T20:31:43.961 INFO:tasks.workunit.client.0.smithi070.stdout:7/717: write d2/d19/d25/d42/f91 [3473365,37538] 0 2024-09-20T20:31:43.962 INFO:tasks.workunit.client.0.smithi070.stdout:7/718: mknod d2/d19/dbe/dd0/dd3/ce9 0 2024-09-20T20:31:43.963 INFO:tasks.workunit.client.0.smithi070.stdout:7/719: fsync d2/d19/d25/d42/f5a 0 2024-09-20T20:31:43.963 INFO:tasks.workunit.client.0.smithi070.stdout:1/840: dread d4/d6/d11/d63/d6c/fbe [0,4194304] 0 2024-09-20T20:31:43.965 INFO:tasks.workunit.client.0.smithi070.stdout:7/720: mkdir d2/d19/d25/d2a/d4a/dea 0 2024-09-20T20:31:43.965 INFO:tasks.workunit.client.0.smithi070.stdout:1/841: unlink d4/d6/d11/d63/de7/dd3/c123 0 2024-09-20T20:31:43.966 INFO:tasks.workunit.client.0.smithi070.stdout:7/721: creat d2/d65/feb x:0 0 0 2024-09-20T20:31:43.966 INFO:tasks.workunit.client.0.smithi070.stdout:1/842: chown d4/d6/dae/ce3 1 1 2024-09-20T20:31:43.967 INFO:tasks.workunit.client.0.smithi070.stdout:5/795: dwrite d2/d7/f49 [0,4194304] 0 2024-09-20T20:31:43.967 INFO:tasks.workunit.client.0.smithi070.stdout:1/843: stat d4/d6/d11/d63/de7/d44 0 2024-09-20T20:31:43.967 INFO:tasks.workunit.client.0.smithi070.stdout:5/796: fsync d2/d4/de/d47/fa6 0 2024-09-20T20:31:43.968 INFO:tasks.workunit.client.0.smithi070.stdout:5/797: dread - d2/df/d77/f112 zero size 2024-09-20T20:31:43.968 INFO:tasks.workunit.client.0.smithi070.stdout:3/669: dread f2 [0,4194304] 0 2024-09-20T20:31:43.969 INFO:tasks.workunit.client.0.smithi070.stdout:1/844: rename d4/d6/d11/d63/da3/lad to d4/d6/d11/d63/de7/d44/d4b/d87/dbb/l12e 0 2024-09-20T20:31:43.969 INFO:tasks.workunit.client.0.smithi070.stdout:5/798: creat d2/d4/de/d47/d5f/f114 x:0 0 0 2024-09-20T20:31:43.970 INFO:tasks.workunit.client.0.smithi070.stdout:5/799: fsync d2/d4/de/f34 0 2024-09-20T20:31:43.971 INFO:tasks.workunit.client.0.smithi070.stdout:6/867: dread d4/d8/d10/fe7 [0,4194304] 0 2024-09-20T20:31:43.971 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:43.969+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:43.971 INFO:tasks.workunit.client.0.smithi070.stdout:6/868: stat d4/d8/d10/f2b 0 2024-09-20T20:31:43.973 INFO:tasks.workunit.client.0.smithi070.stdout:6/869: link d4/d8/d38/f7d d4/d8/d1e/d7e/dd6/d109/f13a 0 2024-09-20T20:31:43.974 INFO:tasks.workunit.client.0.smithi070.stdout:2/742: dread d3/de/d12/f82 [4194304,4194304] 0 2024-09-20T20:31:43.975 INFO:tasks.workunit.client.0.smithi070.stdout:6/870: getdents d4/d8/d3a 0 2024-09-20T20:31:43.976 INFO:tasks.workunit.client.0.smithi070.stdout:6/871: fsync d4/d8/f124 0 2024-09-20T20:31:43.976 INFO:tasks.workunit.client.0.smithi070.stdout:1/845: dwrite d4/d6/d11/d63/de7/dd3/f12c [0,4194304] 0 2024-09-20T20:31:43.976 INFO:tasks.workunit.client.0.smithi070.stdout:5/800: dwrite d2/d4/d98/d5b/d90/da0/f109 [0,4194304] 0 2024-09-20T20:31:43.977 INFO:tasks.workunit.client.0.smithi070.stdout:1/846: dread - d4/d32/dea/d3b/f106 zero size 2024-09-20T20:31:43.977 INFO:tasks.workunit.client.0.smithi070.stdout:5/801: chown d2/df/ce3 2963406 1 2024-09-20T20:31:43.979 INFO:tasks.workunit.client.0.smithi070.stdout:2/743: rename d3/d5/d9/d1c/d1f to d3/d5/d9/d1c/dda/d104 0 2024-09-20T20:31:43.979 INFO:tasks.workunit.client.0.smithi070.stdout:1/847: creat d4/d6/d11/d63/de7/d44/d48/f12f x:0 0 0 2024-09-20T20:31:43.981 INFO:tasks.workunit.client.0.smithi070.stdout:1/848: rename d4/d32/dea/ca5 to d4/d6/d11/d63/de7/dd3/c130 0 2024-09-20T20:31:43.983 INFO:tasks.workunit.client.0.smithi070.stdout:9/757: dread d1/df/d25/d69/d85/d9f/fd5 [0,4194304] 0 2024-09-20T20:31:43.984 INFO:tasks.workunit.client.0.smithi070.stdout:6/872: dwrite d4/d8/d10/f6f [0,4194304] 0 2024-09-20T20:31:43.984 INFO:tasks.workunit.client.0.smithi070.stdout:9/758: creat d1/df/d25/d69/daf/f112 x:0 0 0 2024-09-20T20:31:43.985 INFO:tasks.workunit.client.0.smithi070.stdout:2/744: read d3/d5/d9/d1c/dda/d104/f5e [1536260,75338] 0 2024-09-20T20:31:43.987 INFO:tasks.workunit.client.0.smithi070.stdout:6/873: truncate d4/d8/d17/fc0 213951 0 2024-09-20T20:31:43.987 INFO:tasks.workunit.client.0.smithi070.stdout:1/849: dwrite d4/d32/dea/d3a/d9d/db7/f109 [0,4194304] 0 2024-09-20T20:31:43.993 INFO:tasks.workunit.client.0.smithi070.stdout:6/874: truncate d4/d8/d10/d54/d7a/fab 203584 0 2024-09-20T20:31:43.997 INFO:tasks.workunit.client.0.smithi070.stdout:6/875: dread d4/d8/db4/db6/fca [0,4194304] 0 2024-09-20T20:31:43.998 INFO:tasks.workunit.client.0.smithi070.stdout:6/876: write d4/d8/d10/d54/dec/f114 [589543,123872] 0 2024-09-20T20:31:44.004 INFO:tasks.workunit.client.0.smithi070.stdout:6/877: dwrite d4/d8/d17/db2/f139 [0,4194304] 0 2024-09-20T20:31:44.007 INFO:tasks.workunit.client.0.smithi070.stdout:6/878: creat d4/d8/d17/d33/d36/ddb/f13b x:0 0 0 2024-09-20T20:31:44.008 INFO:tasks.workunit.client.0.smithi070.stdout:6/879: creat d4/d8/db4/db6/f13c x:0 0 0 2024-09-20T20:31:44.008 INFO:tasks.workunit.client.0.smithi070.stdout:1/850: dread d4/d6/d11/d63/d6c/fbf [0,4194304] 0 2024-09-20T20:31:44.009 INFO:tasks.workunit.client.0.smithi070.stdout:6/880: mknod d4/d8/db4/db6/d104/c13d 0 2024-09-20T20:31:44.009 INFO:tasks.workunit.client.0.smithi070.stdout:1/851: truncate d4/d6/d11/d63/de7/d44/d48/f12f 598148 0 2024-09-20T20:31:44.010 INFO:tasks.workunit.client.0.smithi070.stdout:1/852: write d4/d32/dea/d3a/f68 [2175020,47210] 0 2024-09-20T20:31:44.011 INFO:tasks.workunit.client.0.smithi070.stdout:1/853: creat d4/d32/d60/f131 x:0 0 0 2024-09-20T20:31:44.012 INFO:tasks.workunit.client.0.smithi070.stdout:7/722: dread d2/d8/fcb [0,4194304] 0 2024-09-20T20:31:44.012 INFO:tasks.workunit.client.0.smithi070.stdout:1/854: symlink d4/d6/d26/l132 0 2024-09-20T20:31:44.013 INFO:tasks.workunit.client.0.smithi070.stdout:7/723: chown d2/d19/d25/d2a/dd4/dd7/de6 10 1 2024-09-20T20:31:44.013 INFO:tasks.workunit.client.0.smithi070.stdout:1/855: symlink d4/d6/ddb/l133 0 2024-09-20T20:31:44.013 INFO:tasks.workunit.client.0.smithi070.stdout:1/856: readlink d4/l8a 0 2024-09-20T20:31:44.014 INFO:tasks.workunit.client.0.smithi070.stdout:7/724: creat d2/d30/d63/db4/de7/fec x:0 0 0 2024-09-20T20:31:44.014 INFO:tasks.workunit.client.0.smithi070.stdout:8/789: dread d4/db/d64/f93 [0,4194304] 0 2024-09-20T20:31:44.015 INFO:tasks.workunit.client.0.smithi070.stdout:1/857: truncate d4/d32/fd1 676028 0 2024-09-20T20:31:44.015 INFO:tasks.workunit.client.0.smithi070.stdout:7/725: write d2/d19/d25/d42/d77/fa1 [132269,123741] 0 2024-09-20T20:31:44.016 INFO:tasks.workunit.client.0.smithi070.stdout:1/858: rename d4/d6/d11/d63/de7/d44/d4b/d87/da9/cd5 to d4/d32/c134 0 2024-09-20T20:31:44.017 INFO:tasks.workunit.client.0.smithi070.stdout:7/726: link d2/d19/d25/d42/d77/l7f d2/d30/d63/db4/led 0 2024-09-20T20:31:44.018 INFO:tasks.workunit.client.0.smithi070.stdout:7/727: creat d2/d30/d63/fee x:0 0 0 2024-09-20T20:31:44.018 INFO:tasks.workunit.client.0.smithi070.stdout:1/859: read d4/d6/d11/d63/de7/d44/d4b/d87/fd4 [995375,76203] 0 2024-09-20T20:31:44.019 INFO:tasks.workunit.client.0.smithi070.stdout:0/768: sync 2024-09-20T20:31:44.020 INFO:tasks.workunit.client.0.smithi070.stdout:4/771: sync 2024-09-20T20:31:44.020 INFO:tasks.workunit.client.0.smithi070.stdout:5/802: sync 2024-09-20T20:31:44.020 INFO:tasks.workunit.client.0.smithi070.stdout:1/860: symlink d4/d32/d60/dca/l135 0 2024-09-20T20:31:44.021 INFO:tasks.workunit.client.0.smithi070.stdout:0/769: mknod d4/d19/cf1 0 2024-09-20T20:31:44.021 INFO:tasks.workunit.client.0.smithi070.stdout:2/745: dread d3/d5/dd/f63 [0,4194304] 0 2024-09-20T20:31:44.022 INFO:tasks.workunit.client.0.smithi070.stdout:5/803: mkdir d2/d4/de/d47/d67/d92/de2/d115 0 2024-09-20T20:31:44.022 INFO:tasks.workunit.client.0.smithi070.stdout:4/772: write d6/d7/dc/d4a/d81/ff2 [816369,66903] 0 2024-09-20T20:31:44.022 INFO:tasks.workunit.client.0.smithi070.stdout:6/881: read d4/d8/d10/d54/d7a/fab [39170,8163] 0 2024-09-20T20:31:44.029 INFO:tasks.workunit.client.0.smithi070.stdout:1/861: write d4/d6/d11/d7b/d83/fba [2709024,24577] 0 2024-09-20T20:31:44.029 INFO:tasks.workunit.client.0.smithi070.stdout:7/728: truncate d2/d65/fa0 105805 0 2024-09-20T20:31:44.029 INFO:tasks.workunit.client.0.smithi070.stdout:0/770: mknod d4/d8/d12/d43/dd5/cf2 0 2024-09-20T20:31:44.029 INFO:tasks.workunit.client.0.smithi070.stdout:6/882: write d4/d8/d38/f120 [414685,78683] 0 2024-09-20T20:31:44.029 INFO:tasks.workunit.client.0.smithi070.stdout:2/746: creat d3/d5/d9/d1c/d4e/f105 x:0 0 0 2024-09-20T20:31:44.030 INFO:tasks.workunit.client.0.smithi070.stdout:4/773: write d6/fdf [85395,215] 0 2024-09-20T20:31:44.030 INFO:tasks.workunit.client.0.smithi070.stdout:5/804: symlink d2/d4/de/d47/l116 0 2024-09-20T20:31:44.030 INFO:tasks.workunit.client.0.smithi070.stdout:9/759: dread d1/df/d18/d44/fba [0,4194304] 0 2024-09-20T20:31:44.030 INFO:tasks.workunit.client.0.smithi070.stdout:0/771: rename d4/d8/f4a to d4/d48/d67/dcd/ff3 0 2024-09-20T20:31:44.030 INFO:tasks.workunit.client.0.smithi070.stdout:2/747: creat d3/d5/d9/d1c/d47/f106 x:0 0 0 2024-09-20T20:31:44.030 INFO:tasks.workunit.client.0.smithi070.stdout:1/862: read d4/d6/d11/d63/da3/faa [3130138,125014] 0 2024-09-20T20:31:44.031 INFO:tasks.workunit.client.0.smithi070.stdout:7/729: rename d2/d19/d25/d2a/ce4 to d2/d19/d7c/cef 0 2024-09-20T20:31:44.031 INFO:tasks.workunit.client.0.smithi070.stdout:4/774: mkdir d6/d26/df6 0 2024-09-20T20:31:44.031 INFO:tasks.workunit.client.0.smithi070.stdout:9/760: creat d1/df/d25/d9e/f113 x:0 0 0 2024-09-20T20:31:44.031 INFO:tasks.workunit.client.0.smithi070.stdout:0/772: truncate d4/f62 885169 0 2024-09-20T20:31:44.031 INFO:tasks.workunit.client.0.smithi070.stdout:4/775: readlink d6/d43/l64 0 2024-09-20T20:31:44.031 INFO:tasks.workunit.client.0.smithi070.stdout:0/773: read d4/d48/de6/f9d [2485287,8910] 0 2024-09-20T20:31:44.031 INFO:tasks.workunit.client.0.smithi070.stdout:2/748: getdents d3 0 2024-09-20T20:31:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:7/730: rmdir d2/d19/d25/d2a/d4a/dea 0 2024-09-20T20:31:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:4/776: read - d6/d7/dc/d20/fd1 zero size 2024-09-20T20:31:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:6/883: read d4/d8/d10/d3c/f6a [2410014,101419] 0 2024-09-20T20:31:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:0/774: rmdir d4/d8/d55/dd8/d1d/d7e 39 2024-09-20T20:31:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:4/777: write d6/d7/dc/d20/f99 [2816419,84131] 0 2024-09-20T20:31:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:3/670: sync 2024-09-20T20:31:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:9/761: chown d1/df/d18/d44/f98 437462 1 2024-09-20T20:31:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:0/775: rmdir d4/d19/d82 39 2024-09-20T20:31:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:9/762: creat d1/df/d18/d44/da2/f114 x:0 0 0 2024-09-20T20:31:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:0/776: creat d4/d8/db6/ff4 x:0 0 0 2024-09-20T20:31:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:7/731: creat d2/d19/d25/ff0 x:0 0 0 2024-09-20T20:31:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:8/790: dread d4/db/f4a [0,4194304] 0 2024-09-20T20:31:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:2/749: rename d3/de/d12/d1a/f46 to d3/d5/d9/d1c/f107 0 2024-09-20T20:31:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:1/863: dwrite d4/d6/d11/d63/f76 [0,4194304] 0 2024-09-20T20:31:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:3/671: mknod d7/d15/d1a/d48/d66/d69/d13/d7a/cd3 0 2024-09-20T20:31:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:2/750: read - d3/d5/d9/f88 zero size 2024-09-20T20:31:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:7/732: chown d2/d19/d25/d2a/d4a/fb3 2 1 2024-09-20T20:31:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:3/672: stat d7/d15/d1a/d48/d57/c63 0 2024-09-20T20:31:44.038 INFO:tasks.workunit.client.0.smithi070.stdout:9/763: creat d1/df/d38/f115 x:0 0 0 2024-09-20T20:31:44.039 INFO:tasks.workunit.client.0.smithi070.stdout:4/778: dwrite d6/d26/fb2 [0,4194304] 0 2024-09-20T20:31:44.040 INFO:tasks.workunit.client.0.smithi070.stdout:8/791: creat d4/f109 x:0 0 0 2024-09-20T20:31:44.040 INFO:tasks.workunit.client.0.smithi070.stdout:4/779: sync 2024-09-20T20:31:44.041 INFO:tasks.workunit.client.0.smithi070.stdout:5/805: dread d2/d4/d98/d5b/f5e [0,4194304] 0 2024-09-20T20:31:44.041 INFO:tasks.workunit.client.0.smithi070.stdout:1/864: rename d4/d6/c92 to d4/d32/de6/c136 0 2024-09-20T20:31:44.041 INFO:tasks.workunit.client.0.smithi070.stdout:5/806: sync 2024-09-20T20:31:44.042 INFO:tasks.workunit.client.0.smithi070.stdout:6/884: dwrite d4/d8/d68/d93/fcf [0,4194304] 0 2024-09-20T20:31:44.043 INFO:tasks.workunit.client.0.smithi070.stdout:4/780: symlink d6/d43/d5a/ddd/lf7 0 2024-09-20T20:31:44.043 INFO:tasks.workunit.client.0.smithi070.stdout:9/764: dread - d1/df/d18/d44/da2/dab/f10e zero size 2024-09-20T20:31:44.043 INFO:tasks.workunit.client.0.smithi070.stdout:0/777: dwrite d4/d8/d55/fb3 [0,4194304] 0 2024-09-20T20:31:44.044 INFO:tasks.workunit.client.0.smithi070.stdout:0/778: sync 2024-09-20T20:31:44.044 INFO:tasks.workunit.client.0.smithi070.stdout:9/765: dread - d1/df/d38/f115 zero size 2024-09-20T20:31:44.045 INFO:tasks.workunit.client.0.smithi070.stdout:5/807: creat d2/d4/d98/d4c/f117 x:0 0 0 2024-09-20T20:31:44.045 INFO:tasks.workunit.client.0.smithi070.stdout:8/792: creat d4/db/d64/d95/da5/dfb/f10a x:0 0 0 2024-09-20T20:31:44.045 INFO:tasks.workunit.client.0.smithi070.stdout:6/885: chown d4/d8/d38/c110 565782 1 2024-09-20T20:31:44.045 INFO:tasks.workunit.client.0.smithi070.stdout:4/781: fdatasync d6/d5e/d75/d40/f56 0 2024-09-20T20:31:44.046 INFO:tasks.workunit.client.0.smithi070.stdout:2/751: dwrite d3/d5/dd/f100 [0,4194304] 0 2024-09-20T20:31:44.046 INFO:tasks.workunit.client.0.smithi070.stdout:7/733: dread d2/d19/d7c/fab [0,4194304] 0 2024-09-20T20:31:44.047 INFO:tasks.workunit.client.0.smithi070.stdout:5/808: mkdir d2/df/d77/d106/d118 0 2024-09-20T20:31:44.047 INFO:tasks.workunit.client.0.smithi070.stdout:8/793: creat d4/db/d64/d7b/f10b x:0 0 0 2024-09-20T20:31:44.048 INFO:tasks.workunit.client.0.smithi070.stdout:4/782: creat d6/d7/dc/d20/ff8 x:0 0 0 2024-09-20T20:31:44.048 INFO:tasks.workunit.client.0.smithi070.stdout:6/886: mknod d4/d8/d68/d93/c13e 0 2024-09-20T20:31:44.048 INFO:tasks.workunit.client.0.smithi070.stdout:0/779: creat d4/d8/d55/dd8/d1d/d37/d38/ff5 x:0 0 0 2024-09-20T20:31:44.049 INFO:tasks.workunit.client.0.smithi070.stdout:8/794: fdatasync d4/db/d64/d95/da5/fab 0 2024-09-20T20:31:44.049 INFO:tasks.workunit.client.0.smithi070.stdout:6/887: readlink d4/d8/l51 0 2024-09-20T20:31:44.049 INFO:tasks.workunit.client.0.smithi070.stdout:3/673: truncate d7/d15/d1e/da9/fbd 2862668 0 2024-09-20T20:31:44.049 INFO:tasks.workunit.client.0.smithi070.stdout:2/752: readlink d3/d5/d9/d1c/dda/d104/d3e/d61/db2/ld8 0 2024-09-20T20:31:44.050 INFO:tasks.workunit.client.0.smithi070.stdout:5/809: symlink d2/df/d40/da8/l119 0 2024-09-20T20:31:44.051 INFO:tasks.workunit.client.0.smithi070.stdout:4/783: mknod d6/d5e/d6b/d74/cf9 0 2024-09-20T20:31:44.051 INFO:tasks.workunit.client.0.smithi070.stdout:3/674: readlink l6 0 2024-09-20T20:31:44.051 INFO:tasks.workunit.client.0.smithi070.stdout:1/865: dread d4/d6/d11/d63/de7/d44/d4b/d87/fa2 [0,4194304] 0 2024-09-20T20:31:44.051 INFO:tasks.workunit.client.0.smithi070.stdout:8/795: write d4/d27/d42/f72 [2386974,50828] 0 2024-09-20T20:31:44.051 INFO:tasks.workunit.client.0.smithi070.stdout:6/888: symlink d4/d8/d68/d93/dba/l13f 0 2024-09-20T20:31:44.051 INFO:tasks.workunit.client.0.smithi070.stdout:0/780: rename d4/d8/fb0 to d4/d48/d67/da5/ff6 0 2024-09-20T20:31:44.051 INFO:tasks.workunit.client.0.smithi070.stdout:4/784: unlink d6/d5e/d51/d78/dbc/fce 0 2024-09-20T20:31:44.052 INFO:tasks.workunit.client.0.smithi070.stdout:3/675: write d7/d15/d1a/d4a/d51/d5b/f6a [1585537,12784] 0 2024-09-20T20:31:44.052 INFO:tasks.workunit.client.0.smithi070.stdout:2/753: truncate d3/d5/dd/ff 3835065 0 2024-09-20T20:31:44.052 INFO:tasks.workunit.client.0.smithi070.stdout:1/866: truncate d4/d32/dea/f46 650358 0 2024-09-20T20:31:44.053 INFO:tasks.workunit.client.0.smithi070.stdout:3/676: read d7/d15/d1a/d48/d66/f93 [3572355,85185] 0 2024-09-20T20:31:44.053 INFO:tasks.workunit.client.0.smithi070.stdout:8/796: truncate d4/db/d64/f8c 597983 0 2024-09-20T20:31:44.053 INFO:tasks.workunit.client.0.smithi070.stdout:1/867: fdatasync d4/d6/d11/d63/d6c/fbe 0 2024-09-20T20:31:44.053 INFO:tasks.workunit.client.0.smithi070.stdout:3/677: rmdir d7/d15/d1e 39 2024-09-20T20:31:44.054 INFO:tasks.workunit.client.0.smithi070.stdout:2/754: creat d3/d5/d9/d1c/dda/d104/d3e/d61/db2/dff/f108 x:0 0 0 2024-09-20T20:31:44.054 INFO:tasks.workunit.client.0.smithi070.stdout:8/797: rename d4/db/d66/f78 to d4/d27/d2a/d3e/d31/d63/f10c 0 2024-09-20T20:31:44.055 INFO:tasks.workunit.client.0.smithi070.stdout:2/755: stat d3/d5/d9/d1c/d4e/da4/cdc 0 2024-09-20T20:31:44.055 INFO:tasks.workunit.client.0.smithi070.stdout:9/766: read d1/df/d25/f58 [536157,124548] 0 2024-09-20T20:31:44.057 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:44.053+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:44.058 INFO:tasks.workunit.client.0.smithi070.stdout:4/785: dwrite d6/d43/d5a/f68 [0,4194304] 0 2024-09-20T20:31:44.058 INFO:tasks.workunit.client.0.smithi070.stdout:2/756: unlink d3/lca 0 2024-09-20T20:31:44.059 INFO:tasks.workunit.client.0.smithi070.stdout:6/889: dwrite d4/d8/d38/f116 [0,4194304] 0 2024-09-20T20:31:44.060 INFO:tasks.workunit.client.0.smithi070.stdout:9/767: mkdir d1/df/d18/d44/d77/dd0/d116 0 2024-09-20T20:31:44.061 INFO:tasks.workunit.client.0.smithi070.stdout:6/890: chown d4/d8/d17/f57 22897 1 2024-09-20T20:31:44.062 INFO:tasks.workunit.client.0.smithi070.stdout:9/768: write d1/df/d18/f66 [2893436,11850] 0 2024-09-20T20:31:44.062 INFO:tasks.workunit.client.0.smithi070.stdout:6/891: chown d4/d8/db4 0 1 2024-09-20T20:31:44.063 INFO:tasks.workunit.client.0.smithi070.stdout:0/781: dwrite d4/d8/db6/ff4 [0,4194304] 0 2024-09-20T20:31:44.065 INFO:tasks.workunit.client.0.smithi070.stdout:3/678: dwrite d7/d15/d1a/d48/d66/d69/fc [0,4194304] 0 2024-09-20T20:31:44.065 INFO:tasks.workunit.client.0.smithi070.stdout:6/892: creat d4/d8/d10/d54/d55/f140 x:0 0 0 2024-09-20T20:31:44.066 INFO:tasks.workunit.client.0.smithi070.stdout:0/782: rename d4/d48/d67/da5/fd3 to d4/d8/d55/dd8/d1f/ff7 0 2024-09-20T20:31:44.066 INFO:tasks.workunit.client.0.smithi070.stdout:3/679: mkdir d7/d15/d1e/d60/dd4 0 2024-09-20T20:31:44.066 INFO:tasks.workunit.client.0.smithi070.stdout:6/893: symlink d4/d8/d1e/d7e/dd6/l141 0 2024-09-20T20:31:44.068 INFO:tasks.workunit.client.0.smithi070.stdout:7/734: truncate d2/d8/fcb 2366786 0 2024-09-20T20:31:44.069 INFO:tasks.workunit.client.0.smithi070.stdout:6/894: dread - d4/d8/d10/d54/d7a/f122 zero size 2024-09-20T20:31:44.070 INFO:tasks.workunit.client.0.smithi070.stdout:3/680: creat d7/d15/d1e/d60/dd4/fd5 x:0 0 0 2024-09-20T20:31:44.071 INFO:tasks.workunit.client.0.smithi070.stdout:3/681: chown d7/d71/l84 28 1 2024-09-20T20:31:44.071 INFO:tasks.workunit.client.0.smithi070.stdout:6/895: link d4/d8/db4/ld7 d4/d8/d17/d33/d61/d73/d10a/d112/l142 0 2024-09-20T20:31:44.072 INFO:tasks.workunit.client.0.smithi070.stdout:3/682: rename d7/d15/d1a/f4e to d7/d15/d1a/d4a/d51/d5b/d9e/fd6 0 2024-09-20T20:31:44.073 INFO:tasks.workunit.client.0.smithi070.stdout:6/896: getdents d4/d8/d68 0 2024-09-20T20:31:44.074 INFO:tasks.workunit.client.0.smithi070.stdout:6/897: dread d4/d8/db4/db6/fca [0,4194304] 0 2024-09-20T20:31:44.075 INFO:tasks.workunit.client.0.smithi070.stdout:7/735: dwrite d2/d19/d25/d42/f79 [0,4194304] 0 2024-09-20T20:31:44.075 INFO:tasks.workunit.client.0.smithi070.stdout:6/898: creat d4/d8/d17/db2/db5/f143 x:0 0 0 2024-09-20T20:31:44.075 INFO:tasks.workunit.client.0.smithi070.stdout:7/736: getdents d2/dd5 0 2024-09-20T20:31:44.077 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:44.077 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:44.078 INFO:tasks.workunit.client.0.smithi070.stdout:7/737: rename d2/d30/l7a to d2/d30/d63/db4/de7/lf1 0 2024-09-20T20:31:44.078 INFO:tasks.workunit.client.0.smithi070.stdout:7/738: mknod d2/d19/d2e/cf2 0 2024-09-20T20:31:44.079 INFO:tasks.workunit.client.0.smithi070.stdout:8/798: dread d4/d27/d2a/d3e/f56 [4194304,4194304] 0 2024-09-20T20:31:44.082 INFO:tasks.workunit.client.0.smithi070.stdout:7/739: dwrite d2/d30/d63/db4/fb8 [0,4194304] 0 2024-09-20T20:31:44.085 INFO:tasks.workunit.client.0.smithi070.stdout:1/868: truncate d4/d6/d11/f10 3505952 0 2024-09-20T20:31:44.086 INFO:tasks.workunit.client.0.smithi070.stdout:5/810: dread d2/d4/d98/d5b/f26 [0,4194304] 0 2024-09-20T20:31:44.086 INFO:tasks.workunit.client.0.smithi070.stdout:4/786: write d6/d7/dc/f52 [576725,14013] 0 2024-09-20T20:31:44.086 INFO:tasks.workunit.client.0.smithi070.stdout:9/769: truncate d1/df/d18/d46/f55 395610 0 2024-09-20T20:31:44.087 INFO:tasks.workunit.client.0.smithi070.stdout:1/869: write d4/d6/fbd [215054,114189] 0 2024-09-20T20:31:44.089 INFO:tasks.workunit.client.0.smithi070.stdout:9/770: symlink d1/df/d18/d44/da2/db7/l117 0 2024-09-20T20:31:44.089 INFO:tasks.workunit.client.0.smithi070.stdout:1/870: creat d4/d6/d26/f137 x:0 0 0 2024-09-20T20:31:44.090 INFO:tasks.workunit.client.0.smithi070.stdout:1/871: chown d4/d6/l1c 51818 1 2024-09-20T20:31:44.092 INFO:tasks.workunit.client.0.smithi070.stdout:1/872: write d4/d32/dea/d3b/f3e [649838,98646] 0 2024-09-20T20:31:44.092 INFO:tasks.workunit.client.0.smithi070.stdout:6/899: truncate d4/d8/f69 88646 0 2024-09-20T20:31:44.092 INFO:tasks.workunit.client.0.smithi070.stdout:4/787: dread d6/d5e/d51/d63/ff5 [0,4194304] 0 2024-09-20T20:31:44.093 INFO:tasks.workunit.client.0.smithi070.stdout:4/788: readlink d6/d43/lb3 0 2024-09-20T20:31:44.094 INFO:tasks.workunit.client.0.smithi070.stdout:5/811: dwrite d2/d4/d98/dc7/fbc [0,4194304] 0 2024-09-20T20:31:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:0/783: dread d4/d8/d55/dd8/f51 [0,4194304] 0 2024-09-20T20:31:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:1/873: write d4/d32/dea/d3b/f3e [508292,123890] 0 2024-09-20T20:31:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:2/757: truncate d3/d5/d9/f48 621998 0 2024-09-20T20:31:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:4/789: creat d6/d5e/d6b/d74/dd3/ffa x:0 0 0 2024-09-20T20:31:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:3/683: dread d7/d15/d1a/d48/d66/d69/d13/fb4 [0,4194304] 0 2024-09-20T20:31:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:7/740: dwrite d2/f45 [0,4194304] 0 2024-09-20T20:31:44.100 INFO:tasks.workunit.client.0.smithi070.stdout:9/771: truncate d1/f61 1339809 0 2024-09-20T20:31:44.100 INFO:tasks.workunit.client.0.smithi070.stdout:0/784: rename d4/d8/d12/d43 to d4/d8/d55/dd8/d1d/d37/d3e/df8 0 2024-09-20T20:31:44.101 INFO:tasks.workunit.client.0.smithi070.stdout:6/900: dread d4/d8/d10/ff5 [0,4194304] 0 2024-09-20T20:31:44.102 INFO:tasks.workunit.client.0.smithi070.stdout:9/772: rmdir d1/d76 39 2024-09-20T20:31:44.103 INFO:tasks.workunit.client.0.smithi070.stdout:4/790: mknod d6/d26/d69/d71/d4c/dcc/cfb 0 2024-09-20T20:31:44.103 INFO:tasks.workunit.client.0.smithi070.stdout:6/901: sync 2024-09-20T20:31:44.103 INFO:tasks.workunit.client.0.smithi070.stdout:7/741: mkdir d2/d30/d63/d69/df3 0 2024-09-20T20:31:44.103 INFO:tasks.workunit.client.0.smithi070.stdout:3/684: creat d7/fd7 x:0 0 0 2024-09-20T20:31:44.103 INFO:tasks.workunit.client.0.smithi070.stdout:4/791: stat d6/d26/dd7/fe9 0 2024-09-20T20:31:44.103 INFO:tasks.workunit.client.0.smithi070.stdout:0/785: symlink d4/d8/d55/d7c/lf9 0 2024-09-20T20:31:44.104 INFO:tasks.workunit.client.0.smithi070.stdout:4/792: symlink d6/d26/d69/d71/lfc 0 2024-09-20T20:31:44.105 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:44.106 INFO:tasks.workunit.client.0.smithi070.stdout:1/874: dwrite d4/d6/d11/f3f [0,4194304] 0 2024-09-20T20:31:44.107 INFO:tasks.workunit.client.0.smithi070.stdout:6/902: truncate d4/d8/d10/d3c/f6a 5453256 0 2024-09-20T20:31:44.107 INFO:tasks.workunit.client.0.smithi070.stdout:0/786: chown d4/d8/d55/dd8/d1d/d37/d3e/df8/fc9 442 1 2024-09-20T20:31:44.107 INFO:tasks.workunit.client.0.smithi070.stdout:4/793: chown d6/d5e/l53 4295204 1 2024-09-20T20:31:44.107 INFO:tasks.workunit.client.0.smithi070.stdout:8/799: dread d4/db/d64/ff3 [0,4194304] 0 2024-09-20T20:31:44.108 INFO:tasks.workunit.client.0.smithi070.stdout:4/794: mknod d6/d26/deb/cfd 0 2024-09-20T20:31:44.108 INFO:tasks.workunit.client.0.smithi070.stdout:4/795: sync 2024-09-20T20:31:44.109 INFO:tasks.workunit.client.0.smithi070.stdout:6/903: write d4/d8/d3a/f97 [539133,34118] 0 2024-09-20T20:31:44.109 INFO:tasks.workunit.client.0.smithi070.stdout:1/875: mkdir d4/d6/d11/d63/de7/d44/de8/d138 0 2024-09-20T20:31:44.110 INFO:tasks.workunit.client.0.smithi070.stdout:0/787: creat d4/d8/d55/dd8/d1d/d37/d3e/df8/ffa x:0 0 0 2024-09-20T20:31:44.110 INFO:tasks.workunit.client.0.smithi070.stdout:8/800: mkdir d4/d27/d2a/d43/d61/d10d 0 2024-09-20T20:31:44.110 INFO:tasks.workunit.client.0.smithi070.stdout:1/876: rmdir d4/d6/dae 39 2024-09-20T20:31:44.110 INFO:tasks.workunit.client.0.smithi070.stdout:8/801: stat d4 0 2024-09-20T20:31:44.110 INFO:tasks.workunit.client.0.smithi070.stdout:9/773: dwrite d1/df/d25/d69/d85/d9f/fd5 [0,4194304] 0 2024-09-20T20:31:44.110 INFO:tasks.workunit.client.0.smithi070.stdout:8/802: sync 2024-09-20T20:31:44.110 INFO:tasks.workunit.client.0.smithi070.stdout:0/788: mkdir d4/dfb 0 2024-09-20T20:31:44.111 INFO:tasks.workunit.client.0.smithi070.stdout:9/774: fdatasync d1/df/f19 0 2024-09-20T20:31:44.112 INFO:tasks.workunit.client.0.smithi070.stdout:1/877: unlink d4/d32/dea/d3a/d78/lfb 0 2024-09-20T20:31:44.112 INFO:tasks.workunit.client.0.smithi070.stdout:6/904: chown d4/d8/d17/d33/lb8 0 1 2024-09-20T20:31:44.115 INFO:tasks.workunit.client.0.smithi070.stdout:6/905: symlink d4/df0/d11a/l144 0 2024-09-20T20:31:44.115 INFO:tasks.workunit.client.0.smithi070.stdout:1/878: fsync d4/d6/d11/d63/de7/d44/d48/f5e 0 2024-09-20T20:31:44.115 INFO:tasks.workunit.client.0.smithi070.stdout:0/789: link d4/d8/d55/dd8/d1d/d37/ccb d4/d8/d55/dd8/d1d/d7e/cfc 0 2024-09-20T20:31:44.116 INFO:tasks.workunit.client.0.smithi070.stdout:9/775: creat d1/df/d25/d69/d80/d10b/f118 x:0 0 0 2024-09-20T20:31:44.118 INFO:tasks.workunit.client.0.smithi070.stdout:1/879: readlink d4/d32/dea/d3a/ld8 0 2024-09-20T20:31:44.118 INFO:tasks.workunit.client.0.smithi070.stdout:5/812: dwrite d2/d4/d98/f87 [0,4194304] 0 2024-09-20T20:31:44.118 INFO:tasks.workunit.client.0.smithi070.stdout:8/803: read d4/db/f5e [1615860,119473] 0 2024-09-20T20:31:44.118 INFO:tasks.workunit.client.0.smithi070.stdout:0/790: creat d4/d19/d82/ffd x:0 0 0 2024-09-20T20:31:44.119 INFO:tasks.workunit.client.0.smithi070.stdout:4/796: dwrite d6/d7/dc/f8a [0,4194304] 0 2024-09-20T20:31:44.123 INFO:tasks.workunit.client.0.smithi070.stdout:1/880: rename d4/d1f/f90 to d4/d32/dea/d3a/d9d/f139 0 2024-09-20T20:31:44.123 INFO:tasks.workunit.client.0.smithi070.stdout:6/906: getdents d4/d8/d3a/da7 0 2024-09-20T20:31:44.123 INFO:tasks.workunit.client.0.smithi070.stdout:5/813: mkdir d2/db7/d11a 0 2024-09-20T20:31:44.123 INFO:tasks.workunit.client.0.smithi070.stdout:8/804: mknod d4/db/d64/d95/c10e 0 2024-09-20T20:31:44.123 INFO:tasks.workunit.client.0.smithi070.stdout:0/791: getdents d4/d8/d55/dd8/d1d/d37/d3e/df8 0 2024-09-20T20:31:44.124 INFO:tasks.workunit.client.0.smithi070.stdout:5/814: dread - d2/d4/d98/faa zero size 2024-09-20T20:31:44.124 INFO:tasks.workunit.client.0.smithi070.stdout:1/881: unlink d4/d6/d11/d63/de7/f11f 0 2024-09-20T20:31:44.126 INFO:tasks.workunit.client.0.smithi070.stdout:5/815: mknod d2/db7/d11a/c11b 0 2024-09-20T20:31:44.126 INFO:tasks.workunit.client.0.smithi070.stdout:8/805: mknod d4/d27/d2a/d3e/c10f 0 2024-09-20T20:31:44.127 INFO:tasks.workunit.client.0.smithi070.stdout:0/792: write d4/d48/d67/dcd/ff3 [28296,71861] 0 2024-09-20T20:31:44.127 INFO:tasks.workunit.client.0.smithi070.stdout:5/816: sync 2024-09-20T20:31:44.127 INFO:tasks.workunit.client.0.smithi070.stdout:7/742: dread d2/d8/f47 [4194304,4194304] 0 2024-09-20T20:31:44.128 INFO:tasks.workunit.client.0.smithi070.stdout:8/806: creat d4/d27/d2a/d5b/d98/da9/db5/f110 x:0 0 0 2024-09-20T20:31:44.128 INFO:tasks.workunit.client.0.smithi070.stdout:5/817: mknod d2/d4/d53/d59/d113/c11c 0 2024-09-20T20:31:44.128 INFO:tasks.workunit.client.0.smithi070.stdout:0/793: getdents d4/d8/d55/dd8/d1d/d37/d3e/df8/dd5 0 2024-09-20T20:31:44.129 INFO:tasks.workunit.client.0.smithi070.stdout:5/818: write d2/d4/d98/d5b/d90/fd0 [1268348,116057] 0 2024-09-20T20:31:44.130 INFO:tasks.workunit.client.0.smithi070.stdout:9/776: truncate d1/df/d18/fc9 2086816 0 2024-09-20T20:31:44.130 INFO:tasks.workunit.client.0.smithi070.stdout:5/819: write d2/d7/f49 [3356147,13254] 0 2024-09-20T20:31:44.130 INFO:tasks.workunit.client.0.smithi070.stdout:8/807: truncate d4/d27/d2a/d3e/d31/d63/ff7 1017205 0 2024-09-20T20:31:44.130 INFO:tasks.workunit.client.0.smithi070.stdout:4/797: truncate d6/d7/dc/f52 341610 0 2024-09-20T20:31:44.131 INFO:tasks.workunit.client.0.smithi070.stdout:9/777: unlink d1/df/d25/c29 0 2024-09-20T20:31:44.132 INFO:tasks.workunit.client.0.smithi070.stdout:8/808: rmdir d4/d27/d2a/d3e/d31 39 2024-09-20T20:31:44.132 INFO:tasks.workunit.client.0.smithi070.stdout:4/798: write d6/d7/dc/d4a/d81/fa8 [865562,96302] 0 2024-09-20T20:31:44.132 INFO:tasks.workunit.client.0.smithi070.stdout:1/882: dwrite d4/d32/dea/f46 [0,4194304] 0 2024-09-20T20:31:44.136 INFO:tasks.workunit.client.0.smithi070.stdout:3/685: dread d7/d15/d1a/d48/d66/d69/f19 [0,4194304] 0 2024-09-20T20:31:44.137 INFO:tasks.workunit.client.0.smithi070.stdout:7/743: dwrite d2/d19/d25/d42/d77/f9b [0,4194304] 0 2024-09-20T20:31:44.138 INFO:tasks.workunit.client.0.smithi070.stdout:8/809: rename d4/d27/d2a/d3e/f56 to d4/d27/d2a/d5b/d6c/da6/f111 0 2024-09-20T20:31:44.139 INFO:tasks.workunit.client.0.smithi070.stdout:2/758: dread d3/de/d12/f7a [0,4194304] 0 2024-09-20T20:31:44.139 INFO:tasks.workunit.client.0.smithi070.stdout:1/883: dwrite d4/d32/dea/d3a/f68 [0,4194304] 0 2024-09-20T20:31:44.140 INFO:tasks.workunit.client.0.smithi070.stdout:0/794: write d4/d8/d55/dd8/d1d/d41/dd1/f6e [4457133,105837] 0 2024-09-20T20:31:44.142 INFO:tasks.workunit.client.0.smithi070.stdout:7/744: symlink d2/dd5/lf4 0 2024-09-20T20:31:44.142 INFO:tasks.workunit.client.0.smithi070.stdout:8/810: write d4/d27/f2f [52518,65979] 0 2024-09-20T20:31:44.142 INFO:tasks.workunit.client.0.smithi070.stdout:7/745: fdatasync d2/d8/f47 0 2024-09-20T20:31:44.142 INFO:tasks.workunit.client.0.smithi070.stdout:2/759: symlink d3/d4c/d5c/d86/dd5/de3/l109 0 2024-09-20T20:31:44.142 INFO:tasks.workunit.client.0.smithi070.stdout:1/884: fdatasync d4/d6/d11/d63/de7/d44/d4b/d87/fd4 0 2024-09-20T20:31:44.145 INFO:tasks.workunit.client.0.smithi070.stdout:5/820: truncate d2/df/f68 1030164 0 2024-09-20T20:31:44.146 INFO:tasks.workunit.client.0.smithi070.stdout:7/746: creat d2/d19/d25/ff5 x:0 0 0 2024-09-20T20:31:44.147 INFO:tasks.workunit.client.0.smithi070.stdout:7/747: rename d2/d30 to d2/d30/df6 22 2024-09-20T20:31:44.150 INFO:tasks.workunit.client.0.smithi070.stdout:5/821: write d2/d4/de/d47/d5f/fa7 [1017881,31763] 0 2024-09-20T20:31:44.150 INFO:tasks.workunit.client.0.smithi070.stdout:7/748: read - d2/d30/d63/d69/fb7 zero size 2024-09-20T20:31:44.150 INFO:tasks.workunit.client.0.smithi070.stdout:6/907: dread d4/d8/d17/d33/d36/f37 [0,4194304] 0 2024-09-20T20:31:44.151 INFO:tasks.workunit.client.0.smithi070.stdout:8/811: dwrite d4/d27/d2a/d3e/d31/d63/fac [0,4194304] 0 2024-09-20T20:31:44.152 INFO:tasks.workunit.client.0.smithi070.stdout:2/760: dwrite d3/d5/d9/d1c/d4e/f105 [0,4194304] 0 2024-09-20T20:31:44.152 INFO:tasks.workunit.client.0.smithi070.stdout:1/885: dwrite d4/d6/d11/f42 [0,4194304] 0 2024-09-20T20:31:44.154 INFO:tasks.workunit.client.0.smithi070.stdout:3/686: dwrite d7/d15/d1a/d4a/fbb [0,4194304] 0 2024-09-20T20:31:44.155 INFO:tasks.workunit.client.0.smithi070.stdout:1/886: unlink d4/d6/f52 0 2024-09-20T20:31:44.156 INFO:tasks.workunit.client.0.smithi070.stdout:2/761: mkdir d3/d5/d9/d1c/d47/d10a 0 2024-09-20T20:31:44.156 INFO:tasks.workunit.client.0.smithi070.stdout:3/687: mkdir d7/d15/d1a/d80/dd8 0 2024-09-20T20:31:44.156 INFO:tasks.workunit.client.0.smithi070.stdout:2/762: dread - d3/d5/dd/d99/ddb/ff9 zero size 2024-09-20T20:31:44.158 INFO:tasks.workunit.client.0.smithi070.stdout:6/908: dwrite d4/d8/d38/f120 [0,4194304] 0 2024-09-20T20:31:44.159 INFO:tasks.workunit.client.0.smithi070.stdout:3/688: stat d7/d15/l4b 0 2024-09-20T20:31:44.159 INFO:tasks.workunit.client.0.smithi070.stdout:7/749: truncate d2/d65/fa0 611894 0 2024-09-20T20:31:44.159 INFO:tasks.workunit.client.0.smithi070.stdout:2/763: write d3/d5/d9/d1c/dda/d104/d3e/d61/fc3 [48332,25531] 0 2024-09-20T20:31:44.159 INFO:tasks.workunit.client.0.smithi070.stdout:5/822: link d2/d7/c18 d2/d4/de/d47/d5f/c11d 0 2024-09-20T20:31:44.159 INFO:tasks.workunit.client.0.smithi070.stdout:1/887: rename d4/d32/dea/d3a/d78/la8 to d4/d6/d11/d63/l13a 0 2024-09-20T20:31:44.160 INFO:tasks.workunit.client.0.smithi070.stdout:8/812: dwrite d4/db/d64/d95/da5/f96 [0,4194304] 0 2024-09-20T20:31:44.161 INFO:tasks.workunit.client.0.smithi070.stdout:2/764: stat d3/d5/d9/d1c/dda/cfe 0 2024-09-20T20:31:44.161 INFO:tasks.workunit.client.0.smithi070.stdout:8/813: chown d4/d27/d2a/d5b/d6c/cbd 49044 1 2024-09-20T20:31:44.161 INFO:tasks.workunit.client.0.smithi070.stdout:3/689: fdatasync d7/d15/d1a/d48/d66/d69/d13/f2e 0 2024-09-20T20:31:44.161 INFO:tasks.workunit.client.0.smithi070.stdout:9/778: dread d1/df/d18/d44/d77/f7b [0,4194304] 0 2024-09-20T20:31:44.163 INFO:tasks.workunit.client.0.smithi070.stdout:6/909: stat d4/d8/d38/f5d 0 2024-09-20T20:31:44.163 INFO:tasks.workunit.client.0.smithi070.stdout:1/888: creat d4/d32/d60/dca/dd2/f13b x:0 0 0 2024-09-20T20:31:44.163 INFO:tasks.workunit.client.0.smithi070.stdout:8/814: mkdir d4/d27/dc6/d112 0 2024-09-20T20:31:44.163 INFO:tasks.workunit.client.0.smithi070.stdout:3/690: mkdir d7/d15/d1a/d80/dd9 0 2024-09-20T20:31:44.163 INFO:tasks.workunit.client.0.smithi070.stdout:5/823: creat d2/df/d77/d106/d118/f11e x:0 0 0 2024-09-20T20:31:44.164 INFO:tasks.workunit.client.0.smithi070.stdout:2/765: fsync d3/d5/dd/ff 0 2024-09-20T20:31:44.164 INFO:tasks.workunit.client.0.smithi070.stdout:3/691: fdatasync d7/d15/f2d 0 2024-09-20T20:31:44.164 INFO:tasks.workunit.client.0.smithi070.stdout:6/910: write d4/d8/f131 [291881,104367] 0 2024-09-20T20:31:44.165 INFO:tasks.workunit.client.0.smithi070.stdout:1/889: mkdir d4/d32/dea/d3a/d9d/d13c 0 2024-09-20T20:31:44.165 INFO:tasks.workunit.client.0.smithi070.stdout:2/766: stat d3/f38 0 2024-09-20T20:31:44.166 INFO:tasks.workunit.client.0.smithi070.stdout:5/824: write d2/d4/d98/dc7/f10f [88484,124980] 0 2024-09-20T20:31:44.166 INFO:tasks.workunit.client.0.smithi070.stdout:2/767: stat d3/d5/dd/d99/df7 0 2024-09-20T20:31:44.168 INFO:tasks.workunit.client.0.smithi070.stdout:7/750: dwrite d2/d8/f1d [4194304,4194304] 0 2024-09-20T20:31:44.168 INFO:tasks.workunit.client.0.smithi070.stdout:1/890: write d4/d6/d11/d63/de7/d44/d120/f126 [655845,60403] 0 2024-09-20T20:31:44.169 INFO:tasks.workunit.client.0.smithi070.stdout:8/815: creat d4/d27/d2a/d5b/d98/da9/db5/dc0/f113 x:0 0 0 2024-09-20T20:31:44.169 INFO:tasks.workunit.client.0.smithi070.stdout:6/911: truncate d4/d8/d17/d33/d61/d73/f121 500060 0 2024-09-20T20:31:44.169 INFO:tasks.workunit.client.0.smithi070.stdout:3/692: getdents d7/d15/d1a/d48/d66/d69/d99 0 2024-09-20T20:31:44.170 INFO:tasks.workunit.client.0.smithi070.stdout:2/768: rename d3/cb9 to d3/d5/dd/d99/df7/c10b 0 2024-09-20T20:31:44.170 INFO:tasks.workunit.client.0.smithi070.stdout:6/912: mkdir d4/d8/d10/d3c/d99/d145 0 2024-09-20T20:31:44.170 INFO:tasks.workunit.client.0.smithi070.stdout:9/779: dwrite d1/df/d25/db2/f10a [0,4194304] 0 2024-09-20T20:31:44.171 INFO:tasks.workunit.client.0.smithi070.stdout:1/891: rename d4/d6/d11/d63/de7/lf4 to d4/d6/d11/d7b/l13d 0 2024-09-20T20:31:44.171 INFO:tasks.workunit.client.0.smithi070.stdout:1/892: stat d4/l22 0 2024-09-20T20:31:44.172 INFO:tasks.workunit.client.0.smithi070.stdout:3/693: truncate d7/d15/d1a/d80/fc3 536945 0 2024-09-20T20:31:44.173 INFO:tasks.workunit.client.0.smithi070.stdout:9/780: write d1/df/d18/d44/d77/f7b [4268584,104065] 0 2024-09-20T20:31:44.174 INFO:tasks.workunit.client.0.smithi070.stdout:6/913: symlink d4/d8/d17/d33/d61/d73/d10a/d112/l146 0 2024-09-20T20:31:44.177 INFO:tasks.workunit.client.0.smithi070.stdout:3/694: rename d7/d15/d1a/d4a/d51/l6b to d7/d15/lda 0 2024-09-20T20:31:44.179 INFO:tasks.workunit.client.0.smithi070.stdout:8/816: dwrite d4/d27/d2a/d5b/d98/ffd [0,4194304] 0 2024-09-20T20:31:44.179 INFO:tasks.workunit.client.0.smithi070.stdout:5/825: dwrite d2/d4/d98/d4c/f117 [0,4194304] 0 2024-09-20T20:31:44.180 INFO:tasks.workunit.client.0.smithi070.stdout:9/781: rename d1/df/d18/f2f to d1/df/d25/d69/d85/d9f/db9/de3/de5/f119 0 2024-09-20T20:31:44.180 INFO:tasks.workunit.client.0.smithi070.stdout:4/799: dread d6/d7/dc/f4d [0,4194304] 0 2024-09-20T20:31:44.181 INFO:tasks.workunit.client.0.smithi070.stdout:7/751: truncate d2/d19/d25/d61/f6f 3367260 0 2024-09-20T20:31:44.181 INFO:tasks.workunit.client.0.smithi070.stdout:1/893: dwrite d4/d6/d26/fc6 [0,4194304] 0 2024-09-20T20:31:44.183 INFO:tasks.workunit.client.0.smithi070.stdout:5/826: unlink d2/d4/de/d47/d5f/f114 0 2024-09-20T20:31:44.184 INFO:tasks.workunit.client.0.smithi070.stdout:7/752: rmdir d2/d30/d78 39 2024-09-20T20:31:44.184 INFO:tasks.workunit.client.0.smithi070.stdout:4/800: rename d6/d7/dc/d4a/d81/fea to d6/d43/d5a/ddd/ffe 0 2024-09-20T20:31:44.184 INFO:tasks.workunit.client.0.smithi070.stdout:1/894: rmdir d4/d6/d11/d63/de7/d44/de8 39 2024-09-20T20:31:44.184 INFO:tasks.workunit.client.0.smithi070.stdout:2/769: chown d3/f36 19533 1 2024-09-20T20:31:44.185 INFO:tasks.workunit.client.0.smithi070.stdout:9/782: mkdir d1/df/d25/d69/d85/d9f/db9/de3/d11a 0 2024-09-20T20:31:44.185 INFO:tasks.workunit.client.0.smithi070.stdout:2/770: symlink d3/de/d9f/l10c 0 2024-09-20T20:31:44.186 INFO:tasks.workunit.client.0.smithi070.stdout:1/895: rmdir d4/d6/d11/d63/de7/d44/d5a 39 2024-09-20T20:31:44.187 INFO:tasks.workunit.client.0.smithi070.stdout:9/783: getdents d1/df/d25/d69/d85/d9f/db9/de3/d111 0 2024-09-20T20:31:44.187 INFO:tasks.workunit.client.0.smithi070.stdout:1/896: creat d4/d6/d11/d63/de7/d44/de8/f13e x:0 0 0 2024-09-20T20:31:44.188 INFO:tasks.workunit.client.0.smithi070.stdout:5/827: truncate d2/d4/d53/f95 783220 0 2024-09-20T20:31:44.188 INFO:tasks.workunit.client.0.smithi070.stdout:9/784: write d1/df/d18/d44/da2/dcc/fe1 [3917737,91857] 0 2024-09-20T20:31:44.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/828: mkdir d2/d4/d53/d11f 0 2024-09-20T20:31:44.190 INFO:tasks.workunit.client.0.smithi070.stdout:5/829: chown d2/d4/d98/fc0 13379399 1 2024-09-20T20:31:44.191 INFO:tasks.workunit.client.0.smithi070.stdout:4/801: dwrite d6/d7/dc/d4a/d58/f6c [4194304,4194304] 0 2024-09-20T20:31:44.191 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:44.189+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:44.191 INFO:tasks.workunit.client.0.smithi070.stdout:2/771: dread d3/de/d12/d1a/f21 [4194304,4194304] 0 2024-09-20T20:31:44.192 INFO:tasks.workunit.client.0.smithi070.stdout:3/695: sync 2024-09-20T20:31:44.193 INFO:tasks.workunit.client.0.smithi070.stdout:8/817: dread d4/db/d64/d95/f9b [0,4194304] 0 2024-09-20T20:31:44.193 INFO:tasks.workunit.client.0.smithi070.stdout:4/802: rename d6/d5e/ced to d6/d26/d69/d71/cff 0 2024-09-20T20:31:44.194 INFO:tasks.workunit.client.0.smithi070.stdout:2/772: mknod d3/d5/d9/d79/c10d 0 2024-09-20T20:31:44.195 INFO:tasks.workunit.client.0.smithi070.stdout:6/914: dread d4/d8/f90 [0,4194304] 0 2024-09-20T20:31:44.195 INFO:tasks.workunit.client.0.smithi070.stdout:3/696: dread d7/d15/d1a/d80/f8c [0,4194304] 0 2024-09-20T20:31:44.195 INFO:tasks.workunit.client.0.smithi070.stdout:8/818: truncate d4/d27/d73/fd7 4640993 0 2024-09-20T20:31:44.196 INFO:tasks.workunit.client.0.smithi070.stdout:2/773: write d3/d5/dd/d5a/f66 [2772777,80532] 0 2024-09-20T20:31:44.197 INFO:tasks.workunit.client.0.smithi070.stdout:6/915: fsync d4/d8/db4/db6/ff9 0 2024-09-20T20:31:44.197 INFO:tasks.workunit.client.0.smithi070.stdout:8/819: rmdir d4/d27/d2a/d3e/d39/ddf 39 2024-09-20T20:31:44.200 INFO:tasks.workunit.client.0.smithi070.stdout:5/830: dwrite d2/d7/d60/dbd/ffc [0,4194304] 0 2024-09-20T20:31:44.200 INFO:tasks.workunit.client.0.smithi070.stdout:5/831: stat d2/d4/de/d47/fa6 0 2024-09-20T20:31:44.201 INFO:tasks.workunit.client.0.smithi070.stdout:8/820: link d4/d27/d2a/d7e/ld2 d4/d27/d2a/d43/d61/d10d/l114 0 2024-09-20T20:31:44.202 INFO:tasks.workunit.client.0.smithi070.stdout:5/832: symlink d2/d4/de/d47/d5f/l120 0 2024-09-20T20:31:44.202 INFO:tasks.workunit.client.0.smithi070.stdout:8/821: rename d4/d27/d2a/d3e to d4/db/d64/d95/da5/d115 0 2024-09-20T20:31:44.203 INFO:tasks.workunit.client.0.smithi070.stdout:4/803: dread d6/d26/d69/d71/fa9 [0,4194304] 0 2024-09-20T20:31:44.204 INFO:tasks.workunit.client.0.smithi070.stdout:8/822: creat d4/db/d64/f116 x:0 0 0 2024-09-20T20:31:44.205 INFO:tasks.workunit.client.0.smithi070.stdout:8/823: chown d4/d27/cc5 317 1 2024-09-20T20:31:44.205 INFO:tasks.workunit.client.0.smithi070.stdout:0/795: dread d4/d1b/f3d [0,4194304] 0 2024-09-20T20:31:44.207 INFO:tasks.workunit.client.0.smithi070.stdout:0/796: fdatasync d4/d8/d55/dd8/d1d/fc6 0 2024-09-20T20:31:44.207 INFO:tasks.workunit.client.0.smithi070.stdout:8/824: rename d4/d27/d42/f54 to d4/d27/d2a/d43/d61/d10d/f117 0 2024-09-20T20:31:44.208 INFO:tasks.workunit.client.0.smithi070.stdout:8/825: rename d4/dd3 to d4/d27/dc6/d112/d118 0 2024-09-20T20:31:44.210 INFO:tasks.workunit.client.0.smithi070.stdout:0/797: dread d4/d8/db6/ff4 [0,4194304] 0 2024-09-20T20:31:44.211 INFO:tasks.workunit.client.0.smithi070.stdout:0/798: creat d4/d48/d7b/ffe x:0 0 0 2024-09-20T20:31:44.213 INFO:tasks.workunit.client.0.smithi070.stdout:0/799: write d4/d8/d55/dd8/d1f/d2e/f6d [2103186,49985] 0 2024-09-20T20:31:44.213 INFO:tasks.workunit.client.0.smithi070.stdout:5/833: truncate d2/d7/d60/dbd/fcc 1517673 0 2024-09-20T20:31:44.214 INFO:tasks.workunit.client.0.smithi070.stdout:4/804: truncate d6/d5e/f33 2029926 0 2024-09-20T20:31:44.214 INFO:tasks.workunit.client.0.smithi070.stdout:0/800: readlink d4/d48/ld6 0 2024-09-20T20:31:44.216 INFO:tasks.workunit.client.0.smithi070.stdout:5/834: rmdir d2/d4/de/d47/d5f 39 2024-09-20T20:31:44.217 INFO:tasks.workunit.client.0.smithi070.stdout:2/774: dread d3/d5/d9/fcf [0,4194304] 0 2024-09-20T20:31:44.217 INFO:tasks.workunit.client.0.smithi070.stdout:5/835: fsync d2/f10d 0 2024-09-20T20:31:44.218 INFO:tasks.workunit.client.0.smithi070.stdout:6/916: dwrite d4/d8/d17/d33/d36/f37 [0,4194304] 0 2024-09-20T20:31:44.219 INFO:tasks.workunit.client.0.smithi070.stdout:1/897: dread d4/d6/d11/d63/d6c/f10a [0,4194304] 0 2024-09-20T20:31:44.219 INFO:tasks.workunit.client.0.smithi070.stdout:6/917: write d4/d8/d38/f116 [3551313,99126] 0 2024-09-20T20:31:44.220 INFO:tasks.workunit.client.0.smithi070.stdout:4/805: creat d6/d5e/d6b/f100 x:0 0 0 2024-09-20T20:31:44.221 INFO:tasks.workunit.client.0.smithi070.stdout:8/826: dwrite d4/db/d64/d95/da5/d115/d31/d63/fac [4194304,4194304] 0 2024-09-20T20:31:44.224 INFO:tasks.workunit.client.0.smithi070.stdout:0/801: rename d4/d48/d7b/d8c to d4/d8/dff 0 2024-09-20T20:31:44.224 INFO:tasks.workunit.client.0.smithi070.stdout:7/753: dread d2/d8/f3b [0,4194304] 0 2024-09-20T20:31:44.226 INFO:tasks.workunit.client.0.smithi070.stdout:2/775: mkdir d3/d5/d10e 0 2024-09-20T20:31:44.227 INFO:tasks.workunit.client.0.smithi070.stdout:4/806: mknod d6/d5e/d51/d63/c101 0 2024-09-20T20:31:44.227 INFO:tasks.workunit.client.0.smithi070.stdout:0/802: sync 2024-09-20T20:31:44.229 INFO:tasks.workunit.client.0.smithi070.stdout:1/898: rename d4/d32/dea/d3a/f68 to d4/d6/d11/d63/de7/d44/d4b/f13f 0 2024-09-20T20:31:44.230 INFO:tasks.workunit.client.0.smithi070.stdout:9/785: dread d1/df/d18/d46/ffb [0,4194304] 0 2024-09-20T20:31:44.230 INFO:tasks.workunit.client.0.smithi070.stdout:5/836: dwrite d2/d4/f111 [0,4194304] 0 2024-09-20T20:31:44.230 INFO:tasks.workunit.client.0.smithi070.stdout:4/807: creat d6/d5e/d75/d40/f102 x:0 0 0 2024-09-20T20:31:44.231 INFO:tasks.workunit.client.0.smithi070.stdout:5/837: fdatasync d2/d7/d60/f91 0 2024-09-20T20:31:44.231 INFO:tasks.workunit.client.0.smithi070.stdout:6/918: dwrite d4/d8/d3a/ffb [0,4194304] 0 2024-09-20T20:31:44.232 INFO:tasks.workunit.client.0.smithi070.stdout:2/776: write d3/d5/d9/d1c/dda/d104/f62 [4929868,19302] 0 2024-09-20T20:31:44.233 INFO:tasks.workunit.client.0.smithi070.stdout:2/777: stat d3/d5/d10e 0 2024-09-20T20:31:44.233 INFO:tasks.workunit.client.0.smithi070.stdout:6/919: creat d4/df0/f147 x:0 0 0 2024-09-20T20:31:44.234 INFO:tasks.workunit.client.0.smithi070.stdout:2/778: stat d3/d5/dd/d5a/c8a 0 2024-09-20T20:31:44.234 INFO:tasks.workunit.client.0.smithi070.stdout:0/803: creat d4/d8/d12/d23/f100 x:0 0 0 2024-09-20T20:31:44.234 INFO:tasks.workunit.client.0.smithi070.stdout:6/920: readlink d4/d8/d1e/la0 0 2024-09-20T20:31:44.234 INFO:tasks.workunit.client.0.smithi070.stdout:8/827: rename d4/d27/d2a/d5b/d6c/da6/ff8 to d4/db/d64/d95/da5/d115/f119 0 2024-09-20T20:31:44.235 INFO:tasks.workunit.client.0.smithi070.stdout:3/697: dread d7/d15/d1a/d48/d57/f70 [0,4194304] 0 2024-09-20T20:31:44.235 INFO:tasks.workunit.client.0.smithi070.stdout:6/921: fdatasync d4/d8/d17/d33/d36/ddb/f13b 0 2024-09-20T20:31:44.235 INFO:tasks.workunit.client.0.smithi070.stdout:2/779: write d3/de/d12/d4f/fd2 [809613,112578] 0 2024-09-20T20:31:44.235 INFO:tasks.workunit.client.0.smithi070.stdout:8/828: stat d4/d27/d2a/d5b/ff1 0 2024-09-20T20:31:44.235 INFO:tasks.workunit.client.0.smithi070.stdout:7/754: rename d2/d30/d63/f93 to d2/d19/dbe/ff7 0 2024-09-20T20:31:44.236 INFO:tasks.workunit.client.0.smithi070.stdout:8/829: unlink d4/db/d64/f8c 0 2024-09-20T20:31:44.236 INFO:tasks.workunit.client.0.smithi070.stdout:9/786: getdents d1/df/d25/d9e 0 2024-09-20T20:31:44.237 INFO:tasks.workunit.client.0.smithi070.stdout:2/780: chown d3/d5/dd/d99/dae/lcc 3 1 2024-09-20T20:31:44.237 INFO:tasks.workunit.client.0.smithi070.stdout:5/838: truncate d2/d7/d60/dbd/ffc 3589491 0 2024-09-20T20:31:44.237 INFO:tasks.workunit.client.0.smithi070.stdout:6/922: symlink d4/d8/d68/l148 0 2024-09-20T20:31:44.237 INFO:tasks.workunit.client.0.smithi070.stdout:7/755: symlink d2/dd5/lf8 0 2024-09-20T20:31:44.237 INFO:tasks.workunit.client.0.smithi070.stdout:9/787: fdatasync d1/df/d38/f115 0 2024-09-20T20:31:44.237 INFO:tasks.workunit.client.0.smithi070.stdout:1/899: dread - d4/d32/dea/d3a/fec zero size 2024-09-20T20:31:44.238 INFO:tasks.workunit.client.0.smithi070.stdout:5/839: fsync d2/d4/d98/d4c/f64 0 2024-09-20T20:31:44.238 INFO:tasks.workunit.client.0.smithi070.stdout:6/923: chown d4/d8/d3a/c86 262302 1 2024-09-20T20:31:44.239 INFO:tasks.workunit.client.0.smithi070.stdout:5/840: write d2/d4/d53/fa4 [832921,116156] 0 2024-09-20T20:31:44.240 INFO:tasks.workunit.client.0.smithi070.stdout:9/788: rmdir d1/df/d84 39 2024-09-20T20:31:44.240 INFO:tasks.workunit.client.0.smithi070.stdout:8/830: readlink d4/d27/d2a/d5b/d98/da9/db5/dc0/lc8 0 2024-09-20T20:31:44.241 INFO:tasks.workunit.client.0.smithi070.stdout:2/781: truncate d3/d5/d9/d1c/d4e/fe2 680086 0 2024-09-20T20:31:44.241 INFO:tasks.workunit.client.0.smithi070.stdout:1/900: getdents d4/d32/de6/d10e 0 2024-09-20T20:31:44.241 INFO:tasks.workunit.client.0.smithi070.stdout:5/841: unlink d2/d4/cb5 0 2024-09-20T20:31:44.241 INFO:tasks.workunit.client.0.smithi070.stdout:9/789: creat d1/f11b x:0 0 0 2024-09-20T20:31:44.242 INFO:tasks.workunit.client.0.smithi070.stdout:2/782: rmdir d3/d4c/d5c/d86 39 2024-09-20T20:31:44.242 INFO:tasks.workunit.client.0.smithi070.stdout:5/842: dread - d2/d4/d98/d5b/d90/da0/f10a zero size 2024-09-20T20:31:44.242 INFO:tasks.workunit.client.0.smithi070.stdout:1/901: symlink d4/d6/d11/d63/da3/l140 0 2024-09-20T20:31:44.243 INFO:tasks.workunit.client.0.smithi070.stdout:0/804: dwrite d4/d8/d55/dd8/d2d/f89 [0,4194304] 0 2024-09-20T20:31:44.243 INFO:tasks.workunit.client.0.smithi070.stdout:2/783: symlink d3/d5/d9/d1c/d47/l10f 0 2024-09-20T20:31:44.243 INFO:tasks.workunit.client.0.smithi070.stdout:1/902: creat d4/d32/d60/f141 x:0 0 0 2024-09-20T20:31:44.244 INFO:tasks.workunit.client.0.smithi070.stdout:9/790: truncate d1/df/f7e 3171370 0 2024-09-20T20:31:44.244 INFO:tasks.workunit.client.0.smithi070.stdout:9/791: sync 2024-09-20T20:31:44.245 INFO:tasks.workunit.client.0.smithi070.stdout:2/784: creat d3/d5/d9/d1c/d47/d10a/f110 x:0 0 0 2024-09-20T20:31:44.245 INFO:tasks.workunit.client.0.smithi070.stdout:9/792: dread - d1/df/d25/d69/daf/f112 zero size 2024-09-20T20:31:44.246 INFO:tasks.workunit.client.0.smithi070.stdout:7/756: fsync d2/d19/dbe/ff7 0 2024-09-20T20:31:44.247 INFO:tasks.workunit.client.0.smithi070.stdout:2/785: creat d3/d5/d10e/f111 x:0 0 0 2024-09-20T20:31:44.248 INFO:tasks.workunit.client.0.smithi070.stdout:8/831: dwrite d4/d27/fd6 [0,4194304] 0 2024-09-20T20:31:44.249 INFO:tasks.workunit.client.0.smithi070.stdout:4/808: dread d6/d7/dc/d4a/d81/fa8 [0,4194304] 0 2024-09-20T20:31:44.249 INFO:tasks.workunit.client.0.smithi070.stdout:7/757: truncate d2/d8/fb6 312298 0 2024-09-20T20:31:44.251 INFO:tasks.workunit.client.0.smithi070.stdout:5/843: truncate d2/d7/f31 7983459 0 2024-09-20T20:31:44.252 INFO:tasks.workunit.client.0.smithi070.stdout:4/809: stat d6/d26/d69/d71/lc9 0 2024-09-20T20:31:44.252 INFO:tasks.workunit.client.0.smithi070.stdout:2/786: creat d3/d5/d10e/f112 x:0 0 0 2024-09-20T20:31:44.252 INFO:tasks.workunit.client.0.smithi070.stdout:2/787: sync 2024-09-20T20:31:44.254 INFO:tasks.workunit.client.0.smithi070.stdout:5/844: chown d2/l1f 8354837 1 2024-09-20T20:31:44.254 INFO:tasks.workunit.client.0.smithi070.stdout:7/758: creat d2/d19/ff9 x:0 0 0 2024-09-20T20:31:44.255 INFO:tasks.workunit.client.0.smithi070.stdout:0/805: dwrite f2 [0,4194304] 0 2024-09-20T20:31:44.256 INFO:tasks.workunit.client.0.smithi070.stdout:5/845: mkdir d2/d4/d121 0 2024-09-20T20:31:44.256 INFO:tasks.workunit.client.0.smithi070.stdout:3/698: dwrite d7/d15/f18 [0,4194304] 0 2024-09-20T20:31:44.256 INFO:tasks.workunit.client.0.smithi070.stdout:2/788: creat d3/d5/d9/d1c/dda/f113 x:0 0 0 2024-09-20T20:31:44.257 INFO:tasks.workunit.client.0.smithi070.stdout:1/903: dwrite d4/d6/d11/d63/d6c/f85 [0,4194304] 0 2024-09-20T20:31:44.258 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:44.253+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:44.258 INFO:tasks.workunit.client.0.smithi070.stdout:9/793: dwrite d1/df/d25/dc4/df5/fde [0,4194304] 0 2024-09-20T20:31:44.258 INFO:tasks.workunit.client.0.smithi070.stdout:4/810: truncate d6/d5e/d75/d40/f102 900344 0 2024-09-20T20:31:44.259 INFO:tasks.workunit.client.0.smithi070.stdout:0/806: write d4/d8/d55/dd8/d1d/d37/d3e/fef [2137205,90546] 0 2024-09-20T20:31:44.259 INFO:tasks.workunit.client.0.smithi070.stdout:2/789: chown d3/de/d9f/l10c 419 1 2024-09-20T20:31:44.259 INFO:tasks.workunit.client.0.smithi070.stdout:7/759: rename d2/d19/d25/d2a to d2/dfa 0 2024-09-20T20:31:44.259 INFO:tasks.workunit.client.0.smithi070.stdout:5/846: mkdir d2/db7/d11a/d122 0 2024-09-20T20:31:44.259 INFO:tasks.workunit.client.0.smithi070.stdout:9/794: unlink d1/df/d38/f47 0 2024-09-20T20:31:44.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/807: truncate d4/d8/d55/dd8/d1d/d37/d3e/df8/f75 1104901 0 2024-09-20T20:31:44.262 INFO:tasks.workunit.client.0.smithi070.stdout:3/699: rename d7/d15/d1a/d4a/fae to d7/d15/d1a/d48/d66/d69/d99/fdb 0 2024-09-20T20:31:44.263 INFO:tasks.workunit.client.0.smithi070.stdout:4/811: mknod d6/d7/dc/d4a/d81/de4/c103 0 2024-09-20T20:31:44.263 INFO:tasks.workunit.client.0.smithi070.stdout:9/795: rmdir d1/df/d25/d9e 39 2024-09-20T20:31:44.263 INFO:tasks.workunit.client.0.smithi070.stdout:5/847: dread - d2/fce zero size 2024-09-20T20:31:44.263 INFO:tasks.workunit.client.0.smithi070.stdout:0/808: unlink d4/d48/lc4 0 2024-09-20T20:31:44.264 INFO:tasks.workunit.client.0.smithi070.stdout:5/848: mknod d2/db7/c123 0 2024-09-20T20:31:44.264 INFO:tasks.workunit.client.0.smithi070.stdout:2/790: getdents d3/d4c/d5c/d86/dd5/de3/df5 0 2024-09-20T20:31:44.265 INFO:tasks.workunit.client.0.smithi070.stdout:5/849: readlink d2/df/d40/l70 0 2024-09-20T20:31:44.265 INFO:tasks.workunit.client.0.smithi070.stdout:9/796: mknod d1/df/d25/db2/c11c 0 2024-09-20T20:31:44.265 INFO:tasks.workunit.client.0.smithi070.stdout:3/700: creat d7/fdc x:0 0 0 2024-09-20T20:31:44.265 INFO:tasks.workunit.client.0.smithi070.stdout:0/809: write d4/d48/de6/f68 [7753287,121488] 0 2024-09-20T20:31:44.265 INFO:tasks.workunit.client.0.smithi070.stdout:4/812: rename d6/d26/d69/d71/d4c/f8f to d6/d7/dc/d4a/d81/f104 0 2024-09-20T20:31:44.267 INFO:tasks.workunit.client.0.smithi070.stdout:8/832: truncate d4/db/d64/d95/da5/d115/f6d 386095 0 2024-09-20T20:31:44.267 INFO:tasks.workunit.client.0.smithi070.stdout:4/813: unlink d6/d5e/d75/d40/ff4 0 2024-09-20T20:31:44.267 INFO:tasks.workunit.client.0.smithi070.stdout:3/701: write d7/d15/d1a/d48/d57/f70 [507029,3421] 0 2024-09-20T20:31:44.267 INFO:tasks.workunit.client.0.smithi070.stdout:7/760: dwrite d2/dfa/d4a/fb9 [0,4194304] 0 2024-09-20T20:31:44.267 INFO:tasks.workunit.client.0.smithi070.stdout:4/814: fsync d6/d5e/d51/fc4 0 2024-09-20T20:31:44.268 INFO:tasks.workunit.client.0.smithi070.stdout:9/797: truncate d1/df/d25/d69/d85/dad/fef 1046110 0 2024-09-20T20:31:44.268 INFO:tasks.workunit.client.0.smithi070.stdout:3/702: write f4 [2087424,110201] 0 2024-09-20T20:31:44.270 INFO:tasks.workunit.client.0.smithi070.stdout:8/833: mknod d4/d27/d2a/d5b/d6c/c11a 0 2024-09-20T20:31:44.270 INFO:tasks.workunit.client.0.smithi070.stdout:7/761: symlink d2/d19/d25/da2/lfb 0 2024-09-20T20:31:44.270 INFO:tasks.workunit.client.0.smithi070.stdout:9/798: link d1/lae d1/df/d25/d69/daf/l11d 0 2024-09-20T20:31:44.271 INFO:tasks.workunit.client.0.smithi070.stdout:3/703: rmdir d7/d15/d1a/d4a/d7d 39 2024-09-20T20:31:44.272 INFO:tasks.workunit.client.0.smithi070.stdout:7/762: mknod d2/d8/cfc 0 2024-09-20T20:31:44.272 INFO:tasks.workunit.client.0.smithi070.stdout:9/799: mkdir d1/df/d25/d69/d85/d9f/d11e 0 2024-09-20T20:31:44.272 INFO:tasks.workunit.client.0.smithi070.stdout:8/834: stat d4/db/d64/d95/da5/d115/c4c 0 2024-09-20T20:31:44.274 INFO:tasks.workunit.client.0.smithi070.stdout:6/924: dread d4/d8/d1e/db7/f105 [0,4194304] 0 2024-09-20T20:31:44.274 INFO:tasks.workunit.client.0.smithi070.stdout:4/815: dwrite d6/d26/f9c [0,4194304] 0 2024-09-20T20:31:44.274 INFO:tasks.workunit.client.0.smithi070.stdout:9/800: write d1/df/d25/fa7 [99210,79905] 0 2024-09-20T20:31:44.275 INFO:tasks.workunit.client.0.smithi070.stdout:8/835: creat d4/d27/d2a/d5b/d6c/f11b x:0 0 0 2024-09-20T20:31:44.275 INFO:tasks.workunit.client.0.smithi070.stdout:6/925: fdatasync d4/d8/d17/fe3 0 2024-09-20T20:31:44.275 INFO:tasks.workunit.client.0.smithi070.stdout:9/801: chown d1/df/d38/f115 36648460 1 2024-09-20T20:31:44.277 INFO:tasks.workunit.client.0.smithi070.stdout:4/816: mknod d6/d26/dd7/c105 0 2024-09-20T20:31:44.278 INFO:tasks.workunit.client.0.smithi070.stdout:9/802: mknod d1/df/d18/d44/d77/dd0/c11f 0 2024-09-20T20:31:44.278 INFO:tasks.workunit.client.0.smithi070.stdout:9/803: write d1/f10f [331995,53088] 0 2024-09-20T20:31:44.281 INFO:tasks.workunit.client.0.smithi070.stdout:9/804: chown d1/df/d25/d69/d85/d9f/db9/de3/d11a 21888 1 2024-09-20T20:31:44.282 INFO:tasks.workunit.client.0.smithi070.stdout:7/763: truncate d2/d52/f5e 222293 0 2024-09-20T20:31:44.283 INFO:tasks.workunit.client.0.smithi070.stdout:8/836: dwrite d4/d27/d42/d103/f91 [0,4194304] 0 2024-09-20T20:31:44.288 INFO:tasks.workunit.client.0.smithi070.stdout:1/904: dread d4/d6/d11/f10 [0,4194304] 0 2024-09-20T20:31:44.289 INFO:tasks.workunit.client.0.smithi070.stdout:7/764: creat d2/dfa/ffd x:0 0 0 2024-09-20T20:31:44.289 INFO:tasks.workunit.client.0.smithi070.stdout:6/926: dwrite d4/d8/f90 [0,4194304] 0 2024-09-20T20:31:44.289 INFO:tasks.workunit.client.0.smithi070.stdout:3/704: dwrite d7/d15/d1a/d48/d66/d69/f33 [0,4194304] 0 2024-09-20T20:31:44.290 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:44.290 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:44.292 INFO:tasks.workunit.client.0.smithi070.stdout:4/817: dwrite d6/d5e/f70 [4194304,4194304] 0 2024-09-20T20:31:44.292 INFO:tasks.workunit.client.0.smithi070.stdout:6/927: chown d4/d8/d10/d54/db1 1381 1 2024-09-20T20:31:44.292 INFO:tasks.workunit.client.0.smithi070.stdout:6/928: sync 2024-09-20T20:31:44.293 INFO:tasks.workunit.client.0.smithi070.stdout:1/905: creat d4/d6/d11/f142 x:0 0 0 2024-09-20T20:31:44.294 INFO:tasks.workunit.client.0.smithi070.stdout:6/929: fdatasync d4/d8/d38/d50/fe8 0 2024-09-20T20:31:44.295 INFO:tasks.workunit.client.0.smithi070.stdout:9/805: dwrite d1/df/d25/d69/d80/fd3 [0,4194304] 0 2024-09-20T20:31:44.295 INFO:tasks.workunit.client.0.smithi070.stdout:8/837: dwrite d4/db/d66/f6a [0,4194304] 0 2024-09-20T20:31:44.295 INFO:tasks.workunit.client.0.smithi070.stdout:1/906: read - d4/d6/d11/d63/dd7/f11c zero size 2024-09-20T20:31:44.297 INFO:tasks.workunit.client.0.smithi070.stdout:9/806: write d1/df/d25/f96 [3569791,18752] 0 2024-09-20T20:31:44.298 INFO:tasks.workunit.client.0.smithi070.stdout:8/838: chown d4/d27/d2a/d5b/d98/da9/db5/dc0/fc3 123 1 2024-09-20T20:31:44.298 INFO:tasks.workunit.client.0.smithi070.stdout:6/930: creat d4/d8/d10/d54/db1/f149 x:0 0 0 2024-09-20T20:31:44.298 INFO:tasks.workunit.client.0.smithi070.stdout:6/931: sync 2024-09-20T20:31:44.299 INFO:tasks.workunit.client.0.smithi070.stdout:1/907: stat d4/d32/dea/d3a/d9d/db7 0 2024-09-20T20:31:44.299 INFO:tasks.workunit.client.0.smithi070.stdout:8/839: stat d4/db/d64 0 2024-09-20T20:31:44.299 INFO:tasks.workunit.client.0.smithi070.stdout:9/807: write d1/df/d25/f96 [3988222,48843] 0 2024-09-20T20:31:44.299 INFO:tasks.workunit.client.0.smithi070.stdout:7/765: dwrite d2/d19/d25/d84/f8c [0,4194304] 0 2024-09-20T20:31:44.300 INFO:tasks.workunit.client.0.smithi070.stdout:1/908: creat d4/d32/d60/dca/dd2/f143 x:0 0 0 2024-09-20T20:31:44.300 INFO:tasks.workunit.client.0.smithi070.stdout:8/840: creat d4/d27/dc6/f11c x:0 0 0 2024-09-20T20:31:44.301 INFO:tasks.workunit.client.0.smithi070.stdout:6/932: creat d4/d8/d17/d33/d61/d73/dd8/f14a x:0 0 0 2024-09-20T20:31:44.301 INFO:tasks.workunit.client.0.smithi070.stdout:1/909: mknod d4/d32/d116/c144 0 2024-09-20T20:31:44.303 INFO:tasks.workunit.client.0.smithi070.stdout:3/705: dwrite d7/d15/d1a/d48/d66/d69/f19 [0,4194304] 0 2024-09-20T20:31:44.304 INFO:tasks.workunit.client.0.smithi070.stdout:1/910: rmdir d4/d6/d11/d63 39 2024-09-20T20:31:44.305 INFO:tasks.workunit.client.0.smithi070.stdout:6/933: rename d4/d8/d1e/db7 to d4/d8/d1e/db7/d14b 22 2024-09-20T20:31:44.306 INFO:tasks.workunit.client.0.smithi070.stdout:1/911: stat d4/d6/c6d 0 2024-09-20T20:31:44.306 INFO:tasks.workunit.client.0.smithi070.stdout:6/934: fsync d4/d8/d17/f31 0 2024-09-20T20:31:44.307 INFO:tasks.workunit.client.0.smithi070.stdout:7/766: dread d2/d19/d25/d42/d77/f9b [0,4194304] 0 2024-09-20T20:31:44.307 INFO:tasks.workunit.client.0.smithi070.stdout:1/912: dread - d4/d6/d11/f142 zero size 2024-09-20T20:31:44.308 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:44.309 INFO:tasks.workunit.client.0.smithi070.stdout:9/808: dwrite d1/df/d38/fc1 [0,4194304] 0 2024-09-20T20:31:44.309 INFO:tasks.workunit.client.0.smithi070.stdout:6/935: write d4/d8/d1e/f7c [1583457,92469] 0 2024-09-20T20:31:44.309 INFO:tasks.workunit.client.0.smithi070.stdout:1/913: symlink d4/d6/d26/l145 0 2024-09-20T20:31:44.310 INFO:tasks.workunit.client.0.smithi070.stdout:9/809: fsync d1/df/d25/d69/f6a 0 2024-09-20T20:31:44.311 INFO:tasks.workunit.client.0.smithi070.stdout:8/841: dwrite d4/d27/faf [0,4194304] 0 2024-09-20T20:31:44.311 INFO:tasks.workunit.client.0.smithi070.stdout:9/810: readlink d1/df/d18/d44/da2/lb4 0 2024-09-20T20:31:44.312 INFO:tasks.workunit.client.0.smithi070.stdout:1/914: write d4/d6/d11/d63/de7/d44/d4b/f10f [490161,35696] 0 2024-09-20T20:31:44.312 INFO:tasks.workunit.client.0.smithi070.stdout:7/767: truncate d2/d65/fa0 1357906 0 2024-09-20T20:31:44.313 INFO:tasks.workunit.client.0.smithi070.stdout:8/842: unlink d4/db/d64/d95/da5/d115/d39/f97 0 2024-09-20T20:31:44.315 INFO:tasks.workunit.client.0.smithi070.stdout:7/768: creat d2/d30/d63/ffe x:0 0 0 2024-09-20T20:31:44.315 INFO:tasks.workunit.client.0.smithi070.stdout:1/915: write d4/d6/d11/f18 [1039363,99186] 0 2024-09-20T20:31:44.315 INFO:tasks.workunit.client.0.smithi070.stdout:8/843: truncate d4/d27/faf 4249099 0 2024-09-20T20:31:44.317 INFO:tasks.workunit.client.0.smithi070.stdout:8/844: symlink d4/db/d64/d95/da5/l11d 0 2024-09-20T20:31:44.317 INFO:tasks.workunit.client.0.smithi070.stdout:3/706: dwrite d7/d15/d1a/d48/d57/d75/fc9 [0,4194304] 0 2024-09-20T20:31:44.317 INFO:tasks.workunit.client.0.smithi070.stdout:7/769: rename d2/d30/d63/c75 to d2/dfa/dd4/dd7/cff 0 2024-09-20T20:31:44.318 INFO:tasks.workunit.client.0.smithi070.stdout:8/845: dread - d4/db/d64/d95/da5/fda zero size 2024-09-20T20:31:44.319 INFO:tasks.workunit.client.0.smithi070.stdout:6/936: dwrite d4/d8/d17/d33/d36/ddb/fdf [4194304,4194304] 0 2024-09-20T20:31:44.319 INFO:tasks.workunit.client.0.smithi070.stdout:7/770: mkdir d2/d19/d7c/dde/d100 0 2024-09-20T20:31:44.321 INFO:tasks.workunit.client.0.smithi070.stdout:6/937: write d4/d8/f131 [406108,71639] 0 2024-09-20T20:31:44.322 INFO:tasks.workunit.client.0.smithi070.stdout:7/771: getdents d2/d30 0 2024-09-20T20:31:44.323 INFO:tasks.workunit.client.0.smithi070.stdout:6/938: truncate d4/d8/d1e/db7/f11e 160530 0 2024-09-20T20:31:44.323 INFO:tasks.workunit.client.0.smithi070.stdout:1/916: dwrite d4/d32/d60/f8e [0,4194304] 0 2024-09-20T20:31:44.324 INFO:tasks.workunit.client.0.smithi070.stdout:7/772: write d2/d30/d63/fee [1067,14846] 0 2024-09-20T20:31:44.325 INFO:tasks.workunit.client.0.smithi070.stdout:7/773: mkdir d2/d19/d2e/d101 0 2024-09-20T20:31:44.326 INFO:tasks.workunit.client.0.smithi070.stdout:1/917: truncate d4/d6/d11/d63/d6c/f114 21293 0 2024-09-20T20:31:44.326 INFO:tasks.workunit.client.0.smithi070.stdout:7/774: symlink d2/dfa/dd4/l102 0 2024-09-20T20:31:44.327 INFO:tasks.workunit.client.0.smithi070.stdout:3/707: dwrite d7/d15/d1a/d4a/d51/d5b/fa0 [0,4194304] 0 2024-09-20T20:31:44.327 INFO:tasks.workunit.client.0.smithi070.stdout:7/775: creat d2/d19/dbe/dd0/dd3/f103 x:0 0 0 2024-09-20T20:31:44.328 INFO:tasks.workunit.client.0.smithi070.stdout:3/708: getdents d7/d15/d1a/d80/dd9 0 2024-09-20T20:31:44.328 INFO:tasks.workunit.client.0.smithi070.stdout:7/776: rename d2/d8/l11 to d2/d30/dad/l104 0 2024-09-20T20:31:44.328 INFO:tasks.workunit.client.0.smithi070.stdout:7/777: stat d2/dd5 0 2024-09-20T20:31:44.329 INFO:tasks.workunit.client.0.smithi070.stdout:7/778: read d2/d8/f3b [2601214,22207] 0 2024-09-20T20:31:44.330 INFO:tasks.workunit.client.0.smithi070.stdout:7/779: mknod d2/d19/d25/d42/c105 0 2024-09-20T20:31:44.331 INFO:tasks.workunit.client.0.smithi070.stdout:7/780: dread - d2/d8/fa8 zero size 2024-09-20T20:31:44.332 INFO:tasks.workunit.client.0.smithi070.stdout:3/709: getdents d7/d15/d1e/da9 0 2024-09-20T20:31:44.332 INFO:tasks.workunit.client.0.smithi070.stdout:3/710: sync 2024-09-20T20:31:44.333 INFO:tasks.workunit.client.0.smithi070.stdout:6/939: dwrite d4/d8/d10/d54/d55/d72/fd1 [0,4194304] 0 2024-09-20T20:31:44.333 INFO:tasks.workunit.client.0.smithi070.stdout:7/781: rmdir d2/d30/d63/db4/de7 39 2024-09-20T20:31:44.333 INFO:tasks.workunit.client.0.smithi070.stdout:3/711: write d7/d15/d1a/d48/d66/d69/d13/d1d/fab [174909,78876] 0 2024-09-20T20:31:44.334 INFO:tasks.workunit.client.0.smithi070.stdout:3/712: write d7/d15/d1a/d48/f50 [2312748,38032] 0 2024-09-20T20:31:44.335 INFO:tasks.workunit.client.0.smithi070.stdout:6/940: mkdir d4/d8/d68/d93/d14c 0 2024-09-20T20:31:44.336 INFO:tasks.workunit.client.0.smithi070.stdout:3/713: creat d7/d15/d1a/d48/d66/d69/d99/dcd/fdd x:0 0 0 2024-09-20T20:31:44.336 INFO:tasks.workunit.client.0.smithi070.stdout:4/818: dread d6/d7/dc/f46 [0,4194304] 0 2024-09-20T20:31:44.337 INFO:tasks.workunit.client.0.smithi070.stdout:4/819: readlink d6/d26/d69/d71/d4c/dcc/ldb 0 2024-09-20T20:31:44.338 INFO:tasks.workunit.client.0.smithi070.stdout:6/941: getdents d4/d8/d68/d93/dba 0 2024-09-20T20:31:44.338 INFO:tasks.workunit.client.0.smithi070.stdout:4/820: fsync d6/d26/fb2 0 2024-09-20T20:31:44.338 INFO:tasks.workunit.client.0.smithi070.stdout:5/850: dread d2/d4/d98/dc7/da5/f9f [0,4194304] 0 2024-09-20T20:31:44.338 INFO:tasks.workunit.client.0.smithi070.stdout:4/821: stat d6/d43/d5a/ddd/ce3 0 2024-09-20T20:31:44.339 INFO:tasks.workunit.client.0.smithi070.stdout:6/942: chown d4/d8/d10/d54/d55/d72/fc5 186949343 1 2024-09-20T20:31:44.339 INFO:tasks.workunit.client.0.smithi070.stdout:4/822: write d6/d5e/d51/fc4 [811309,13136] 0 2024-09-20T20:31:44.339 INFO:tasks.workunit.client.0.smithi070.stdout:5/851: write d2/d4/d53/fb9 [917556,16062] 0 2024-09-20T20:31:44.339 INFO:tasks.workunit.client.0.smithi070.stdout:6/943: write d4/d8/d10/fe7 [65691,46160] 0 2024-09-20T20:31:44.342 INFO:tasks.workunit.client.0.smithi070.stdout:2/791: dread d3/d5/d9/d1c/f4d [0,4194304] 0 2024-09-20T20:31:44.344 INFO:tasks.workunit.client.0.smithi070.stdout:3/714: dwrite d7/d15/d1a/d4a/d51/d5b/f6c [0,4194304] 0 2024-09-20T20:31:44.344 INFO:tasks.workunit.client.0.smithi070.stdout:1/918: write d4/d6/d11/d63/de7/d44/d4b/d87/fd4 [4184158,123141] 0 2024-09-20T20:31:44.346 INFO:tasks.workunit.client.0.smithi070.stdout:1/919: write d4/d6/d11/f3f [223902,11156] 0 2024-09-20T20:31:44.347 INFO:tasks.workunit.client.0.smithi070.stdout:3/715: write d7/d15/d1a/d48/d66/d69/f24 [951274,104722] 0 2024-09-20T20:31:44.347 INFO:tasks.workunit.client.0.smithi070.stdout:5/852: write d2/d4/d53/d59/f8d [1385340,42326] 0 2024-09-20T20:31:44.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/823: creat d6/d5e/d75/f106 x:0 0 0 2024-09-20T20:31:44.348 INFO:tasks.workunit.client.0.smithi070.stdout:4/824: chown d6/d7/dc 13428837 1 2024-09-20T20:31:44.348 INFO:tasks.workunit.client.0.smithi070.stdout:1/920: fsync d4/d6/d11/d63/de7/d44/fc8 0 2024-09-20T20:31:44.349 INFO:tasks.workunit.client.0.smithi070.stdout:2/792: dread d3/de/d12/d1a/f21 [4194304,4194304] 0 2024-09-20T20:31:44.349 INFO:tasks.workunit.client.0.smithi070.stdout:0/810: dread d4/f9 [0,4194304] 0 2024-09-20T20:31:44.349 INFO:tasks.workunit.client.0.smithi070.stdout:5/853: truncate d2/df/d40/f7c 709705 0 2024-09-20T20:31:44.349 INFO:tasks.workunit.client.0.smithi070.stdout:3/716: write d7/d15/f2d [4834983,26941] 0 2024-09-20T20:31:44.349 INFO:tasks.workunit.client.0.smithi070.stdout:4/825: chown d6/d5e/d51/d63/c101 2517 1 2024-09-20T20:31:44.350 INFO:tasks.workunit.client.0.smithi070.stdout:4/826: dread - d6/d43/fe7 zero size 2024-09-20T20:31:44.350 INFO:tasks.workunit.client.0.smithi070.stdout:0/811: creat d4/d19/d5b/f101 x:0 0 0 2024-09-20T20:31:44.350 INFO:tasks.workunit.client.0.smithi070.stdout:5/854: chown d2/d4/d98/f56 0 1 2024-09-20T20:31:44.351 INFO:tasks.workunit.client.0.smithi070.stdout:4/827: write d6/d26/d69/fbd [835803,78517] 0 2024-09-20T20:31:44.351 INFO:tasks.workunit.client.0.smithi070.stdout:3/717: dread - d7/d15/d1e/d60/dd4/fd5 zero size 2024-09-20T20:31:44.353 INFO:tasks.workunit.client.0.smithi070.stdout:5/855: write d2/df/f55 [5077400,92996] 0 2024-09-20T20:31:44.353 INFO:tasks.workunit.client.0.smithi070.stdout:1/921: symlink d4/d6/d11/d63/de7/d44/d4b/d87/da9/l146 0 2024-09-20T20:31:44.353 INFO:tasks.workunit.client.0.smithi070.stdout:0/812: chown d4/d8/d55/dd8/d1d/d37/l99 77036 1 2024-09-20T20:31:44.354 INFO:tasks.workunit.client.0.smithi070.stdout:1/922: chown d4/d32/d60/dca/dd2/lf3 460081175 1 2024-09-20T20:31:44.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/828: link d6/d43/f8e d6/d5e/d75/f107 0 2024-09-20T20:31:44.355 INFO:tasks.workunit.client.0.smithi070.stdout:3/718: truncate d7/d15/d1a/d48/d57/f85 806160 0 2024-09-20T20:31:44.355 INFO:tasks.workunit.client.0.smithi070.stdout:6/944: dread d4/d8/d17/f1a [0,4194304] 0 2024-09-20T20:31:44.355 INFO:tasks.workunit.client.0.smithi070.stdout:3/719: sync 2024-09-20T20:31:44.355 INFO:tasks.workunit.client.0.smithi070.stdout:0/813: rename d4/d8/ce to d4/d8/dff/c102 0 2024-09-20T20:31:44.356 INFO:tasks.workunit.client.0.smithi070.stdout:1/923: creat d4/d32/dea/d3b/f147 x:0 0 0 2024-09-20T20:31:44.356 INFO:tasks.workunit.client.0.smithi070.stdout:4/829: creat d6/d5e/d75/d40/f108 x:0 0 0 2024-09-20T20:31:44.358 INFO:tasks.workunit.client.0.smithi070.stdout:6/945: mknod d4/d8/d10/d3c/d99/c14d 0 2024-09-20T20:31:44.358 INFO:tasks.workunit.client.0.smithi070.stdout:0/814: rmdir d4/d8/d55/dd8/d1d/d37/d3e/df8 39 2024-09-20T20:31:44.358 INFO:tasks.workunit.client.0.smithi070.stdout:4/830: symlink d6/d26/dd7/l109 0 2024-09-20T20:31:44.358 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:44.352+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:44.359 INFO:tasks.workunit.client.0.smithi070.stdout:2/793: dwrite d3/d5/d9/f48 [0,4194304] 0 2024-09-20T20:31:44.359 INFO:tasks.workunit.client.0.smithi070.stdout:6/946: rmdir d4/d8 39 2024-09-20T20:31:44.359 INFO:tasks.workunit.client.0.smithi070.stdout:1/924: rename d4/d32/dea/d3a to d4/d32/de6/d10e/d148 0 2024-09-20T20:31:44.359 INFO:tasks.workunit.client.0.smithi070.stdout:0/815: mknod d4/d48/d67/da5/c103 0 2024-09-20T20:31:44.359 INFO:tasks.workunit.client.0.smithi070.stdout:6/947: sync 2024-09-20T20:31:44.360 INFO:tasks.workunit.client.0.smithi070.stdout:4/831: link d6/d5e/d75/d40/f56 d6/d26/dd7/f10a 0 2024-09-20T20:31:44.360 INFO:tasks.workunit.client.0.smithi070.stdout:2/794: unlink d3/de/d12/df2/ccb 0 2024-09-20T20:31:44.361 INFO:tasks.workunit.client.0.smithi070.stdout:4/832: dread - d6/d43/f8e zero size 2024-09-20T20:31:44.361 INFO:tasks.workunit.client.0.smithi070.stdout:1/925: creat d4/d32/de6/d10e/d148/d9d/f149 x:0 0 0 2024-09-20T20:31:44.362 INFO:tasks.workunit.client.0.smithi070.stdout:0/816: getdents d4/d48/d67/dcd 0 2024-09-20T20:31:44.362 INFO:tasks.workunit.client.0.smithi070.stdout:7/782: dread d2/d19/d25/d42/d77/fa1 [0,4194304] 0 2024-09-20T20:31:44.362 INFO:tasks.workunit.client.0.smithi070.stdout:2/795: creat d3/d4c/d5c/d86/dd5/de3/df5/f114 x:0 0 0 2024-09-20T20:31:44.363 INFO:tasks.workunit.client.0.smithi070.stdout:6/948: link d4/d8/d10/d3c/l3e d4/d8/d10/d54/l14e 0 2024-09-20T20:31:44.363 INFO:tasks.workunit.client.0.smithi070.stdout:7/783: read - d2/d19/d25/fb0 zero size 2024-09-20T20:31:44.363 INFO:tasks.workunit.client.0.smithi070.stdout:6/949: mkdir d4/df0/d14f 0 2024-09-20T20:31:44.364 INFO:tasks.workunit.client.0.smithi070.stdout:2/796: creat d3/d5/d9/d1c/d47/d7e/f115 x:0 0 0 2024-09-20T20:31:44.364 INFO:tasks.workunit.client.0.smithi070.stdout:1/926: write d4/d32/de6/d10e/d148/d9d/db7/f93 [1385466,128352] 0 2024-09-20T20:31:44.365 INFO:tasks.workunit.client.0.smithi070.stdout:6/950: creat d4/d8/d68/d93/d14c/f150 x:0 0 0 2024-09-20T20:31:44.366 INFO:tasks.workunit.client.0.smithi070.stdout:6/951: write d4/d8/d10/d54/dec/f114 [1620872,72995] 0 2024-09-20T20:31:44.367 INFO:tasks.workunit.client.0.smithi070.stdout:4/833: read d6/d7/dc/fe [2643487,95928] 0 2024-09-20T20:31:44.367 INFO:tasks.workunit.client.0.smithi070.stdout:5/856: truncate d2/d4/d98/dc7/fb3 2255404 0 2024-09-20T20:31:44.367 INFO:tasks.workunit.client.0.smithi070.stdout:6/952: chown d4/d8/d10/f92 158 1 2024-09-20T20:31:44.368 INFO:tasks.workunit.client.0.smithi070.stdout:5/857: mkdir d2/d4/d98/dc7/da5/dec/d124 0 2024-09-20T20:31:44.368 INFO:tasks.workunit.client.0.smithi070.stdout:4/834: mkdir d6/d26/d69/d71/d4c/d10b 0 2024-09-20T20:31:44.368 INFO:tasks.workunit.client.0.smithi070.stdout:4/835: chown d6/d26/dd7 27890189 1 2024-09-20T20:31:44.369 INFO:tasks.workunit.client.0.smithi070.stdout:5/858: truncate d2/d4/d98/d5b/d90/da0/f10a 976086 0 2024-09-20T20:31:44.370 INFO:tasks.workunit.client.0.smithi070.stdout:2/797: dread d3/d5/d9/d1c/dda/d104/d3e/dbe/fe8 [0,4194304] 0 2024-09-20T20:31:44.371 INFO:tasks.workunit.client.0.smithi070.stdout:5/859: chown d2/d7/d88/f4d 915 1 2024-09-20T20:31:44.371 INFO:tasks.workunit.client.0.smithi070.stdout:0/817: dread d4/d8/d55/dd8/fc5 [0,4194304] 0 2024-09-20T20:31:44.371 INFO:tasks.workunit.client.0.smithi070.stdout:2/798: fdatasync d3/d5/d9/d42/f93 0 2024-09-20T20:31:44.371 INFO:tasks.workunit.client.0.smithi070.stdout:0/818: sync 2024-09-20T20:31:44.371 INFO:tasks.workunit.client.0.smithi070.stdout:8/846: dread d4/d27/f36 [0,4194304] 0 2024-09-20T20:31:44.371 INFO:tasks.workunit.client.0.smithi070.stdout:2/799: write d3/d5/d9/d10/f6a [5001588,19241] 0 2024-09-20T20:31:44.372 INFO:tasks.workunit.client.0.smithi070.stdout:8/847: mkdir d4/d27/d2a/d5b/d98/da9/db5/d11e 0 2024-09-20T20:31:44.372 INFO:tasks.workunit.client.0.smithi070.stdout:5/860: unlink d2/d4/de/l4b 0 2024-09-20T20:31:44.373 INFO:tasks.workunit.client.0.smithi070.stdout:0/819: write d4/d8/dff/f93 [2489845,2578] 0 2024-09-20T20:31:44.374 INFO:tasks.workunit.client.0.smithi070.stdout:2/800: creat d3/d5/dd/d99/f116 x:0 0 0 2024-09-20T20:31:44.374 INFO:tasks.workunit.client.0.smithi070.stdout:9/811: dread d1/df/d25/d69/f6a [0,4194304] 0 2024-09-20T20:31:44.374 INFO:tasks.workunit.client.0.smithi070.stdout:7/784: write d2/d65/fc3 [947797,90353] 0 2024-09-20T20:31:44.374 INFO:tasks.workunit.client.0.smithi070.stdout:8/848: fdatasync f0 0 2024-09-20T20:31:44.375 INFO:tasks.workunit.client.0.smithi070.stdout:9/812: chown d1/df/d18/l1d 306 1 2024-09-20T20:31:44.375 INFO:tasks.workunit.client.0.smithi070.stdout:8/849: unlink d4/d27/faf 0 2024-09-20T20:31:44.376 INFO:tasks.workunit.client.0.smithi070.stdout:2/801: rename d3/d5/d9/d79/c103 to d3/d4c/c117 0 2024-09-20T20:31:44.376 INFO:tasks.workunit.client.0.smithi070.stdout:7/785: rename d2/d30/d63/d69/cd1 to d2/dfa/dd4/dd7/de6/c106 0 2024-09-20T20:31:44.377 INFO:tasks.workunit.client.0.smithi070.stdout:2/802: mknod d3/de/d12/df2/dc2/c118 0 2024-09-20T20:31:44.378 INFO:tasks.workunit.client.0.smithi070.stdout:6/953: truncate d4/d8/f4c 2991739 0 2024-09-20T20:31:44.379 INFO:tasks.workunit.client.0.smithi070.stdout:4/836: dwrite d6/d7/f59 [0,4194304] 0 2024-09-20T20:31:44.380 INFO:tasks.workunit.client.0.smithi070.stdout:9/813: rename d1/df/d25/dc4/df5/cf2 to d1/df/d18/d44/c120 0 2024-09-20T20:31:44.383 INFO:tasks.workunit.client.0.smithi070.stdout:9/814: read d1/df/d25/d69/f6a [1427470,109754] 0 2024-09-20T20:31:44.383 INFO:tasks.workunit.client.0.smithi070.stdout:6/954: getdents d4/d8/d1e/db7 0 2024-09-20T20:31:44.383 INFO:tasks.workunit.client.0.smithi070.stdout:5/861: truncate d2/df/f55 1166630 0 2024-09-20T20:31:44.385 INFO:tasks.workunit.client.0.smithi070.stdout:8/850: dwrite d4/db/d64/d95/da5/d115/d39/f41 [0,4194304] 0 2024-09-20T20:31:44.386 INFO:tasks.workunit.client.0.smithi070.stdout:3/720: dread d7/d15/d1a/d48/d66/d69/f24 [0,4194304] 0 2024-09-20T20:31:44.388 INFO:tasks.workunit.client.0.smithi070.stdout:2/803: dwrite d3/de/d12/f8d [0,4194304] 0 2024-09-20T20:31:44.388 INFO:tasks.workunit.client.0.smithi070.stdout:9/815: creat d1/df/d18/d44/d77/dd0/f121 x:0 0 0 2024-09-20T20:31:44.388 INFO:tasks.workunit.client.0.smithi070.stdout:8/851: symlink d4/db/d64/l11f 0 2024-09-20T20:31:44.388 INFO:tasks.workunit.client.0.smithi070.stdout:7/786: dwrite d2/d19/d25/f86 [0,4194304] 0 2024-09-20T20:31:44.388 INFO:tasks.workunit.client.0.smithi070.stdout:3/721: dread - d7/fdc zero size 2024-09-20T20:31:44.388 INFO:tasks.workunit.client.0.smithi070.stdout:6/955: truncate d4/d8/d17/d33/d61/f9b 4255473 0 2024-09-20T20:31:44.392 INFO:tasks.workunit.client.0.smithi070.stdout:6/956: creat d4/d8/d17/db2/db5/f151 x:0 0 0 2024-09-20T20:31:44.392 INFO:tasks.workunit.client.0.smithi070.stdout:1/927: dread d4/d32/dea/f46 [0,4194304] 0 2024-09-20T20:31:44.394 INFO:tasks.workunit.client.0.smithi070.stdout:8/852: symlink d4/d27/d2a/d5b/d98/da9/db5/d11e/l120 0 2024-09-20T20:31:44.395 INFO:tasks.workunit.client.0.smithi070.stdout:1/928: truncate d4/d32/de6/d10e/d148/d9d/db7/f93 1998657 0 2024-09-20T20:31:44.395 INFO:tasks.workunit.client.0.smithi070.stdout:6/957: rename d4/d8/d1e/d7e/fac to d4/d8/d17/db2/deb/f152 0 2024-09-20T20:31:44.396 INFO:tasks.workunit.client.0.smithi070.stdout:4/837: dwrite d6/d7/f3b [0,4194304] 0 2024-09-20T20:31:44.397 INFO:tasks.workunit.client.0.smithi070.stdout:6/958: creat d4/d8/db4/dbd/f153 x:0 0 0 2024-09-20T20:31:44.399 INFO:tasks.workunit.client.0.smithi070.stdout:1/929: getdents d4/d6/d11/d63/de7/d44/d4b/d87/dbb 0 2024-09-20T20:31:44.399 INFO:tasks.workunit.client.0.smithi070.stdout:4/838: truncate d6/d5e/d6b/fac 202887 0 2024-09-20T20:31:44.400 INFO:tasks.workunit.client.0.smithi070.stdout:2/804: dwrite d3/d5/d9/d1c/f4d [0,4194304] 0 2024-09-20T20:31:44.401 INFO:tasks.workunit.client.0.smithi070.stdout:6/959: chown d4/d8/d17/d33/d36/lea 0 1 2024-09-20T20:31:44.401 INFO:tasks.workunit.client.0.smithi070.stdout:3/722: dwrite d7/d15/d1a/d48/d57/f6d [0,4194304] 0 2024-09-20T20:31:44.402 INFO:tasks.workunit.client.0.smithi070.stdout:2/805: mknod d3/d5/c119 0 2024-09-20T20:31:44.402 INFO:tasks.workunit.client.0.smithi070.stdout:4/839: creat d6/d5e/d51/f10c x:0 0 0 2024-09-20T20:31:44.402 INFO:tasks.workunit.client.0.smithi070.stdout:3/723: fdatasync d7/d15/fc2 0 2024-09-20T20:31:44.403 INFO:tasks.workunit.client.0.smithi070.stdout:3/724: sync 2024-09-20T20:31:44.403 INFO:tasks.workunit.client.0.smithi070.stdout:1/930: write d4/d6/d11/d63/de7/d44/d4b/d87/dbb/fc9 [4775943,57341] 0 2024-09-20T20:31:44.403 INFO:tasks.workunit.client.0.smithi070.stdout:7/787: read d2/dfa/d4a/fd2 [107815,112972] 0 2024-09-20T20:31:44.403 INFO:tasks.workunit.client.0.smithi070.stdout:2/806: stat d3/de/d12/d1a/cb6 0 2024-09-20T20:31:44.404 INFO:tasks.workunit.client.0.smithi070.stdout:0/820: dread d4/d48/de6/f6b [0,4194304] 0 2024-09-20T20:31:44.404 INFO:tasks.workunit.client.0.smithi070.stdout:8/853: dwrite d4/d27/dc6/f11c [0,4194304] 0 2024-09-20T20:31:44.405 INFO:tasks.workunit.client.0.smithi070.stdout:7/788: write d2/d65/fc3 [24503,109961] 0 2024-09-20T20:31:44.407 INFO:tasks.workunit.client.0.smithi070.stdout:3/725: chown d7/d15/d1a/d48/d66/d69/d13/d1d/fab 0 1 2024-09-20T20:31:44.407 INFO:tasks.workunit.client.0.smithi070.stdout:7/789: write d2/f45 [1303018,7520] 0 2024-09-20T20:31:44.408 INFO:tasks.workunit.client.0.smithi070.stdout:8/854: chown d4/d27/d2a/d5b/d6c/da6/ced 802223923 1 2024-09-20T20:31:44.408 INFO:tasks.workunit.client.0.smithi070.stdout:3/726: symlink d7/d15/d1e/d60/dd4/lde 0 2024-09-20T20:31:44.408 INFO:tasks.workunit.client.0.smithi070.stdout:2/807: symlink d3/de/d12/df2/dc2/l11a 0 2024-09-20T20:31:44.409 INFO:tasks.workunit.client.0.smithi070.stdout:3/727: stat d7/d15/d1e/d65/db6 0 2024-09-20T20:31:44.410 INFO:tasks.workunit.client.0.smithi070.stdout:8/855: write d4/d27/d2a/d5b/d6c/da6/f111 [2227304,67332] 0 2024-09-20T20:31:44.412 INFO:tasks.workunit.client.0.smithi070.stdout:4/840: dwrite d6/d7/dc/f4d [0,4194304] 0 2024-09-20T20:31:44.412 INFO:tasks.workunit.client.0.smithi070.stdout:2/808: creat d3/de/d12/d4f/f11b x:0 0 0 2024-09-20T20:31:44.414 INFO:tasks.workunit.client.0.smithi070.stdout:7/790: link d2/d30/dad/fcc d2/d19/f107 0 2024-09-20T20:31:44.414 INFO:tasks.workunit.client.0.smithi070.stdout:8/856: mkdir d4/d27/dde/d121 0 2024-09-20T20:31:44.414 INFO:tasks.workunit.client.0.smithi070.stdout:3/728: creat d7/d15/d1e/d60/dd4/fdf x:0 0 0 2024-09-20T20:31:44.414 INFO:tasks.workunit.client.0.smithi070.stdout:2/809: rmdir d3 39 2024-09-20T20:31:44.414 INFO:tasks.workunit.client.0.smithi070.stdout:4/841: unlink d6/d5e/d51/d63/fcd 0 2024-09-20T20:31:44.414 INFO:tasks.workunit.client.0.smithi070.stdout:8/857: chown d4/d27/dde/fea 1 1 2024-09-20T20:31:44.414 INFO:tasks.workunit.client.0.smithi070.stdout:6/960: dwrite d4/d8/d10/d54/f6b [4194304,4194304] 0 2024-09-20T20:31:44.415 INFO:tasks.workunit.client.0.smithi070.stdout:3/729: readlink d7/d71/l84 0 2024-09-20T20:31:44.415 INFO:tasks.workunit.client.0.smithi070.stdout:9/816: creat d1/df/d25/d69/d85/d9f/db9/de3/d111/f122 x:0 0 0 2024-09-20T20:31:44.416 INFO:tasks.workunit.client.0.smithi070.stdout:4/842: rmdir d6/d26/d69/d71/d4c/dcc 39 2024-09-20T20:31:44.416 INFO:tasks.workunit.client.0.smithi070.stdout:3/730: stat d7/d15/d1e/c3b 0 2024-09-20T20:31:44.417 INFO:tasks.workunit.client.0.smithi070.stdout:1/931: dread d4/d6/d11/d7b/d83/ff6 [0,4194304] 0 2024-09-20T20:31:44.418 INFO:tasks.workunit.client.0.smithi070.stdout:6/961: creat d4/d8/db4/dbd/f154 x:0 0 0 2024-09-20T20:31:44.418 INFO:tasks.workunit.client.0.smithi070.stdout:9/817: chown d1/df/d18/d44/da2/f114 25157 1 2024-09-20T20:31:44.420 INFO:tasks.workunit.client.0.smithi070.stdout:6/962: chown d4/d8/d3a/f66 161 1 2024-09-20T20:31:44.421 INFO:tasks.workunit.client.0.smithi070.stdout:3/731: creat d7/d15/d1a/d48/d66/d69/d13/d1d/fe0 x:0 0 0 2024-09-20T20:31:44.421 INFO:tasks.workunit.client.0.smithi070.stdout:0/821: dwrite d4/d8/dff/dce/fde [0,4194304] 0 2024-09-20T20:31:44.422 INFO:tasks.workunit.client.0.smithi070.stdout:4/843: getdents d6/d26/d69/d71/d4c/dcc 0 2024-09-20T20:31:44.423 INFO:tasks.workunit.client.0.smithi070.stdout:1/932: read d4/d6/d11/d7b/fb1 [719532,65057] 0 2024-09-20T20:31:44.424 INFO:tasks.workunit.client.0.smithi070.stdout:7/791: dwrite d2/d8/f22 [0,4194304] 0 2024-09-20T20:31:44.425 INFO:tasks.workunit.client.0.smithi070.stdout:2/810: dwrite d3/d5/d9/d79/f7b [0,4194304] 0 2024-09-20T20:31:44.425 INFO:tasks.workunit.client.0.smithi070.stdout:3/732: creat d7/d15/d1a/d80/fe1 x:0 0 0 2024-09-20T20:31:44.425 INFO:tasks.workunit.client.0.smithi070.stdout:4/844: write d6/d5e/d6b/f100 [809029,43740] 0 2024-09-20T20:31:44.425 INFO:tasks.workunit.client.0.smithi070.stdout:2/811: sync 2024-09-20T20:31:44.425 INFO:tasks.workunit.client.0.smithi070.stdout:9/818: rename d1/df/d25/d69/d85/d9f/c104 to d1/df/d25/c123 0 2024-09-20T20:31:44.425 INFO:tasks.workunit.client.0.smithi070.stdout:5/862: dread d2/f79 [0,4194304] 0 2024-09-20T20:31:44.426 INFO:tasks.workunit.client.0.smithi070.stdout:7/792: symlink d2/d19/d7c/l108 0 2024-09-20T20:31:44.426 INFO:tasks.workunit.client.0.smithi070.stdout:0/822: getdents d4/d8/db6 0 2024-09-20T20:31:44.427 INFO:tasks.workunit.client.0.smithi070.stdout:1/933: write d4/d6/d11/d63/de7/d44/d48/f5e [2045704,37439] 0 2024-09-20T20:31:44.427 INFO:tasks.workunit.client.0.smithi070.stdout:9/819: symlink d1/df/d25/d69/d80/l124 0 2024-09-20T20:31:44.427 INFO:tasks.workunit.client.0.smithi070.stdout:5/863: fsync d2/f79 0 2024-09-20T20:31:44.428 INFO:tasks.workunit.client.0.smithi070.stdout:7/793: creat d2/d30/d78/f109 x:0 0 0 2024-09-20T20:31:44.428 INFO:tasks.workunit.client.0.smithi070.stdout:5/864: chown d2/d4/d98/d5b/f26 249 1 2024-09-20T20:31:44.428 INFO:tasks.workunit.client.0.smithi070.stdout:0/823: write d4/d48/de6/f6b [3404797,64897] 0 2024-09-20T20:31:44.429 INFO:tasks.workunit.client.0.smithi070.stdout:2/812: getdents d3/d5/d9 0 2024-09-20T20:31:44.429 INFO:tasks.workunit.client.0.smithi070.stdout:9/820: symlink d1/df/d25/d69/d10c/l125 0 2024-09-20T20:31:44.430 INFO:tasks.workunit.client.0.smithi070.stdout:7/794: truncate d2/d30/d63/f80 313743 0 2024-09-20T20:31:44.430 INFO:tasks.workunit.client.0.smithi070.stdout:0/824: rmdir d4/d8/d55/dd8/d1f/d2e 39 2024-09-20T20:31:44.430 INFO:tasks.workunit.client.0.smithi070.stdout:2/813: chown d3/de/d12/d1a/cb6 827 1 2024-09-20T20:31:44.431 INFO:tasks.workunit.client.0.smithi070.stdout:7/795: unlink d2/f1b 0 2024-09-20T20:31:44.431 INFO:tasks.workunit.client.0.smithi070.stdout:9/821: symlink d1/df/d25/d69/d85/d9f/l126 0 2024-09-20T20:31:44.432 INFO:tasks.workunit.client.0.smithi070.stdout:0/825: link d4/d19/f95 d4/d8/dff/f104 0 2024-09-20T20:31:44.434 INFO:tasks.workunit.client.0.smithi070.stdout:9/822: rmdir d1/df/d25/d69/d10c 39 2024-09-20T20:31:44.434 INFO:tasks.workunit.client.0.smithi070.stdout:6/963: truncate d4/d8/d3a/ffb 3054817 0 2024-09-20T20:31:44.434 INFO:tasks.workunit.client.0.smithi070.stdout:2/814: rename d3/d5/d9/d1c/dda/d104/d3e/d61/db2/fbc to d3/de/d12/df2/f11c 0 2024-09-20T20:31:44.435 INFO:tasks.workunit.client.0.smithi070.stdout:1/934: dread d4/d6/d11/d63/de7/d44/d4b/d87/dbb/fc9 [4194304,4194304] 0 2024-09-20T20:31:44.435 INFO:tasks.workunit.client.0.smithi070.stdout:4/845: write d6/d7/f16 [316581,49889] 0 2024-09-20T20:31:44.435 INFO:tasks.workunit.client.0.smithi070.stdout:9/823: chown d1/df/d18 1944373 1 2024-09-20T20:31:44.435 INFO:tasks.workunit.client.0.smithi070.stdout:7/796: link d2/d19/d25/d42/f91 d2/d8/f10a 0 2024-09-20T20:31:44.435 INFO:tasks.workunit.client.0.smithi070.stdout:6/964: mknod d4/c155 0 2024-09-20T20:31:44.436 INFO:tasks.workunit.client.0.smithi070.stdout:4/846: write d6/d5e/f25 [7018340,11100] 0 2024-09-20T20:31:44.436 INFO:tasks.workunit.client.0.smithi070.stdout:2/815: fdatasync d3/de/d12/df2/f11c 0 2024-09-20T20:31:44.437 INFO:tasks.workunit.client.0.smithi070.stdout:1/935: fsync d4/d32/de6/d10e/d148/d9d/db7/f93 0 2024-09-20T20:31:44.438 INFO:tasks.workunit.client.0.smithi070.stdout:9/824: rmdir d1/df/d25/d69/d85/d9f/db9/de3/de5 39 2024-09-20T20:31:44.438 INFO:tasks.workunit.client.0.smithi070.stdout:0/826: dread d4/d8/d55/dd8/d2d/f89 [0,4194304] 0 2024-09-20T20:31:44.438 INFO:tasks.workunit.client.0.smithi070.stdout:6/965: creat d4/d8/d17/d33/d61/d73/d10a/f156 x:0 0 0 2024-09-20T20:31:44.439 INFO:tasks.workunit.client.0.smithi070.stdout:1/936: stat d4/d6/d11/d7b/l13d 0 2024-09-20T20:31:44.439 INFO:tasks.workunit.client.0.smithi070.stdout:0/827: readlink d4/d8/dff/l8e 0 2024-09-20T20:31:44.439 INFO:tasks.workunit.client.0.smithi070.stdout:3/733: dwrite d7/d15/d1a/d80/f8c [0,4194304] 0 2024-09-20T20:31:44.439 INFO:tasks.workunit.client.0.smithi070.stdout:9/825: mkdir d1/df/d18/d46/d127 0 2024-09-20T20:31:44.440 INFO:tasks.workunit.client.0.smithi070.stdout:2/816: write d3/d5/dd/f63 [1400042,98427] 0 2024-09-20T20:31:44.442 INFO:tasks.workunit.client.0.smithi070.stdout:7/797: write d2/dfa/f44 [152621,123405] 0 2024-09-20T20:31:44.443 INFO:tasks.workunit.client.0.smithi070.stdout:2/817: readlink d3/d5/dd/lc9 0 2024-09-20T20:31:44.443 INFO:tasks.workunit.client.0.smithi070.stdout:6/966: creat d4/d8/db4/db6/d104/f157 x:0 0 0 2024-09-20T20:31:44.443 INFO:tasks.workunit.client.0.smithi070.stdout:9/826: creat d1/df/f128 x:0 0 0 2024-09-20T20:31:44.443 INFO:tasks.workunit.client.0.smithi070.stdout:4/847: link d6/d5e/d75/laa d6/d5e/d51/d78/dbc/l10d 0 2024-09-20T20:31:44.443 INFO:tasks.workunit.client.0.smithi070.stdout:7/798: write d2/dfa/d4a/fb3 [743697,74933] 0 2024-09-20T20:31:44.443 INFO:tasks.workunit.client.0.smithi070.stdout:2/818: dread - d3/d5/d9/d1c/d47/d10a/f110 zero size 2024-09-20T20:31:44.443 INFO:tasks.workunit.client.0.smithi070.stdout:9/827: readlink d1/d76/lb5 0 2024-09-20T20:31:44.444 INFO:tasks.workunit.client.0.smithi070.stdout:6/967: getdents d4/d8/d17/d33 0 2024-09-20T20:31:44.444 INFO:tasks.workunit.client.0.smithi070.stdout:6/968: unlink d4/d8/db4/db6/fe5 0 2024-09-20T20:31:44.444 INFO:tasks.workunit.client.0.smithi070.stdout:9/828: mkdir d1/df/d25/d69/d10c/d129 0 2024-09-20T20:31:44.445 INFO:tasks.workunit.client.0.smithi070.stdout:2/819: getdents d3/de/d9f 0 2024-09-20T20:31:44.446 INFO:tasks.workunit.client.0.smithi070.stdout:3/734: mkdir d7/d15/d1a/d4a/d51/de2 0 2024-09-20T20:31:44.447 INFO:tasks.workunit.client.0.smithi070.stdout:9/829: chown d1/df/d25/d69/d85/d9f/db9/de3/de5/f119 1 1 2024-09-20T20:31:44.447 INFO:tasks.workunit.client.0.smithi070.stdout:6/969: rename d4/d8/d10/d3c/l4b to d4/d8/d10/d54/db1/l158 0 2024-09-20T20:31:44.447 INFO:tasks.workunit.client.0.smithi070.stdout:3/735: creat d7/d15/d1a/d80/fe3 x:0 0 0 2024-09-20T20:31:44.448 INFO:tasks.workunit.client.0.smithi070.stdout:6/970: symlink d4/d8/d17/d33/l159 0 2024-09-20T20:31:44.448 INFO:tasks.workunit.client.0.smithi070.stdout:3/736: creat d7/d15/d1a/d48/d66/d69/d99/fe4 x:0 0 0 2024-09-20T20:31:44.449 INFO:tasks.workunit.client.0.smithi070.stdout:4/848: dwrite d6/f6f [0,4194304] 0 2024-09-20T20:31:44.450 INFO:tasks.workunit.client.0.smithi070.stdout:9/830: chown d1/df/d25/d69/d85/d9f/db9/de3/de5/fe6 184314092 1 2024-09-20T20:31:44.451 INFO:tasks.workunit.client.0.smithi070.stdout:0/828: dwrite d4/d8/d55/dd8/d1d/fc6 [0,4194304] 0 2024-09-20T20:31:44.451 INFO:tasks.workunit.client.0.smithi070.stdout:6/971: creat d4/d8/d17/db2/db5/f15a x:0 0 0 2024-09-20T20:31:44.451 INFO:tasks.workunit.client.0.smithi070.stdout:9/831: fsync d1/f14 0 2024-09-20T20:31:44.452 INFO:tasks.workunit.client.0.smithi070.stdout:6/972: chown d4 744 1 2024-09-20T20:31:44.454 INFO:tasks.workunit.client.0.smithi070.stdout:9/832: rmdir d1/df/d38/dac 39 2024-09-20T20:31:44.455 INFO:tasks.workunit.client.0.smithi070.stdout:0/829: creat d4/d8/d55/dd8/d1d/d37/d38/f105 x:0 0 0 2024-09-20T20:31:44.457 INFO:tasks.workunit.client.0.smithi070.stdout:4/849: dwrite d6/d26/d97/fc5 [0,4194304] 0 2024-09-20T20:31:44.457 INFO:tasks.workunit.client.0.smithi070.stdout:0/830: dread d4/d8/d55/dd8/fc5 [0,4194304] 0 2024-09-20T20:31:44.458 INFO:tasks.workunit.client.0.smithi070.stdout:9/833: fsync d1/df/d25/d69/d85/dad/f54 0 2024-09-20T20:31:44.458 INFO:tasks.workunit.client.0.smithi070.stdout:7/799: write d2/d19/d25/d42/f5a [642933,41038] 0 2024-09-20T20:31:44.458 INFO:tasks.workunit.client.0.smithi070.stdout:3/737: dwrite d7/d15/d1a/d48/d66/d69/d13/d72/fb0 [0,4194304] 0 2024-09-20T20:31:44.459 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:44.456+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:44.459 INFO:tasks.workunit.client.0.smithi070.stdout:4/850: write d6/d7/dc/d4a/d81/ff2 [1705320,27644] 0 2024-09-20T20:31:44.459 INFO:tasks.workunit.client.0.smithi070.stdout:5/865: dread d2/d7/d60/dbd/ffc [0,4194304] 0 2024-09-20T20:31:44.459 INFO:tasks.workunit.client.0.smithi070.stdout:4/851: sync 2024-09-20T20:31:44.459 INFO:tasks.workunit.client.0.smithi070.stdout:2/820: truncate d3/d5/d9/d10/f11 2755198 0 2024-09-20T20:31:44.460 INFO:tasks.workunit.client.0.smithi070.stdout:7/800: fsync d2/d30/d78/fbf 0 2024-09-20T20:31:44.460 INFO:tasks.workunit.client.0.smithi070.stdout:5/866: write d2/d7/fd3 [197242,46394] 0 2024-09-20T20:31:44.461 INFO:tasks.workunit.client.0.smithi070.stdout:3/738: rmdir d7/d15/d1a/d48/d57/d75 39 2024-09-20T20:31:44.462 INFO:tasks.workunit.client.0.smithi070.stdout:2/821: write d3/d5/d9/d10/fd9 [592232,60674] 0 2024-09-20T20:31:44.462 INFO:tasks.workunit.client.0.smithi070.stdout:5/867: dread - d2/d7/d60/dbd/f107 zero size 2024-09-20T20:31:44.464 INFO:tasks.workunit.client.0.smithi070.stdout:5/868: write d2/d7/d60/fb1 [1383793,80737] 0 2024-09-20T20:31:44.465 INFO:tasks.workunit.client.0.smithi070.stdout:2/822: write d3/d5/d9/d1c/dda/f113 [881528,7952] 0 2024-09-20T20:31:44.465 INFO:tasks.workunit.client.0.smithi070.stdout:3/739: rmdir d7/d15/d1a/d48/d66/d69/d13/d7a 39 2024-09-20T20:31:44.466 INFO:tasks.workunit.client.0.smithi070.stdout:9/834: dwrite d1/df/d38/fc1 [4194304,4194304] 0 2024-09-20T20:31:44.467 INFO:tasks.workunit.client.0.smithi070.stdout:0/831: dwrite d4/d8/d12/d23/f100 [0,4194304] 0 2024-09-20T20:31:44.467 INFO:tasks.workunit.client.0.smithi070.stdout:7/801: dread d2/d8/f3b [0,4194304] 0 2024-09-20T20:31:44.467 INFO:tasks.workunit.client.0.smithi070.stdout:9/835: write d1/f5 [3677569,42850] 0 2024-09-20T20:31:44.468 INFO:tasks.workunit.client.0.smithi070.stdout:7/802: unlink d2/d30/d63/fee 0 2024-09-20T20:31:44.469 INFO:tasks.workunit.client.0.smithi070.stdout:5/869: link d2/d4/d98/d4c/f117 d2/df/d40/da8/f125 0 2024-09-20T20:31:44.469 INFO:tasks.workunit.client.0.smithi070.stdout:0/832: mkdir d4/d8/d12/d23/d106 0 2024-09-20T20:31:44.469 INFO:tasks.workunit.client.0.smithi070.stdout:9/836: creat d1/df/d25/d69/daf/f12a x:0 0 0 2024-09-20T20:31:44.469 INFO:tasks.workunit.client.0.smithi070.stdout:7/803: symlink d2/d19/d2e/daa/l10b 0 2024-09-20T20:31:44.470 INFO:tasks.workunit.client.0.smithi070.stdout:7/804: write d2/d30/d63/f81 [8371,13040] 0 2024-09-20T20:31:44.471 INFO:tasks.workunit.client.0.smithi070.stdout:0/833: creat d4/d8/d55/dd8/d1d/d37/d3e/df8/d3b/da9/f107 x:0 0 0 2024-09-20T20:31:44.471 INFO:tasks.workunit.client.0.smithi070.stdout:5/870: getdents d2/d4/de/d47/d67/d92/de2 0 2024-09-20T20:31:44.471 INFO:tasks.workunit.client.0.smithi070.stdout:9/837: write d1/df/d25/d69/d85/d9f/db9/de3/de5/f119 [765762,8219] 0 2024-09-20T20:31:44.472 INFO:tasks.workunit.client.0.smithi070.stdout:0/834: unlink d4/d8/d55/dd8/d1d/fe3 0 2024-09-20T20:31:44.472 INFO:tasks.workunit.client.0.smithi070.stdout:9/838: getdents d1/df/d25/d69 0 2024-09-20T20:31:44.473 INFO:tasks.workunit.client.0.smithi070.stdout:0/835: mknod d4/d8/d55/dd8/d2d/c108 0 2024-09-20T20:31:44.473 INFO:tasks.workunit.client.0.smithi070.stdout:5/871: link d2/d4/d98/d5b/f37 d2/d4/de/d47/f126 0 2024-09-20T20:31:44.474 INFO:tasks.workunit.client.0.smithi070.stdout:0/836: mkdir d4/d8/d55/dd8/d1d/d41/dd1/d109 0 2024-09-20T20:31:44.474 INFO:tasks.workunit.client.0.smithi070.stdout:9/839: symlink d1/df/d25/d69/d85/d9f/db9/de3/d11a/l12b 0 2024-09-20T20:31:44.474 INFO:tasks.workunit.client.0.smithi070.stdout:9/840: stat d1/df/d18/d44 0 2024-09-20T20:31:44.475 INFO:tasks.workunit.client.0.smithi070.stdout:9/841: creat d1/df/d18/d44/da2/dab/f12c x:0 0 0 2024-09-20T20:31:44.476 INFO:tasks.workunit.client.0.smithi070.stdout:0/837: link d4/d8/d55/dd8/d1d/d37/d3e/f83 d4/d8/d55/dd8/d1d/d37/d3e/df8/d3b/da9/f10a 0 2024-09-20T20:31:44.476 INFO:tasks.workunit.client.0.smithi070.stdout:9/842: write d1/df/d25/d69/d80/f10d [203335,4987] 0 2024-09-20T20:31:44.477 INFO:tasks.workunit.client.0.smithi070.stdout:0/838: unlink d4/d48/de6/l34 0 2024-09-20T20:31:44.478 INFO:tasks.workunit.client.0.smithi070.stdout:0/839: symlink d4/d48/d7b/l10b 0 2024-09-20T20:31:44.478 INFO:tasks.workunit.client.0.smithi070.stdout:0/840: rename d4/d8/dff/dce to d4/d8/d12/d10c 0 2024-09-20T20:31:44.479 INFO:tasks.workunit.client.0.smithi070.stdout:0/841: write d4/d48/d4e/f90 [668443,80395] 0 2024-09-20T20:31:44.480 INFO:tasks.workunit.client.0.smithi070.stdout:0/842: symlink d4/d19/d82/l10d 0 2024-09-20T20:31:44.481 INFO:tasks.workunit.client.0.smithi070.stdout:0/843: rename d4/d8/d12/d23/ce1 to d4/d8/d12/d23/db2/c10e 0 2024-09-20T20:31:44.482 INFO:tasks.workunit.client.0.smithi070.stdout:0/844: chown d4/d8/d12/d23/laf 1953 1 2024-09-20T20:31:44.482 INFO:tasks.workunit.client.0.smithi070.stdout:0/845: unlink d4/d8/d55/dd8/c65 0 2024-09-20T20:31:44.483 INFO:tasks.workunit.client.0.smithi070.stdout:0/846: getdents d4/d8/d55/dd8/d1d/d41 0 2024-09-20T20:31:44.484 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:44.484 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:44.486 INFO:tasks.workunit.client.0.smithi070.stdout:5/872: read d2/d4/d98/d4c/f117 [1554788,32345] 0 2024-09-20T20:31:44.486 INFO:tasks.workunit.client.0.smithi070.stdout:3/740: write d7/d15/d1a/d80/fc3 [154390,124211] 0 2024-09-20T20:31:44.486 INFO:tasks.workunit.client.0.smithi070.stdout:2/823: truncate d3/f36 6103910 0 2024-09-20T20:31:44.487 INFO:tasks.workunit.client.0.smithi070.stdout:5/873: creat d2/d4/d98/d5b/f127 x:0 0 0 2024-09-20T20:31:44.488 INFO:tasks.workunit.client.0.smithi070.stdout:2/824: truncate d3/d5/f34 4426007 0 2024-09-20T20:31:44.488 INFO:tasks.workunit.client.0.smithi070.stdout:3/741: creat d7/d15/d1a/d4a/d51/d5b/fe5 x:0 0 0 2024-09-20T20:31:44.489 INFO:tasks.workunit.client.0.smithi070.stdout:2/825: write d3/de/d12/d1a/fc6 [1234279,29707] 0 2024-09-20T20:31:44.490 INFO:tasks.workunit.client.0.smithi070.stdout:5/874: truncate d2/d7/d60/dbd/dcd/ff1 778496 0 2024-09-20T20:31:44.490 INFO:tasks.workunit.client.0.smithi070.stdout:2/826: chown d3/de/d12/f7a 68 1 2024-09-20T20:31:44.490 INFO:tasks.workunit.client.0.smithi070.stdout:6/973: dread d4/d8/d38/f4e [0,4194304] 0 2024-09-20T20:31:44.491 INFO:tasks.workunit.client.0.smithi070.stdout:7/805: truncate d2/d19/d2e/f60 4748242 0 2024-09-20T20:31:44.491 INFO:tasks.workunit.client.0.smithi070.stdout:2/827: mknod d3/d5/d9/d42/c11d 0 2024-09-20T20:31:44.491 INFO:tasks.workunit.client.0.smithi070.stdout:4/852: dread d6/d26/dd7/f9a [0,4194304] 0 2024-09-20T20:31:44.492 INFO:tasks.workunit.client.0.smithi070.stdout:7/806: write d2/d19/f27 [2826672,7560] 0 2024-09-20T20:31:44.493 INFO:tasks.workunit.client.0.smithi070.stdout:4/853: chown d6/d5e/d51/d78/de5 487623026 1 2024-09-20T20:31:44.494 INFO:tasks.workunit.client.0.smithi070.stdout:7/807: write d2/d30/d78/fbf [232881,16445] 0 2024-09-20T20:31:44.494 INFO:tasks.workunit.client.0.smithi070.stdout:4/854: chown d6/f86 126193 1 2024-09-20T20:31:44.494 INFO:tasks.workunit.client.0.smithi070.stdout:2/828: mkdir d3/d4c/d5c/d86/d11e 0 2024-09-20T20:31:44.499 INFO:tasks.workunit.client.0.smithi070.stdout:1/937: dread f2 [4194304,4194304] 0 2024-09-20T20:31:44.500 INFO:tasks.workunit.client.0.smithi070.stdout:3/742: dwrite f2 [0,4194304] 0 2024-09-20T20:31:44.500 INFO:tasks.workunit.client.0.smithi070.stdout:5/875: dwrite d2/d4/d98/fc0 [0,4194304] 0 2024-09-20T20:31:44.500 INFO:tasks.workunit.client.0.smithi070.stdout:7/808: dread d2/d30/d63/f80 [0,4194304] 0 2024-09-20T20:31:44.501 INFO:tasks.workunit.client.0.smithi070.stdout:8/858: dread d4/d27/d2a/d5b/d6c/da6/f111 [0,4194304] 0 2024-09-20T20:31:44.503 INFO:tasks.workunit.client.0.smithi070.stdout:1/938: mknod d4/d6/d11/d63/de7/d44/de8/c14a 0 2024-09-20T20:31:44.504 INFO:tasks.workunit.client.0.smithi070.stdout:2/829: dwrite d3/d5/d9/f88 [0,4194304] 0 2024-09-20T20:31:44.504 INFO:tasks.workunit.client.0.smithi070.stdout:5/876: rename d2/df/d40/ddd to d2/db7/d11a/d128 0 2024-09-20T20:31:44.504 INFO:tasks.workunit.client.0.smithi070.stdout:4/855: write d6/d7/dc/f52 [1194615,73827] 0 2024-09-20T20:31:44.505 INFO:tasks.workunit.client.0.smithi070.stdout:3/743: creat d7/d15/d1a/d4a/d51/d5b/d88/fe6 x:0 0 0 2024-09-20T20:31:44.505 INFO:tasks.workunit.client.0.smithi070.stdout:8/859: creat d4/d27/d2a/d5b/d98/da9/db5/d11e/f122 x:0 0 0 2024-09-20T20:31:44.505 INFO:tasks.workunit.client.0.smithi070.stdout:8/860: write d4/d27/d2a/d5b/ff1 [271097,71623] 0 2024-09-20T20:31:44.505 INFO:tasks.workunit.client.0.smithi070.stdout:4/856: chown d6/d5e/d51/d84/cde 817 1 2024-09-20T20:31:44.505 INFO:tasks.workunit.client.0.smithi070.stdout:3/744: write d7/d15/d1a/d48/d66/d69/d99/dcd/fdd [872179,50567] 0 2024-09-20T20:31:44.505 INFO:tasks.workunit.client.0.smithi070.stdout:1/939: mkdir d4/d32/d14b 0 2024-09-20T20:31:44.505 INFO:tasks.workunit.client.0.smithi070.stdout:3/745: chown d7/d15/d1a/d48/d66/d69/d13/d1d/f34 305 1 2024-09-20T20:31:44.507 INFO:tasks.workunit.client.0.smithi070.stdout:7/809: creat d2/d19/d2e/f10c x:0 0 0 2024-09-20T20:31:44.508 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:44.510 INFO:tasks.workunit.client.0.smithi070.stdout:4/857: mknod d6/d26/dd7/df1/c10e 0 2024-09-20T20:31:44.510 INFO:tasks.workunit.client.0.smithi070.stdout:2/830: creat d3/d5/f11f x:0 0 0 2024-09-20T20:31:44.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/940: chown d4/d6/d11/f38 15472 1 2024-09-20T20:31:44.510 INFO:tasks.workunit.client.0.smithi070.stdout:3/746: readlink d7/d15/d1a/d4a/d51/d5b/d9e/la8 0 2024-09-20T20:31:44.510 INFO:tasks.workunit.client.0.smithi070.stdout:4/858: rename d6/ce2 to d6/d26/dd7/df1/c10f 0 2024-09-20T20:31:44.510 INFO:tasks.workunit.client.0.smithi070.stdout:1/941: mkdir d4/d32/dea/d14c 0 2024-09-20T20:31:44.510 INFO:tasks.workunit.client.0.smithi070.stdout:3/747: write d7/d15/d1a/d4a/f55 [839633,80334] 0 2024-09-20T20:31:44.511 INFO:tasks.workunit.client.0.smithi070.stdout:2/831: creat d3/d5/d9/d1c/dda/d104/d3e/d61/db2/f120 x:0 0 0 2024-09-20T20:31:44.511 INFO:tasks.workunit.client.0.smithi070.stdout:4/859: write d6/d5e/d6b/d74/dd3/ffa [1028350,35904] 0 2024-09-20T20:31:44.512 INFO:tasks.workunit.client.0.smithi070.stdout:8/861: dwrite d4/d27/f40 [4194304,4194304] 0 2024-09-20T20:31:44.512 INFO:tasks.workunit.client.0.smithi070.stdout:1/942: creat d4/d6/d11/d63/de7/d44/de8/f14d x:0 0 0 2024-09-20T20:31:44.512 INFO:tasks.workunit.client.0.smithi070.stdout:4/860: dread - d6/d26/fda zero size 2024-09-20T20:31:44.515 INFO:tasks.workunit.client.0.smithi070.stdout:2/832: symlink d3/d5/dd/d99/ddb/l121 0 2024-09-20T20:31:44.515 INFO:tasks.workunit.client.0.smithi070.stdout:7/810: fdatasync d2/d19/d2e/f60 0 2024-09-20T20:31:44.515 INFO:tasks.workunit.client.0.smithi070.stdout:3/748: mkdir d7/d15/d1a/d48/d66/de7 0 2024-09-20T20:31:44.515 INFO:tasks.workunit.client.0.smithi070.stdout:1/943: write f2 [4560414,70073] 0 2024-09-20T20:31:44.516 INFO:tasks.workunit.client.0.smithi070.stdout:4/861: readlink d6/d7/dc/d4a/d58/l66 0 2024-09-20T20:31:44.516 INFO:tasks.workunit.client.0.smithi070.stdout:8/862: rmdir d4/db/d66/d8d 39 2024-09-20T20:31:44.516 INFO:tasks.workunit.client.0.smithi070.stdout:2/833: creat d3/de/d12/d4f/f122 x:0 0 0 2024-09-20T20:31:44.516 INFO:tasks.workunit.client.0.smithi070.stdout:4/862: stat d6/f8 0 2024-09-20T20:31:44.517 INFO:tasks.workunit.client.0.smithi070.stdout:4/863: write d6/d26/fc1 [631874,6485] 0 2024-09-20T20:31:44.517 INFO:tasks.workunit.client.0.smithi070.stdout:9/843: dread d1/f1a [0,4194304] 0 2024-09-20T20:31:44.518 INFO:tasks.workunit.client.0.smithi070.stdout:3/749: rmdir d7/d15/d1a/d48/d66/d69/d13/d1d 39 2024-09-20T20:31:44.519 INFO:tasks.workunit.client.0.smithi070.stdout:8/863: unlink d4/db/d64/ff3 0 2024-09-20T20:31:44.519 INFO:tasks.workunit.client.0.smithi070.stdout:1/944: fdatasync d4/d32/de6/d10e/d148/d9d/db7/ffd 0 2024-09-20T20:31:44.519 INFO:tasks.workunit.client.0.smithi070.stdout:3/750: chown d7/d15/d1e/d60/dd4 122642 1 2024-09-20T20:31:44.519 INFO:tasks.workunit.client.0.smithi070.stdout:2/834: mknod d3/d5/d9/d79/c123 0 2024-09-20T20:31:44.520 INFO:tasks.workunit.client.0.smithi070.stdout:4/864: creat d6/d5e/d6b/d74/f110 x:0 0 0 2024-09-20T20:31:44.520 INFO:tasks.workunit.client.0.smithi070.stdout:9/844: symlink d1/df/l12d 0 2024-09-20T20:31:44.520 INFO:tasks.workunit.client.0.smithi070.stdout:0/847: dread d4/d8/d55/dd8/d1d/d37/d3e/f83 [0,4194304] 0 2024-09-20T20:31:44.521 INFO:tasks.workunit.client.0.smithi070.stdout:1/945: mkdir d4/d32/d14b/d14e 0 2024-09-20T20:31:44.522 INFO:tasks.workunit.client.0.smithi070.stdout:4/865: rename d6/d26/deb/lf0 to d6/d26/dd7/l111 0 2024-09-20T20:31:44.522 INFO:tasks.workunit.client.0.smithi070.stdout:0/848: fdatasync d4/d19/f52 0 2024-09-20T20:31:44.522 INFO:tasks.workunit.client.0.smithi070.stdout:2/835: fsync d3/d5/d9/d1c/dda/d104/d3e/dbe/fe8 0 2024-09-20T20:31:44.522 INFO:tasks.workunit.client.0.smithi070.stdout:9/845: symlink d1/df/d25/l12e 0 2024-09-20T20:31:44.522 INFO:tasks.workunit.client.0.smithi070.stdout:6/974: dread d4/d8/d17/d33/d36/f53 [0,4194304] 0 2024-09-20T20:31:44.523 INFO:tasks.workunit.client.0.smithi070.stdout:4/866: mknod d6/d7/dc/d20/c112 0 2024-09-20T20:31:44.523 INFO:tasks.workunit.client.0.smithi070.stdout:3/751: link d7/d15/c40 d7/d15/d1a/d48/d66/de7/ce8 0 2024-09-20T20:31:44.523 INFO:tasks.workunit.client.0.smithi070.stdout:2/836: read - d3/d5/dd/d99/ff8 zero size 2024-09-20T20:31:44.524 INFO:tasks.workunit.client.0.smithi070.stdout:6/975: creat d4/d8/d10/d130/f15b x:0 0 0 2024-09-20T20:31:44.524 INFO:tasks.workunit.client.0.smithi070.stdout:1/946: sync 2024-09-20T20:31:44.524 INFO:tasks.workunit.client.0.smithi070.stdout:3/752: mkdir d7/d15/d1e/d60/de9 0 2024-09-20T20:31:44.525 INFO:tasks.workunit.client.0.smithi070.stdout:0/849: getdents d4/d8/d12/d23 0 2024-09-20T20:31:44.525 INFO:tasks.workunit.client.0.smithi070.stdout:2/837: stat d3/d5/dd/d5a 0 2024-09-20T20:31:44.526 INFO:tasks.workunit.client.0.smithi070.stdout:1/947: fdatasync d4/d6/d11/d63/da3/fef 0 2024-09-20T20:31:44.526 INFO:tasks.workunit.client.0.smithi070.stdout:3/753: symlink d7/d15/d1a/d48/d66/d69/lea 0 2024-09-20T20:31:44.527 INFO:tasks.workunit.client.0.smithi070.stdout:5/877: dwrite d2/d4/f1e [0,4194304] 0 2024-09-20T20:31:44.528 INFO:tasks.workunit.client.0.smithi070.stdout:3/754: write d7/d15/d1e/d65/f9a [2917669,120108] 0 2024-09-20T20:31:44.529 INFO:tasks.workunit.client.0.smithi070.stdout:3/755: readlink d7/d15/d1e/d65/l79 0 2024-09-20T20:31:44.530 INFO:tasks.workunit.client.0.smithi070.stdout:9/846: dread d1/df/d38/dac/fec [0,4194304] 0 2024-09-20T20:31:44.530 INFO:tasks.workunit.client.0.smithi070.stdout:5/878: rename d2/d4/d121 to d2/df/d40/d129 0 2024-09-20T20:31:44.532 INFO:tasks.workunit.client.0.smithi070.stdout:6/976: dwrite d4/d8/d17/d33/d36/ddb/f13b [0,4194304] 0 2024-09-20T20:31:44.533 INFO:tasks.workunit.client.0.smithi070.stdout:5/879: creat d2/df/f12a x:0 0 0 2024-09-20T20:31:44.533 INFO:tasks.workunit.client.0.smithi070.stdout:3/756: getdents d7/d15/d1a/d48 0 2024-09-20T20:31:44.533 INFO:tasks.workunit.client.0.smithi070.stdout:0/850: dwrite d4/d8/d55/dd8/d1f/fae [0,4194304] 0 2024-09-20T20:31:44.534 INFO:tasks.workunit.client.0.smithi070.stdout:3/757: chown d7/d15/d1a/f44 2135071876 1 2024-09-20T20:31:44.534 INFO:tasks.workunit.client.0.smithi070.stdout:9/847: truncate d1/df/d25/d69/d85/d9f/db9/de3/de5/f102 920926 0 2024-09-20T20:31:44.536 INFO:tasks.workunit.client.0.smithi070.stdout:5/880: mknod d2/d4/de/d47/d67/d92/c12b 0 2024-09-20T20:31:44.539 INFO:tasks.workunit.client.0.smithi070.stdout:8/864: truncate d4/db/d64/d95/da5/d115/f6d 356723 0 2024-09-20T20:31:44.540 INFO:tasks.workunit.client.0.smithi070.stdout:5/881: mkdir d2/db7/d11a/d122/d12c 0 2024-09-20T20:31:44.540 INFO:tasks.workunit.client.0.smithi070.stdout:3/758: rename d7/f1b to d7/d15/d1a/d48/d66/d69/feb 0 2024-09-20T20:31:44.540 INFO:tasks.workunit.client.0.smithi070.stdout:7/811: dwrite d2/d19/d25/d61/f6f [0,4194304] 0 2024-09-20T20:31:44.541 INFO:tasks.workunit.client.0.smithi070.stdout:7/812: write d2/d19/dbe/dd0/fe1 [593128,72973] 0 2024-09-20T20:31:44.541 INFO:tasks.workunit.client.0.smithi070.stdout:4/867: dread d6/d43/f5c [0,4194304] 0 2024-09-20T20:31:44.542 INFO:tasks.workunit.client.0.smithi070.stdout:0/851: read d4/d8/d55/dd8/f51 [88199,1758] 0 2024-09-20T20:31:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:8/865: creat d4/d27/d2a/d43/de7/f123 x:0 0 0 2024-09-20T20:31:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:4/868: mkdir d6/d26/deb/d113 0 2024-09-20T20:31:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:5/882: fsync d2/d4/de/d47/d67/d92/fa3 0 2024-09-20T20:31:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:3/759: creat d7/d15/d1e/d60/de9/fec x:0 0 0 2024-09-20T20:31:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:2/838: dwrite d3/d4c/d5c/fa2 [0,4194304] 0 2024-09-20T20:31:44.544 INFO:tasks.workunit.client.0.smithi070.stdout:0/852: rename d4/d8/d55/d7c to d4/d48/d10f 0 2024-09-20T20:31:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:5/883: mkdir d2/d4/d98/dc7/d12d 0 2024-09-20T20:31:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:1/948: truncate d4/d32/d60/dca/fe4 3244365 0 2024-09-20T20:31:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:2/839: unlink d3/d4c/d5c/d86/ca9 0 2024-09-20T20:31:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:0/853: chown d4/d8/d55/dd8/d1d/d37/d3e/df8/dd5 11755006 1 2024-09-20T20:31:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:3/760: rename d7/d15/d1a/d48/d66/d69/ccf to d7/ced 0 2024-09-20T20:31:44.546 INFO:tasks.workunit.client.0.smithi070.stdout:0/854: fdatasync d4/d19/fa2 0 2024-09-20T20:31:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:2/840: symlink d3/d5/dd/d99/ddb/l124 0 2024-09-20T20:31:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:3/761: chown d7/d15/d1a/d80/dd8 1345766 1 2024-09-20T20:31:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:2/841: readlink d3/d5/dd/lc9 0 2024-09-20T20:31:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:5/884: link d2/d7/fd3 d2/d4/d98/d5b/d90/da0/f12e 0 2024-09-20T20:31:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:0/855: dread - d4/d8/d55/dd8/d1d/d37/d38/ff5 zero size 2024-09-20T20:31:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:3/762: truncate d7/d15/d1a/d80/fe3 651196 0 2024-09-20T20:31:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:2/842: chown d3/d5/d9/d1c/dda/d104/d3e/ld0 5801176 1 2024-09-20T20:31:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:0/856: mknod d4/d1b/c110 0 2024-09-20T20:31:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:7/813: dread d2/d8/f64 [0,4194304] 0 2024-09-20T20:31:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:4/869: dwrite d6/d7/dc/d4a/fb1 [4194304,4194304] 0 2024-09-20T20:31:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:2/843: write d3/d5/d9/d10/f52 [3945136,118730] 0 2024-09-20T20:31:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:7/814: chown d2/d19/d25/d61/fb1 22388 1 2024-09-20T20:31:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:0/857: creat d4/d8/d12/d23/db2/f111 x:0 0 0 2024-09-20T20:31:44.554 INFO:tasks.workunit.client.0.smithi070.stdout:6/977: dread d4/d8/f2f [4194304,4194304] 0 2024-09-20T20:31:44.554 INFO:tasks.workunit.client.0.smithi070.stdout:7/815: mknod d2/d19/dbe/c10d 0 2024-09-20T20:31:44.556 INFO:tasks.workunit.client.0.smithi070.stdout:6/978: chown d4/d8/d10/d54/d7a/ca5 4 1 2024-09-20T20:31:44.559 INFO:tasks.workunit.client.0.smithi070.stdout:3/763: dwrite d7/d15/d1a/d48/d57/d75/f7f [0,4194304] 0 2024-09-20T20:31:44.560 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:44.557+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:44.561 INFO:tasks.workunit.client.0.smithi070.stdout:1/949: truncate d4/d6/d11/d63/de7/d44/d4b/f10f 308395 0 2024-09-20T20:31:44.561 INFO:tasks.workunit.client.0.smithi070.stdout:3/764: stat d7/d15/d1a/d48/d66/d69/d99/fe4 0 2024-09-20T20:31:44.562 INFO:tasks.workunit.client.0.smithi070.stdout:0/858: dwrite d4/d8/d55/dd8/d1d/d37/d3e/df8/f75 [0,4194304] 0 2024-09-20T20:31:44.563 INFO:tasks.workunit.client.0.smithi070.stdout:0/859: write d4/d48/de6/f68 [2804243,101482] 0 2024-09-20T20:31:44.564 INFO:tasks.workunit.client.0.smithi070.stdout:6/979: dwrite d4/d8/d17/db2/f139 [0,4194304] 0 2024-09-20T20:31:44.565 INFO:tasks.workunit.client.0.smithi070.stdout:9/848: dread d1/df/d25/d69/d80/fd3 [0,4194304] 0 2024-09-20T20:31:44.566 INFO:tasks.workunit.client.0.smithi070.stdout:9/849: truncate d1/df/d38/fa3 325014 0 2024-09-20T20:31:44.569 INFO:tasks.workunit.client.0.smithi070.stdout:5/885: truncate d2/df/f22 877401 0 2024-09-20T20:31:44.569 INFO:tasks.workunit.client.0.smithi070.stdout:6/980: rename d4/d8/d17/d33/d36/c39 to d4/d8/db4/dbd/c15c 0 2024-09-20T20:31:44.570 INFO:tasks.workunit.client.0.smithi070.stdout:6/981: chown d4/f23 18914063 1 2024-09-20T20:31:44.570 INFO:tasks.workunit.client.0.smithi070.stdout:9/850: chown d1/df/d25/d9e/ca6 59812 1 2024-09-20T20:31:44.571 INFO:tasks.workunit.client.0.smithi070.stdout:8/866: dread d4/d27/f40 [0,4194304] 0 2024-09-20T20:31:44.572 INFO:tasks.workunit.client.0.smithi070.stdout:5/886: getdents d2/d4/d98/d4c 0 2024-09-20T20:31:44.573 INFO:tasks.workunit.client.0.smithi070.stdout:1/950: dwrite d4/d32/de6/d10e/d148/d78/db0/fe1 [0,4194304] 0 2024-09-20T20:31:44.573 INFO:tasks.workunit.client.0.smithi070.stdout:8/867: readlink d4/db/d64/d95/lf0 0 2024-09-20T20:31:44.574 INFO:tasks.workunit.client.0.smithi070.stdout:9/851: link d1/df/d25/f58 d1/df/d18/d44/f12f 0 2024-09-20T20:31:44.577 INFO:tasks.workunit.client.0.smithi070.stdout:9/852: write d1/df/d18/d44/d77/dd0/f121 [16531,125032] 0 2024-09-20T20:31:44.577 INFO:tasks.workunit.client.0.smithi070.stdout:1/951: truncate d4/d6/d11/d7b/d83/f95 4556650 0 2024-09-20T20:31:44.577 INFO:tasks.workunit.client.0.smithi070.stdout:0/860: dwrite d4/d48/d67/da5/ff6 [0,4194304] 0 2024-09-20T20:31:44.578 INFO:tasks.workunit.client.0.smithi070.stdout:0/861: write d4/d8/d55/dd8/f51 [463378,52345] 0 2024-09-20T20:31:44.579 INFO:tasks.workunit.client.0.smithi070.stdout:5/887: truncate d2/d7/d60/dbd/fcc 1884200 0 2024-09-20T20:31:44.579 INFO:tasks.workunit.client.0.smithi070.stdout:1/952: dread d4/d6/d11/d7b/d83/ff6 [0,4194304] 0 2024-09-20T20:31:44.581 INFO:tasks.workunit.client.0.smithi070.stdout:6/982: dwrite d4/d8/d1e/f7c [0,4194304] 0 2024-09-20T20:31:44.581 INFO:tasks.workunit.client.0.smithi070.stdout:9/853: mknod d1/df/d25/d69/d85/c130 0 2024-09-20T20:31:44.581 INFO:tasks.workunit.client.0.smithi070.stdout:9/854: chown d1/df/d25/d69/d80/l124 16195558 1 2024-09-20T20:31:44.581 INFO:tasks.workunit.client.0.smithi070.stdout:3/765: fsync d7/d15/d1a/d48/d57/d75/f7f 0 2024-09-20T20:31:44.582 INFO:tasks.workunit.client.0.smithi070.stdout:8/868: dwrite d4/db/d64/d95/da5/d115/d31/f3f [0,4194304] 0 2024-09-20T20:31:44.583 INFO:tasks.workunit.client.0.smithi070.stdout:2/844: dread d3/de/d12/d1a/f3f [0,4194304] 0 2024-09-20T20:31:44.584 INFO:tasks.workunit.client.0.smithi070.stdout:9/855: creat d1/df/d38/dac/f131 x:0 0 0 2024-09-20T20:31:44.585 INFO:tasks.workunit.client.0.smithi070.stdout:6/983: mknod d4/d8/d17/d33/d61/d73/d10a/c15d 0 2024-09-20T20:31:44.585 INFO:tasks.workunit.client.0.smithi070.stdout:3/766: symlink d7/d15/d1a/d80/dd8/lee 0 2024-09-20T20:31:44.586 INFO:tasks.workunit.client.0.smithi070.stdout:9/856: chown d1/df/d25/d69/d85/lcd 115332314 1 2024-09-20T20:31:44.586 INFO:tasks.workunit.client.0.smithi070.stdout:6/984: dread - d4/d8/d10/d54/d55/f140 zero size 2024-09-20T20:31:44.586 INFO:tasks.workunit.client.0.smithi070.stdout:8/869: rmdir d4/db/d64/d95/da5/d115/d39/ddf 39 2024-09-20T20:31:44.586 INFO:tasks.workunit.client.0.smithi070.stdout:0/862: rename d4/d48/de6 to d4/d8/dff/d112 0 2024-09-20T20:31:44.586 INFO:tasks.workunit.client.0.smithi070.stdout:2/845: mknod d3/d5/d9/d1c/dda/d104/c125 0 2024-09-20T20:31:44.587 INFO:tasks.workunit.client.0.smithi070.stdout:9/857: creat d1/df/d25/d69/d80/f132 x:0 0 0 2024-09-20T20:31:44.588 INFO:tasks.workunit.client.0.smithi070.stdout:4/870: dread d6/d26/fbe [0,4194304] 0 2024-09-20T20:31:44.588 INFO:tasks.workunit.client.0.smithi070.stdout:1/953: rename d4/d6/c6d to d4/d6/d11/d63/de7/d44/d5a/c14f 0 2024-09-20T20:31:44.588 INFO:tasks.workunit.client.0.smithi070.stdout:3/767: creat d7/d15/d1a/d48/d66/d69/fef x:0 0 0 2024-09-20T20:31:44.588 INFO:tasks.workunit.client.0.smithi070.stdout:5/888: write d2/d4/de/d47/d5f/f108 [358588,95024] 0 2024-09-20T20:31:44.588 INFO:tasks.workunit.client.0.smithi070.stdout:6/985: fdatasync d4/d8/d1e/db7/f105 0 2024-09-20T20:31:44.589 INFO:tasks.workunit.client.0.smithi070.stdout:9/858: creat d1/df/d38/f133 x:0 0 0 2024-09-20T20:31:44.590 INFO:tasks.workunit.client.0.smithi070.stdout:3/768: symlink d7/d15/d1a/d4a/d51/lf0 0 2024-09-20T20:31:44.590 INFO:tasks.workunit.client.0.smithi070.stdout:4/871: link d6/d5e/d51/fc4 d6/d5e/d75/d40/f114 0 2024-09-20T20:31:44.591 INFO:tasks.workunit.client.0.smithi070.stdout:1/954: truncate d4/d6/d11/d63/de7/d44/fc8 367700 0 2024-09-20T20:31:44.591 INFO:tasks.workunit.client.0.smithi070.stdout:9/859: fsync d1/df/d25/d69/d85/dad/f54 0 2024-09-20T20:31:44.591 INFO:tasks.workunit.client.0.smithi070.stdout:3/769: truncate d7/d71/fb8 746548 0 2024-09-20T20:31:44.592 INFO:tasks.workunit.client.0.smithi070.stdout:5/889: read d2/d7/d60/f6f [181372,9371] 0 2024-09-20T20:31:44.592 INFO:tasks.workunit.client.0.smithi070.stdout:6/986: getdents d4/d8/d10/d54/d55 0 2024-09-20T20:31:44.592 INFO:tasks.workunit.client.0.smithi070.stdout:4/872: read d6/d26/fc1 [128601,66219] 0 2024-09-20T20:31:44.593 INFO:tasks.workunit.client.0.smithi070.stdout:1/955: chown d4/d32/de6/d10e/d148/d9d/db7/f93 1821328 1 2024-09-20T20:31:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:9/860: mkdir d1/df/d25/d69/daf/de7/d134 0 2024-09-20T20:31:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:2/846: dread d3/d5/d9/f88 [0,4194304] 0 2024-09-20T20:31:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:5/890: mknod d2/df/d77/d106/d118/c12f 0 2024-09-20T20:31:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:0/863: sync 2024-09-20T20:31:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:6/987: sync 2024-09-20T20:31:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:2/847: fdatasync d3/d5/d10e/f112 0 2024-09-20T20:31:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:5/891: stat d2/df/d40/d129 0 2024-09-20T20:31:44.595 INFO:tasks.workunit.client.0.smithi070.stdout:0/864: creat d4/d8/d12/d10c/f113 x:0 0 0 2024-09-20T20:31:44.595 INFO:tasks.workunit.client.0.smithi070.stdout:9/861: read d1/df/d18/d44/fc6 [2697925,26771] 0 2024-09-20T20:31:44.595 INFO:tasks.workunit.client.0.smithi070.stdout:6/988: fsync d4/d8/d10/f2d 0 2024-09-20T20:31:44.596 INFO:tasks.workunit.client.0.smithi070.stdout:7/816: dread d2/d19/d25/d42/d77/f9b [0,4194304] 0 2024-09-20T20:31:44.596 INFO:tasks.workunit.client.0.smithi070.stdout:5/892: mkdir d2/d4/de/d47/d67/d92/de2/d130 0 2024-09-20T20:31:44.597 INFO:tasks.workunit.client.0.smithi070.stdout:7/817: rmdir d2/dfa/d5c 39 2024-09-20T20:31:44.597 INFO:tasks.workunit.client.0.smithi070.stdout:2/848: fdatasync d3/d5/d9/d1c/dda/d104/d3e/d61/db2/dff/f108 0 2024-09-20T20:31:44.597 INFO:tasks.workunit.client.0.smithi070.stdout:9/862: read - d1/df/d18/d44/d77/f100 zero size 2024-09-20T20:31:44.598 INFO:tasks.workunit.client.0.smithi070.stdout:4/873: dread d6/f6f [0,4194304] 0 2024-09-20T20:31:44.598 INFO:tasks.workunit.client.0.smithi070.stdout:7/818: write d2/d8/fb6 [1250171,62281] 0 2024-09-20T20:31:44.599 INFO:tasks.workunit.client.0.smithi070.stdout:5/893: chown d2/d7/d60/dbd/dcd/ff1 1 1 2024-09-20T20:31:44.600 INFO:tasks.workunit.client.0.smithi070.stdout:9/863: chown d1/df/d25/d9e/l106 1 1 2024-09-20T20:31:44.600 INFO:tasks.workunit.client.0.smithi070.stdout:4/874: dread - d6/d5e/fe8 zero size 2024-09-20T20:31:44.601 INFO:tasks.workunit.client.0.smithi070.stdout:4/875: stat d6/d5e/d51/d78/dbc 0 2024-09-20T20:31:44.601 INFO:tasks.workunit.client.0.smithi070.stdout:8/870: dwrite d4/d27/d2a/d5b/d6c/da6/fcc [0,4194304] 0 2024-09-20T20:31:44.602 INFO:tasks.workunit.client.0.smithi070.stdout:5/894: fdatasync d2/d4/d98/d5b/f5e 0 2024-09-20T20:31:44.602 INFO:tasks.workunit.client.0.smithi070.stdout:9/864: creat d1/df/d18/d44/da2/f135 x:0 0 0 2024-09-20T20:31:44.602 INFO:tasks.workunit.client.0.smithi070.stdout:7/819: read - d2/dfa/d5c/fc5 zero size 2024-09-20T20:31:44.605 INFO:tasks.workunit.client.0.smithi070.stdout:7/820: rmdir d2 39 2024-09-20T20:31:44.606 INFO:tasks.workunit.client.0.smithi070.stdout:9/865: unlink d1/df/d25/d9e/l106 0 2024-09-20T20:31:44.606 INFO:tasks.workunit.client.0.smithi070.stdout:1/956: write d4/d6/d11/d63/de7/d44/d4b/f10f [649012,54597] 0 2024-09-20T20:31:44.607 INFO:tasks.workunit.client.0.smithi070.stdout:5/895: creat d2/d4/d98/d4c/f131 x:0 0 0 2024-09-20T20:31:44.607 INFO:tasks.workunit.client.0.smithi070.stdout:5/896: sync 2024-09-20T20:31:44.607 INFO:tasks.workunit.client.0.smithi070.stdout:8/871: mknod d4/d27/d2a/d5b/d98/da9/db5/dd8/c124 0 2024-09-20T20:31:44.607 INFO:tasks.workunit.client.0.smithi070.stdout:2/849: dwrite d3/d5/dd/f63 [0,4194304] 0 2024-09-20T20:31:44.608 INFO:tasks.workunit.client.0.smithi070.stdout:5/897: symlink d2/df/d40/da8/l132 0 2024-09-20T20:31:44.609 INFO:tasks.workunit.client.0.smithi070.stdout:3/770: dread d7/d15/d1a/d4a/d51/d5b/f6a [0,4194304] 0 2024-09-20T20:31:44.609 INFO:tasks.workunit.client.0.smithi070.stdout:9/866: truncate d1/d76/f105 363686 0 2024-09-20T20:31:44.609 INFO:tasks.workunit.client.0.smithi070.stdout:7/821: chown d2/d30/c7b 29772 1 2024-09-20T20:31:44.609 INFO:tasks.workunit.client.0.smithi070.stdout:2/850: dread - d3/d5/d9/d1c/f65 zero size 2024-09-20T20:31:44.610 INFO:tasks.workunit.client.0.smithi070.stdout:1/957: write d4/d6/d11/d63/de7/d44/d4b/f13f [3183492,130514] 0 2024-09-20T20:31:44.611 INFO:tasks.workunit.client.0.smithi070.stdout:0/865: dwrite d4/d8/f30 [0,4194304] 0 2024-09-20T20:31:44.612 INFO:tasks.workunit.client.0.smithi070.stdout:5/898: creat d2/d4/f133 x:0 0 0 2024-09-20T20:31:44.612 INFO:tasks.workunit.client.0.smithi070.stdout:4/876: dwrite d6/d5e/d75/f2d [0,4194304] 0 2024-09-20T20:31:44.612 INFO:tasks.workunit.client.0.smithi070.stdout:3/771: write d7/d15/d1a/d48/d66/d69/d13/f2e [201475,18691] 0 2024-09-20T20:31:44.612 INFO:tasks.workunit.client.0.smithi070.stdout:9/867: truncate d1/df/d38/dac/fec 1746423 0 2024-09-20T20:31:44.615 INFO:tasks.workunit.client.0.smithi070.stdout:4/877: symlink d6/d43/d5a/l115 0 2024-09-20T20:31:44.615 INFO:tasks.workunit.client.0.smithi070.stdout:3/772: mkdir d7/d15/d1e/d60/df1 0 2024-09-20T20:31:44.615 INFO:tasks.workunit.client.0.smithi070.stdout:5/899: symlink d2/d4/de/d47/d67/d92/de2/l134 0 2024-09-20T20:31:44.615 INFO:tasks.workunit.client.0.smithi070.stdout:4/878: sync 2024-09-20T20:31:44.615 INFO:tasks.workunit.client.0.smithi070.stdout:8/872: rename d4/db/d64/d95/ce5 to d4/d27/d2a/d5b/d6c/c125 0 2024-09-20T20:31:44.615 INFO:tasks.workunit.client.0.smithi070.stdout:7/822: mkdir d2/d30/d63/d69/df3/d10e 0 2024-09-20T20:31:44.616 INFO:tasks.workunit.client.0.smithi070.stdout:1/958: symlink d4/d6/d11/d63/de7/d44/d4b/d87/da9/l150 0 2024-09-20T20:31:44.617 INFO:tasks.workunit.client.0.smithi070.stdout:7/823: fsync d2/d65/feb 0 2024-09-20T20:31:44.617 INFO:tasks.workunit.client.0.smithi070.stdout:3/773: creat d7/ff2 x:0 0 0 2024-09-20T20:31:44.618 INFO:tasks.workunit.client.0.smithi070.stdout:9/868: dread d1/df/d18/d44/da2/dcc/fe0 [0,4194304] 0 2024-09-20T20:31:44.618 INFO:tasks.workunit.client.0.smithi070.stdout:1/959: write d4/d32/d60/dca/ff7 [964433,30290] 0 2024-09-20T20:31:44.620 INFO:tasks.workunit.client.0.smithi070.stdout:3/774: write d7/d15/fc2 [34368,85942] 0 2024-09-20T20:31:44.620 INFO:tasks.workunit.client.0.smithi070.stdout:8/873: creat d4/d27/d2a/d5b/d6c/da6/f126 x:0 0 0 2024-09-20T20:31:44.620 INFO:tasks.workunit.client.0.smithi070.stdout:6/989: dread d4/d8/f90 [0,4194304] 0 2024-09-20T20:31:44.622 INFO:tasks.workunit.client.0.smithi070.stdout:7/824: rename d2/d19/d25/d84/l99 to d2/dfa/dd4/l10f 0 2024-09-20T20:31:44.622 INFO:tasks.workunit.client.0.smithi070.stdout:9/869: mknod d1/df/d25/d69/d80/c136 0 2024-09-20T20:31:44.623 INFO:tasks.workunit.client.0.smithi070.stdout:2/851: dwrite d3/de/d12/d1a/fc6 [0,4194304] 0 2024-09-20T20:31:44.623 INFO:tasks.workunit.client.0.smithi070.stdout:8/874: write d4/d27/d2a/d7e/fd5 [399834,122707] 0 2024-09-20T20:31:44.624 INFO:tasks.workunit.client.0.smithi070.stdout:0/866: dwrite d4/d8/d55/dd8/d1d/d37/d38/f63 [0,4194304] 0 2024-09-20T20:31:44.625 INFO:tasks.workunit.client.0.smithi070.stdout:2/852: truncate d3/de/d12/f8d 5016798 0 2024-09-20T20:31:44.625 INFO:tasks.workunit.client.0.smithi070.stdout:5/900: dwrite d2/df/d40/da8/fe9 [0,4194304] 0 2024-09-20T20:31:44.627 INFO:tasks.workunit.client.0.smithi070.stdout:3/775: unlink d7/d15/d1a/d4a/d7d/f8f 0 2024-09-20T20:31:44.628 INFO:tasks.workunit.client.0.smithi070.stdout:6/990: rename d4/d8/d17/db2/deb/c117 to d4/df0/d11a/c15e 0 2024-09-20T20:31:44.628 INFO:tasks.workunit.client.0.smithi070.stdout:5/901: fdatasync d2/d7/d60/dbd/ffc 0 2024-09-20T20:31:44.628 INFO:tasks.workunit.client.0.smithi070.stdout:2/853: truncate d3/d5/dd/d99/dae/fe5 4695951 0 2024-09-20T20:31:44.628 INFO:tasks.workunit.client.0.smithi070.stdout:1/960: getdents d4/d32/d60/dca/dd2 0 2024-09-20T20:31:44.628 INFO:tasks.workunit.client.0.smithi070.stdout:7/825: link d2/d65/fc3 d2/d30/d63/f110 0 2024-09-20T20:31:44.629 INFO:tasks.workunit.client.0.smithi070.stdout:7/826: readlink d2/d30/l8e 0 2024-09-20T20:31:44.629 INFO:tasks.workunit.client.0.smithi070.stdout:5/902: creat d2/db7/d11a/f135 x:0 0 0 2024-09-20T20:31:44.630 INFO:tasks.workunit.client.0.smithi070.stdout:7/827: readlink d2/ldf 0 2024-09-20T20:31:44.630 INFO:tasks.workunit.client.0.smithi070.stdout:3/776: write d7/d15/d1a/d48/d66/d69/f19 [3007647,85897] 0 2024-09-20T20:31:44.631 INFO:tasks.workunit.client.0.smithi070.stdout:1/961: rename d4/d6/ddb to d4/d32/d14b/d151 0 2024-09-20T20:31:44.631 INFO:tasks.workunit.client.0.smithi070.stdout:6/991: symlink d4/d8/d17/d33/d61/d73/l15f 0 2024-09-20T20:31:44.632 INFO:tasks.workunit.client.0.smithi070.stdout:3/777: mknod d7/d15/d1a/d48/d57/d75/cf3 0 2024-09-20T20:31:44.633 INFO:tasks.workunit.client.0.smithi070.stdout:6/992: rmdir d4/d8/d10/d130 39 2024-09-20T20:31:44.633 INFO:tasks.workunit.client.0.smithi070.stdout:7/828: getdents d2/d19/d25/d42/d77 0 2024-09-20T20:31:44.634 INFO:tasks.workunit.client.0.smithi070.stdout:0/867: dwrite d4/d8/d12/d10c/fe5 [0,4194304] 0 2024-09-20T20:31:44.634 INFO:tasks.workunit.client.0.smithi070.stdout:1/962: mknod d4/d32/de6/d10e/d148/d78/d125/c152 0 2024-09-20T20:31:44.634 INFO:tasks.workunit.client.0.smithi070.stdout:3/778: unlink d7/d15/c16 0 2024-09-20T20:31:44.635 INFO:tasks.workunit.client.0.smithi070.stdout:5/903: dread d2/d7/fd3 [0,4194304] 0 2024-09-20T20:31:44.635 INFO:tasks.workunit.client.0.smithi070.stdout:6/993: mkdir d4/d8/d10/d54/db1/d160 0 2024-09-20T20:31:44.635 INFO:tasks.workunit.client.0.smithi070.stdout:7/829: write d2/d19/d25/f86 [2465395,102338] 0 2024-09-20T20:31:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:0/868: fdatasync d4/d8/d12/f5e 0 2024-09-20T20:31:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:6/994: chown d4/d8/f90 47 1 2024-09-20T20:31:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:1/963: write d4/d6/d26/f5b [7426789,49873] 0 2024-09-20T20:31:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:6/995: chown d4/d8/d10/d54/dec 2 1 2024-09-20T20:31:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:1/964: fsync f2 0 2024-09-20T20:31:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:2/854: dwrite d3/de/d12/d1a/fc6 [0,4194304] 0 2024-09-20T20:31:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:1/965: chown d4/f71 36648 1 2024-09-20T20:31:44.639 INFO:tasks.workunit.client.0.smithi070.stdout:3/779: link d7/d15/d1e/d65/d9d/fb2 d7/d15/d1e/d60/dd4/ff4 0 2024-09-20T20:31:44.639 INFO:tasks.workunit.client.0.smithi070.stdout:2/855: creat d3/d5/d9/d1c/d47/f126 x:0 0 0 2024-09-20T20:31:44.639 INFO:tasks.workunit.client.0.smithi070.stdout:1/966: creat d4/d32/f153 x:0 0 0 2024-09-20T20:31:44.640 INFO:tasks.workunit.client.0.smithi070.stdout:2/856: rmdir d3/d5/d9/dc1 39 2024-09-20T20:31:44.640 INFO:tasks.workunit.client.0.smithi070.stdout:1/967: creat d4/d6/d11/d63/de7/d44/f154 x:0 0 0 2024-09-20T20:31:44.641 INFO:tasks.workunit.client.0.smithi070.stdout:2/857: rename d3/de/d12/f82 to d3/d4c/f127 0 2024-09-20T20:31:44.641 INFO:tasks.workunit.client.0.smithi070.stdout:3/780: getdents d7/d15/d1a/d48/d66/d69/d13/d1d 0 2024-09-20T20:31:44.642 INFO:tasks.workunit.client.0.smithi070.stdout:3/781: read - d7/d15/d1e/d65/f5c zero size 2024-09-20T20:31:44.642 INFO:tasks.workunit.client.0.smithi070.stdout:2/858: mkdir d3/d5/d9/d1c/dda/d104/d3e/d61/d128 0 2024-09-20T20:31:44.643 INFO:tasks.workunit.client.0.smithi070.stdout:2/859: mkdir d3/d4c/d5c/d129 0 2024-09-20T20:31:44.644 INFO:tasks.workunit.client.0.smithi070.stdout:2/860: creat d3/f12a x:0 0 0 2024-09-20T20:31:44.646 INFO:tasks.workunit.client.0.smithi070.stdout:0/869: dread d4/d8/dff/f104 [0,4194304] 0 2024-09-20T20:31:44.646 INFO:tasks.workunit.client.0.smithi070.stdout:9/870: dread d1/df/f6c [0,4194304] 0 2024-09-20T20:31:44.647 INFO:tasks.workunit.client.0.smithi070.stdout:0/870: creat d4/f114 x:0 0 0 2024-09-20T20:31:44.647 INFO:tasks.workunit.client.0.smithi070.stdout:0/871: unlink d4/d8/dff/le9 0 2024-09-20T20:31:44.650 INFO:tasks.workunit.client.0.smithi070.stdout:1/968: truncate d4/d6/fc5 35584 0 2024-09-20T20:31:44.650 INFO:tasks.workunit.client.0.smithi070.stdout:3/782: truncate d7/d15/d1a/d48/d66/d69/f39 4000384 0 2024-09-20T20:31:44.651 INFO:tasks.workunit.client.0.smithi070.stdout:1/969: mknod d4/d6/d11/d7b/d83/c155 0 2024-09-20T20:31:44.652 INFO:tasks.workunit.client.0.smithi070.stdout:2/861: rmdir d3/d5/dd/d99/dae 39 2024-09-20T20:31:44.653 INFO:tasks.workunit.client.0.smithi070.stdout:2/862: rmdir d3/de 39 2024-09-20T20:31:44.653 INFO:tasks.workunit.client.0.smithi070.stdout:9/871: dwrite d1/df/d18/d44/da2/f114 [0,4194304] 0 2024-09-20T20:31:44.655 INFO:tasks.workunit.client.0.smithi070.stdout:3/783: write d7/d15/d1e/da9/fbd [3822047,43346] 0 2024-09-20T20:31:44.656 INFO:tasks.workunit.client.0.smithi070.stdout:9/872: dread - d1/f11b zero size 2024-09-20T20:31:44.657 INFO:tasks.workunit.client.0.smithi070.stdout:3/784: write d7/d15/d1a/d48/d57/d75/f7f [3833712,106209] 0 2024-09-20T20:31:44.657 INFO:tasks.workunit.client.0.smithi070.stdout:9/873: chown d1/df/d25/d69/d85/d9f/l126 334 1 2024-09-20T20:31:44.659 INFO:tasks.workunit.client.0.smithi070.stdout:8/875: sync 2024-09-20T20:31:44.660 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:44.660 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:44.660 INFO:tasks.workunit.client.0.smithi070.stdout:9/874: mknod d1/df/d18/d44/d77/c137 0 2024-09-20T20:31:44.660 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:44.655+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:44.661 INFO:tasks.workunit.client.0.smithi070.stdout:1/970: dwrite d4/d6/d11/d63/de7/d44/d4b/d87/fd4 [0,4194304] 0 2024-09-20T20:31:44.662 INFO:tasks.workunit.client.0.smithi070.stdout:4/879: dread d6/d26/f9c [0,4194304] 0 2024-09-20T20:31:44.663 INFO:tasks.workunit.client.0.smithi070.stdout:2/863: dwrite d3/de/d12/d4f/f122 [0,4194304] 0 2024-09-20T20:31:44.665 INFO:tasks.workunit.client.0.smithi070.stdout:8/876: rename d4/d27/d2a/d43/d61/cd9 to d4/d27/d2a/d7e/c127 0 2024-09-20T20:31:44.665 INFO:tasks.workunit.client.0.smithi070.stdout:9/875: getdents d1/df/d25/db2/ddb 0 2024-09-20T20:31:44.667 INFO:tasks.workunit.client.0.smithi070.stdout:2/864: chown d3/d5/dd/d99/dae/fe5 204181465 1 2024-09-20T20:31:44.668 INFO:tasks.workunit.client.0.smithi070.stdout:9/876: creat d1/d76/f138 x:0 0 0 2024-09-20T20:31:44.668 INFO:tasks.workunit.client.0.smithi070.stdout:1/971: dwrite d4/d32/dea/d3b/f106 [0,4194304] 0 2024-09-20T20:31:44.670 INFO:tasks.workunit.client.0.smithi070.stdout:9/877: creat d1/df/d18/d46/d127/f139 x:0 0 0 2024-09-20T20:31:44.670 INFO:tasks.workunit.client.0.smithi070.stdout:2/865: creat d3/d4c/d5c/d86/f12b x:0 0 0 2024-09-20T20:31:44.671 INFO:tasks.workunit.client.0.smithi070.stdout:0/872: dread d4/d48/d7b/fbc [0,4194304] 0 2024-09-20T20:31:44.672 INFO:tasks.workunit.client.0.smithi070.stdout:5/904: dread d2/d4/d98/d4c/f117 [0,4194304] 0 2024-09-20T20:31:44.672 INFO:tasks.workunit.client.0.smithi070.stdout:9/878: fsync d1/df/d84/f91 0 2024-09-20T20:31:44.672 INFO:tasks.workunit.client.0.smithi070.stdout:5/905: symlink d2/df/d40/da8/l136 0 2024-09-20T20:31:44.672 INFO:tasks.workunit.client.0.smithi070.stdout:9/879: mknod d1/df/d18/d46/d127/c13a 0 2024-09-20T20:31:44.672 INFO:tasks.workunit.client.0.smithi070.stdout:0/873: symlink d4/d8/d55/dd8/d2d/l115 0 2024-09-20T20:31:44.673 INFO:tasks.workunit.client.0.smithi070.stdout:9/880: write d1/df/d25/d69/d80/f10d [99138,125468] 0 2024-09-20T20:31:44.673 INFO:tasks.workunit.client.0.smithi070.stdout:0/874: rename d4/d48/d4e/lb4 to d4/d8/d12/d23/l116 0 2024-09-20T20:31:44.674 INFO:tasks.workunit.client.0.smithi070.stdout:9/881: write d1/df/d25/d69/d85/d9f/db9/de3/d111/f122 [626942,60875] 0 2024-09-20T20:31:44.674 INFO:tasks.workunit.client.0.smithi070.stdout:4/880: write d6/d7/dc/fe [37378,73657] 0 2024-09-20T20:31:44.674 INFO:tasks.workunit.client.0.smithi070.stdout:9/882: fsync d1/df/f6c 0 2024-09-20T20:31:44.675 INFO:tasks.workunit.client.0.smithi070.stdout:4/881: unlink d6/d7/l41 0 2024-09-20T20:31:44.675 INFO:tasks.workunit.client.0.smithi070.stdout:7/830: sync 2024-09-20T20:31:44.675 INFO:tasks.workunit.client.0.smithi070.stdout:6/996: sync 2024-09-20T20:31:44.675 INFO:tasks.workunit.client.0.smithi070.stdout:9/883: rename d1/df/d25/db2 to d1/d76/d13b 0 2024-09-20T20:31:44.676 INFO:tasks.workunit.client.0.smithi070.stdout:4/882: link d6/d26/d69/d71/f6d d6/d26/dd7/df1/f116 0 2024-09-20T20:31:44.676 INFO:tasks.workunit.client.0.smithi070.stdout:6/997: write d4/d8/d10/d54/d55/f140 [337265,69701] 0 2024-09-20T20:31:44.677 INFO:tasks.workunit.client.0.smithi070.stdout:9/884: getdents d1/df/d18/d44/da2/db6/dd9 0 2024-09-20T20:31:44.678 INFO:tasks.workunit.client.0.smithi070.stdout:4/883: chown d6/d26/d69/d71/f7e 325585754 1 2024-09-20T20:31:44.678 INFO:tasks.workunit.client.0.smithi070.stdout:6/998: link d4/d8/d17/d33/d61/d73/d10a/c132 d4/d8/db4/db6/c161 0 2024-09-20T20:31:44.680 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:44.680 INFO:tasks.workunit.client.0.smithi070.stdout:4/884: rename d6/d5e/d51/d84/cde to d6/d5e/d51/d63/c117 0 2024-09-20T20:31:44.680 INFO:tasks.workunit.client.0.smithi070.stdout:6/999: read d4/d8/d10/f15 [1376811,52416] 0 2024-09-20T20:31:44.681 INFO:tasks.workunit.client.0.smithi070.stdout:1/972: chown d4/d6/fc5 15442923 1 2024-09-20T20:31:44.681 INFO:tasks.workunit.client.0.smithi070.stdout:4/885: creat d6/d43/f118 x:0 0 0 2024-09-20T20:31:44.682 INFO:tasks.workunit.client.0.smithi070.stdout:1/973: readlink d4/l1b 0 2024-09-20T20:31:44.682 INFO:tasks.workunit.client.0.smithi070.stdout:0/875: mknod d4/d8/d12/d23/db2/c117 0 2024-09-20T20:31:44.683 INFO:tasks.workunit.client.0.smithi070.stdout:3/785: dread d7/d15/d1a/d48/d57/f6d [4194304,4194304] 0 2024-09-20T20:31:44.683 INFO:tasks.workunit.client.0.smithi070.stdout:4/886: mkdir d6/d26/deb/d119 0 2024-09-20T20:31:44.685 INFO:tasks.workunit.client.0.smithi070.stdout:3/786: creat d7/d15/d1a/ff5 x:0 0 0 2024-09-20T20:31:44.686 INFO:tasks.workunit.client.0.smithi070.stdout:2/866: dwrite d3/d5/d9/feb [0,4194304] 0 2024-09-20T20:31:44.686 INFO:tasks.workunit.client.0.smithi070.stdout:9/885: dwrite d1/f1a [0,4194304] 0 2024-09-20T20:31:44.689 INFO:tasks.workunit.client.0.smithi070.stdout:4/887: mkdir d6/d7/dc/d4a/d11a 0 2024-09-20T20:31:44.693 INFO:tasks.workunit.client.0.smithi070.stdout:4/888: mkdir d6/d26/df6/d11b 0 2024-09-20T20:31:44.694 INFO:tasks.workunit.client.0.smithi070.stdout:3/787: write d7/d15/d1a/d48/d66/d69/d13/f2e [809720,75451] 0 2024-09-20T20:31:44.694 INFO:tasks.workunit.client.0.smithi070.stdout:0/876: dwrite d4/d8/dff/f93 [0,4194304] 0 2024-09-20T20:31:44.694 INFO:tasks.workunit.client.0.smithi070.stdout:2/867: creat d3/d5/dd/d99/f12c x:0 0 0 2024-09-20T20:31:44.695 INFO:tasks.workunit.client.0.smithi070.stdout:1/974: dwrite d4/d6/d11/f42 [0,4194304] 0 2024-09-20T20:31:44.696 INFO:tasks.workunit.client.0.smithi070.stdout:7/831: dread d2/d19/dbe/dd0/dd3/fda [0,4194304] 0 2024-09-20T20:31:44.696 INFO:tasks.workunit.client.0.smithi070.stdout:9/886: dread d1/df/d38/dac/fec [0,4194304] 0 2024-09-20T20:31:44.697 INFO:tasks.workunit.client.0.smithi070.stdout:1/975: chown d4/d32/de6/d10e/d148/fec 259 1 2024-09-20T20:31:44.697 INFO:tasks.workunit.client.0.smithi070.stdout:0/877: truncate d4/d8/d55/dd8/d1d/d7e/f8d 741885 0 2024-09-20T20:31:44.697 INFO:tasks.workunit.client.0.smithi070.stdout:8/877: dread d4/db/fc9 [0,4194304] 0 2024-09-20T20:31:44.699 INFO:tasks.workunit.client.0.smithi070.stdout:2/868: symlink d3/d5/d9/dc1/l12d 0 2024-09-20T20:31:44.699 INFO:tasks.workunit.client.0.smithi070.stdout:9/887: getdents d1/df/d25/d69/daf/de7/d134 0 2024-09-20T20:31:44.699 INFO:tasks.workunit.client.0.smithi070.stdout:8/878: symlink d4/d27/d73/l128 0 2024-09-20T20:31:44.699 INFO:tasks.workunit.client.0.smithi070.stdout:7/832: fsync d2/d65/fa0 0 2024-09-20T20:31:44.699 INFO:tasks.workunit.client.0.smithi070.stdout:0/878: getdents d4/d48/d7b 0 2024-09-20T20:31:44.700 INFO:tasks.workunit.client.0.smithi070.stdout:2/869: dread - d3/d5/d9/d1c/dda/d104/d3e/f102 zero size 2024-09-20T20:31:44.700 INFO:tasks.workunit.client.0.smithi070.stdout:9/888: fsync d1/df/d18/d46/f7f 0 2024-09-20T20:31:44.702 INFO:tasks.workunit.client.0.smithi070.stdout:4/889: dwrite d6/d7/f3e [0,4194304] 0 2024-09-20T20:31:44.702 INFO:tasks.workunit.client.0.smithi070.stdout:2/870: fsync d3/d5/d9/d1c/dda/d104/d3e/f101 0 2024-09-20T20:31:44.703 INFO:tasks.workunit.client.0.smithi070.stdout:2/871: dread - d3/d5/dd/fd6 zero size 2024-09-20T20:31:44.705 INFO:tasks.workunit.client.0.smithi070.stdout:8/879: read d4/db/d64/d95/f9b [168350,12793] 0 2024-09-20T20:31:44.705 INFO:tasks.workunit.client.0.smithi070.stdout:3/788: dwrite d7/f9 [4194304,4194304] 0 2024-09-20T20:31:44.706 INFO:tasks.workunit.client.0.smithi070.stdout:8/880: creat d4/db/f129 x:0 0 0 2024-09-20T20:31:44.707 INFO:tasks.workunit.client.0.smithi070.stdout:9/889: rename d1/df/d25/d69/d85/c130 to d1/df/d25/dc4/df5/c13c 0 2024-09-20T20:31:44.707 INFO:tasks.workunit.client.0.smithi070.stdout:7/833: dwrite d2/d65/fa3 [0,4194304] 0 2024-09-20T20:31:44.707 INFO:tasks.workunit.client.0.smithi070.stdout:2/872: rename d3/d5/dd/d99/ff8 to d3/d5/dd/d99/f12e 0 2024-09-20T20:31:44.709 INFO:tasks.workunit.client.0.smithi070.stdout:3/789: rename d7/d15/d1e/d65/f27 to d7/d15/d1e/d65/ff6 0 2024-09-20T20:31:44.710 INFO:tasks.workunit.client.0.smithi070.stdout:7/834: rmdir d2/d8 39 2024-09-20T20:31:44.711 INFO:tasks.workunit.client.0.smithi070.stdout:2/873: creat d3/d5/dd/f12f x:0 0 0 2024-09-20T20:31:44.711 INFO:tasks.workunit.client.0.smithi070.stdout:5/906: sync 2024-09-20T20:31:44.711 INFO:tasks.workunit.client.0.smithi070.stdout:7/835: write d2/d19/d25/ff5 [382202,45358] 0 2024-09-20T20:31:44.711 INFO:tasks.workunit.client.0.smithi070.stdout:4/890: dwrite d6/d5e/fb0 [0,4194304] 0 2024-09-20T20:31:44.713 INFO:tasks.workunit.client.0.smithi070.stdout:4/891: fsync d6/d26/d69/d71/f5b 0 2024-09-20T20:31:44.714 INFO:tasks.workunit.client.0.smithi070.stdout:2/874: symlink d3/d5/d9/d1c/d4e/da4/l130 0 2024-09-20T20:31:44.718 INFO:tasks.workunit.client.0.smithi070.stdout:4/892: getdents d6/d26/d69/d71/d4c/d10b 0 2024-09-20T20:31:44.718 INFO:tasks.workunit.client.0.smithi070.stdout:9/890: dwrite d1/df/f22 [0,4194304] 0 2024-09-20T20:31:44.718 INFO:tasks.workunit.client.0.smithi070.stdout:2/875: mkdir d3/de/d12/d131 0 2024-09-20T20:31:44.719 INFO:tasks.workunit.client.0.smithi070.stdout:8/881: dwrite d4/d27/d2a/d5b/d6c/da6/fb9 [0,4194304] 0 2024-09-20T20:31:44.719 INFO:tasks.workunit.client.0.smithi070.stdout:9/891: stat d1/l45 0 2024-09-20T20:31:44.720 INFO:tasks.workunit.client.0.smithi070.stdout:8/882: stat d4/db/f129 0 2024-09-20T20:31:44.720 INFO:tasks.workunit.client.0.smithi070.stdout:7/836: dwrite d2/d19/d25/d42/f9d [0,4194304] 0 2024-09-20T20:31:44.720 INFO:tasks.workunit.client.0.smithi070.stdout:2/876: chown d3/d5/d9/d1c/dda/d104/c125 99307 1 2024-09-20T20:31:44.721 INFO:tasks.workunit.client.0.smithi070.stdout:0/879: dwrite d4/d8/dff/d112/f76 [0,4194304] 0 2024-09-20T20:31:44.721 INFO:tasks.workunit.client.0.smithi070.stdout:8/883: fsync d4/db/f32 0 2024-09-20T20:31:44.728 INFO:tasks.workunit.client.0.smithi070.stdout:9/892: creat d1/df/d18/d44/da2/db6/dd9/f13d x:0 0 0 2024-09-20T20:31:44.728 INFO:tasks.workunit.client.0.smithi070.stdout:7/837: creat d2/d30/d63/d69/f111 x:0 0 0 2024-09-20T20:31:44.728 INFO:tasks.workunit.client.0.smithi070.stdout:8/884: creat d4/d27/d2a/d7e/f12a x:0 0 0 2024-09-20T20:31:44.728 INFO:tasks.workunit.client.0.smithi070.stdout:7/838: write d2/d19/dbe/dd0/fe1 [667690,94156] 0 2024-09-20T20:31:44.729 INFO:tasks.workunit.client.0.smithi070.stdout:8/885: chown d4/d27/d2a/d5b/d98/da9/db5/d11e 316452 1 2024-09-20T20:31:44.729 INFO:tasks.workunit.client.0.smithi070.stdout:5/907: write d2/d4/d98/d5b/f37 [3118837,62816] 0 2024-09-20T20:31:44.732 INFO:tasks.workunit.client.0.smithi070.stdout:7/839: write d2/dfa/d4a/fb9 [714183,80382] 0 2024-09-20T20:31:44.732 INFO:tasks.workunit.client.0.smithi070.stdout:7/840: mknod d2/d19/d25/d84/c112 0 2024-09-20T20:31:44.732 INFO:tasks.workunit.client.0.smithi070.stdout:5/908: creat d2/d4/d98/dc7/da5/dec/f137 x:0 0 0 2024-09-20T20:31:44.732 INFO:tasks.workunit.client.0.smithi070.stdout:9/893: dread d1/df/f6c [0,4194304] 0 2024-09-20T20:31:44.732 INFO:tasks.workunit.client.0.smithi070.stdout:7/841: write d2/d30/d78/f109 [183996,90591] 0 2024-09-20T20:31:44.733 INFO:tasks.workunit.client.0.smithi070.stdout:7/842: fdatasync d2/f35 0 2024-09-20T20:31:44.733 INFO:tasks.workunit.client.0.smithi070.stdout:5/909: dread - d2/d7/d60/dbd/fe8 zero size 2024-09-20T20:31:44.733 INFO:tasks.workunit.client.0.smithi070.stdout:7/843: rmdir d2/d30/d78 39 2024-09-20T20:31:44.733 INFO:tasks.workunit.client.0.smithi070.stdout:2/877: dwrite d3/d5/d9/d10/fce [0,4194304] 0 2024-09-20T20:31:44.733 INFO:tasks.workunit.client.0.smithi070.stdout:9/894: mknod d1/df/d18/d44/d77/db8/c13e 0 2024-09-20T20:31:44.733 INFO:tasks.workunit.client.0.smithi070.stdout:2/878: fdatasync d3/d5/d10e/f112 0 2024-09-20T20:31:44.734 INFO:tasks.workunit.client.0.smithi070.stdout:3/790: truncate d7/d15/d1a/d4a/d51/d5b/f6a 941518 0 2024-09-20T20:31:44.734 INFO:tasks.workunit.client.0.smithi070.stdout:7/844: write d2/d30/d63/d69/fb7 [250294,76605] 0 2024-09-20T20:31:44.734 INFO:tasks.workunit.client.0.smithi070.stdout:9/895: creat d1/df/d18/d44/da2/db6/f13f x:0 0 0 2024-09-20T20:31:44.734 INFO:tasks.workunit.client.0.smithi070.stdout:2/879: unlink d3/d5/d9/dc1/ff4 0 2024-09-20T20:31:44.735 INFO:tasks.workunit.client.0.smithi070.stdout:3/791: symlink d7/d15/d1a/d80/d8e/lf7 0 2024-09-20T20:31:44.735 INFO:tasks.workunit.client.0.smithi070.stdout:7/845: fdatasync d2/d52/f5e 0 2024-09-20T20:31:44.736 INFO:tasks.workunit.client.0.smithi070.stdout:3/792: chown d7/d15/d1e/d65/db6 122 1 2024-09-20T20:31:44.736 INFO:tasks.workunit.client.0.smithi070.stdout:2/880: truncate d3/d5/dd/ff 3072950 0 2024-09-20T20:31:44.736 INFO:tasks.workunit.client.0.smithi070.stdout:9/896: link d1/l45 d1/df/d18/d44/d77/l140 0 2024-09-20T20:31:44.736 INFO:tasks.workunit.client.0.smithi070.stdout:0/880: dread d4/d48/d7b/fdb [0,4194304] 0 2024-09-20T20:31:44.737 INFO:tasks.workunit.client.0.smithi070.stdout:2/881: write d3/d5/dd/f15 [5015046,41661] 0 2024-09-20T20:31:44.737 INFO:tasks.workunit.client.0.smithi070.stdout:3/793: mknod d7/d15/d1a/d48/d66/cf8 0 2024-09-20T20:31:44.738 INFO:tasks.workunit.client.0.smithi070.stdout:9/897: link d1/df/d38/fc1 d1/df/d18/d44/d77/dd0/d116/f141 0 2024-09-20T20:31:44.738 INFO:tasks.workunit.client.0.smithi070.stdout:3/794: symlink d7/d15/d1a/d48/d66/de7/lf9 0 2024-09-20T20:31:44.739 INFO:tasks.workunit.client.0.smithi070.stdout:5/910: dwrite d2/d4/d98/d5b/d90/da0/f109 [4194304,4194304] 0 2024-09-20T20:31:44.739 INFO:tasks.workunit.client.0.smithi070.stdout:9/898: write d1/df/f70 [1314221,22970] 0 2024-09-20T20:31:44.741 INFO:tasks.workunit.client.0.smithi070.stdout:9/899: chown d1/df/d18/d44/d77/dd0/ldc 2923 1 2024-09-20T20:31:44.742 INFO:tasks.workunit.client.0.smithi070.stdout:3/795: unlink d7/d15/d1e/d65/d9d/lc4 0 2024-09-20T20:31:44.742 INFO:tasks.workunit.client.0.smithi070.stdout:5/911: symlink d2/db7/d11a/l138 0 2024-09-20T20:31:44.742 INFO:tasks.workunit.client.0.smithi070.stdout:1/976: sync 2024-09-20T20:31:44.742 INFO:tasks.workunit.client.0.smithi070.stdout:9/900: chown d1/df/d18/d46/ffb 3 1 2024-09-20T20:31:44.743 INFO:tasks.workunit.client.0.smithi070.stdout:3/796: write d7/d15/d1e/f49 [1258474,108828] 0 2024-09-20T20:31:44.744 INFO:tasks.workunit.client.0.smithi070.stdout:4/893: dwrite d6/d5e/d51/d63/ff5 [0,4194304] 0 2024-09-20T20:31:44.744 INFO:tasks.workunit.client.0.smithi070.stdout:3/797: write d7/d15/d1a/d4a/d51/d5b/fa0 [3443254,108870] 0 2024-09-20T20:31:44.744 INFO:tasks.workunit.client.0.smithi070.stdout:4/894: dread - d6/d5e/d75/fee zero size 2024-09-20T20:31:44.746 INFO:tasks.workunit.client.0.smithi070.stdout:4/895: rename d6/d26/d69/f7d to d6/d26/d69/d71/f11c 0 2024-09-20T20:31:44.746 INFO:tasks.workunit.client.0.smithi070.stdout:5/912: dread d2/d4/d53/f95 [0,4194304] 0 2024-09-20T20:31:44.748 INFO:tasks.workunit.client.0.smithi070.stdout:5/913: rename d2/l36 to d2/d4/d53/d59/d113/l139 0 2024-09-20T20:31:44.749 INFO:tasks.workunit.client.0.smithi070.stdout:5/914: symlink d2/df/d40/da8/l13a 0 2024-09-20T20:31:44.750 INFO:tasks.workunit.client.0.smithi070.stdout:5/915: fdatasync d2/d7/d60/dbd/fe4 0 2024-09-20T20:31:44.752 INFO:tasks.workunit.client.0.smithi070.stdout:3/798: dwrite d7/d15/d1a/d4a/d51/d5b/fa0 [0,4194304] 0 2024-09-20T20:31:44.753 INFO:tasks.workunit.client.0.smithi070.stdout:4/896: dwrite d6/d5e/d75/f2d [0,4194304] 0 2024-09-20T20:31:44.754 INFO:tasks.workunit.client.0.smithi070.stdout:5/916: read d2/d4/de/d47/d67/f8e [101286,119752] 0 2024-09-20T20:31:44.755 INFO:tasks.workunit.client.0.smithi070.stdout:5/917: mknod d2/df/d77/d106/d118/c13b 0 2024-09-20T20:31:44.756 INFO:tasks.workunit.client.0.smithi070.stdout:3/799: creat d7/d15/d1a/d48/d66/d69/ffa x:0 0 0 2024-09-20T20:31:44.756 INFO:tasks.workunit.client.0.smithi070.stdout:4/897: link d6/d26/d97/c9f d6/d43/d5a/ddd/c11d 0 2024-09-20T20:31:44.757 INFO:tasks.workunit.client.0.smithi070.stdout:3/800: fsync d7/d15/d1a/d48/d57/f85 0 2024-09-20T20:31:44.758 INFO:tasks.workunit.client.0.smithi070.stdout:4/898: write d6/d43/f118 [583162,51378] 0 2024-09-20T20:31:44.758 INFO:tasks.workunit.client.0.smithi070.stdout:4/899: creat d6/d7/dc/f11e x:0 0 0 2024-09-20T20:31:44.759 INFO:tasks.workunit.client.0.smithi070.stdout:4/900: mknod d6/d5e/c11f 0 2024-09-20T20:31:44.759 INFO:tasks.workunit.client.0.smithi070.stdout:4/901: dread - d6/d5e/d51/dc8/fef zero size 2024-09-20T20:31:44.760 INFO:tasks.workunit.client.0.smithi070.stdout:4/902: mknod d6/d43/d5a/c120 0 2024-09-20T20:31:44.761 INFO:tasks.workunit.client.0.smithi070.stdout:1/977: dread d4/d6/f29 [0,4194304] 0 2024-09-20T20:31:44.761 INFO:tasks.workunit.client.0.smithi070.stdout:5/918: read d2/d7/d60/f93 [909343,280] 0 2024-09-20T20:31:44.761 INFO:tasks.workunit.client.0.smithi070.stdout:0/881: dread d4/d8/d55/dd8/d1d/d41/fd0 [0,4194304] 0 2024-09-20T20:31:44.761 INFO:tasks.workunit.client.0.smithi070.stdout:4/903: mknod d6/d7/dc/d4a/d81/de4/c121 0 2024-09-20T20:31:44.762 INFO:tasks.workunit.client.0.smithi070.stdout:0/882: fsync d4/d8/d12/f50 0 2024-09-20T20:31:44.762 INFO:tasks.workunit.client.0.smithi070.stdout:4/904: stat d6/d7/dc/l72 0 2024-09-20T20:31:44.763 INFO:tasks.workunit.client.0.smithi070.stdout:5/919: symlink d2/d4/de/d47/d67/d92/de2/l13c 0 2024-09-20T20:31:44.763 INFO:tasks.workunit.client.0.smithi070.stdout:1/978: readlink d4/d6/d11/d63/de7/d44/d120/l129 0 2024-09-20T20:31:44.763 INFO:tasks.workunit.client.0.smithi070.stdout:4/905: chown d6/d43/f5c 179863109 1 2024-09-20T20:31:44.763 INFO:tasks.workunit.client.0.smithi070.stdout:0/883: creat d4/d8/d12/f118 x:0 0 0 2024-09-20T20:31:44.764 INFO:tasks.workunit.client.0.smithi070.stdout:4/906: dread - d6/d26/d69/d71/fba zero size 2024-09-20T20:31:44.764 INFO:tasks.workunit.client.0.smithi070.stdout:1/979: mkdir d4/d6/d156 0 2024-09-20T20:31:44.764 INFO:tasks.workunit.client.0.smithi070.stdout:0/884: creat d4/d48/d10f/f119 x:0 0 0 2024-09-20T20:31:44.764 INFO:tasks.workunit.client.0.smithi070.stdout:4/907: symlink d6/d5e/d51/d78/dbc/l122 0 2024-09-20T20:31:44.765 INFO:tasks.workunit.client.0.smithi070.stdout:1/980: getdents d4/d6/d11/d63/de7/d44/d4b/d87/da9/db4 0 2024-09-20T20:31:44.767 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:44.763+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:44.768 INFO:tasks.workunit.client.0.smithi070.stdout:5/920: dread d2/d4/d53/d59/fdf [0,4194304] 0 2024-09-20T20:31:44.769 INFO:tasks.workunit.client.0.smithi070.stdout:8/886: dread d4/d27/d2a/d43/d61/d10d/f117 [0,4194304] 0 2024-09-20T20:31:44.770 INFO:tasks.workunit.client.0.smithi070.stdout:4/908: dwrite d6/d7/dc/f4b [0,4194304] 0 2024-09-20T20:31:44.770 INFO:tasks.workunit.client.0.smithi070.stdout:8/887: fdatasync d4/d27/d2a/d5b/d98/da9/db5/f110 0 2024-09-20T20:31:44.772 INFO:tasks.workunit.client.0.smithi070.stdout:1/981: write d4/f96 [6714089,8411] 0 2024-09-20T20:31:44.772 INFO:tasks.workunit.client.0.smithi070.stdout:4/909: unlink d6/d5e/d75/d40/f108 0 2024-09-20T20:31:44.772 INFO:tasks.workunit.client.0.smithi070.stdout:8/888: link d4/db/f32 d4/d27/dde/f12b 0 2024-09-20T20:31:44.773 INFO:tasks.workunit.client.0.smithi070.stdout:8/889: unlink d4/d27/d73/d87/l9e 0 2024-09-20T20:31:44.776 INFO:tasks.workunit.client.0.smithi070.stdout:5/921: truncate d2/d4/d98/d5b/d90/da0/f109 4359139 0 2024-09-20T20:31:44.778 INFO:tasks.workunit.client.0.smithi070.stdout:5/922: creat d2/d4/d98/d5b/d90/f13d x:0 0 0 2024-09-20T20:31:44.779 INFO:tasks.workunit.client.0.smithi070.stdout:1/982: dwrite d4/d6/d11/d63/de7/d44/de8/f13e [0,4194304] 0 2024-09-20T20:31:44.780 INFO:tasks.workunit.client.0.smithi070.stdout:5/923: write d2/d4/de/d47/d67/d92/de2/fed [1640261,27351] 0 2024-09-20T20:31:44.780 INFO:tasks.workunit.client.0.smithi070.stdout:8/890: dwrite d4/d27/d2a/d5b/d6c/da6/f111 [0,4194304] 0 2024-09-20T20:31:44.782 INFO:tasks.workunit.client.0.smithi070.stdout:1/983: mknod d4/d32/de6/c157 0 2024-09-20T20:31:44.783 INFO:tasks.workunit.client.0.smithi070.stdout:8/891: mknod d4/db/d64/d7b/c12c 0 2024-09-20T20:31:44.783 INFO:tasks.workunit.client.0.smithi070.stdout:5/924: readlink d2/d7/d60/l9b 0 2024-09-20T20:31:44.783 INFO:tasks.workunit.client.0.smithi070.stdout:5/925: mkdir d2/df/d40/d13e 0 2024-09-20T20:31:44.789 INFO:tasks.workunit.client.0.smithi070.stdout:8/892: dwrite d4/db/d64/d95/ff6 [0,4194304] 0 2024-09-20T20:31:44.789 INFO:tasks.workunit.client.0.smithi070.stdout:1/984: dwrite d4/d32/dea/d3b/f106 [0,4194304] 0 2024-09-20T20:31:44.790 INFO:tasks.workunit.client.0.smithi070.stdout:8/893: creat d4/db/d66/d8d/f12d x:0 0 0 2024-09-20T20:31:44.791 INFO:tasks.workunit.client.0.smithi070.stdout:8/894: symlink d4/d27/d2a/d5b/l12e 0 2024-09-20T20:31:44.791 INFO:tasks.workunit.client.0.smithi070.stdout:8/895: readlink d4/db/l23 0 2024-09-20T20:31:44.792 INFO:tasks.workunit.client.0.smithi070.stdout:8/896: creat d4/d27/d2a/d5b/d98/da9/db5/dc0/f12f x:0 0 0 2024-09-20T20:31:44.798 INFO:tasks.workunit.client.0.smithi070.stdout:8/897: write d4/db/d64/d95/da5/d115/d39/f41 [3445909,107834] 0 2024-09-20T20:31:44.799 INFO:tasks.workunit.client.0.smithi070.stdout:8/898: mkdir d4/d27/dde/d121/d130 0 2024-09-20T20:31:44.799 INFO:tasks.workunit.client.0.smithi070.stdout:4/910: dread d6/d43/d5a/f68 [0,4194304] 0 2024-09-20T20:31:44.799 INFO:tasks.workunit.client.0.smithi070.stdout:8/899: mknod d4/db/c131 0 2024-09-20T20:31:44.800 INFO:tasks.workunit.client.0.smithi070.stdout:4/911: write d6/d5e/d75/fee [244656,127399] 0 2024-09-20T20:31:44.800 INFO:tasks.workunit.client.0.smithi070.stdout:9/901: sync 2024-09-20T20:31:44.800 INFO:tasks.workunit.client.0.smithi070.stdout:2/882: sync 2024-09-20T20:31:44.801 INFO:tasks.workunit.client.0.smithi070.stdout:4/912: mknod d6/d7/dc/d4a/d58/c123 0 2024-09-20T20:31:44.801 INFO:tasks.workunit.client.0.smithi070.stdout:7/846: sync 2024-09-20T20:31:44.801 INFO:tasks.workunit.client.0.smithi070.stdout:2/883: mkdir d3/d4c/d132 0 2024-09-20T20:31:44.802 INFO:tasks.workunit.client.0.smithi070.stdout:2/884: stat d3/d4c/d132 0 2024-09-20T20:31:44.802 INFO:tasks.workunit.client.0.smithi070.stdout:2/885: readlink d3/l32 0 2024-09-20T20:31:44.802 INFO:tasks.workunit.client.0.smithi070.stdout:4/913: link d6/d43/f5c d6/d7/dc/d4a/d81/f124 0 2024-09-20T20:31:44.803 INFO:tasks.workunit.client.0.smithi070.stdout:2/886: chown d3/d5/d9/d42/l50 140 1 2024-09-20T20:31:44.804 INFO:tasks.workunit.client.0.smithi070.stdout:2/887: mkdir d3/d4c/d5c/d86/d11e/d133 0 2024-09-20T20:31:44.804 INFO:tasks.workunit.client.0.smithi070.stdout:4/914: link d6/d7/dc/d4a/d58/c2b d6/d5e/d51/c125 0 2024-09-20T20:31:44.805 INFO:tasks.workunit.client.0.smithi070.stdout:9/902: dread d1/df/f22 [0,4194304] 0 2024-09-20T20:31:44.805 INFO:tasks.workunit.client.0.smithi070.stdout:9/903: creat d1/df/f142 x:0 0 0 2024-09-20T20:31:44.806 INFO:tasks.workunit.client.0.smithi070.stdout:2/888: rename d3/d5/d9/d1c/d47/d7e/ld3 to d3/d5/d9/d1c/l134 0 2024-09-20T20:31:44.806 INFO:tasks.workunit.client.0.smithi070.stdout:9/904: stat d1/df/d25/d69/d85/d9f/db9/de3 0 2024-09-20T20:31:44.807 INFO:tasks.workunit.client.0.smithi070.stdout:2/889: rename d3/d5/d9/d1c/dda/d104/d3e/d61/df3 to d3/d5/d9/d1c/dda/d104/d3e/d135 0 2024-09-20T20:31:44.808 INFO:tasks.workunit.client.0.smithi070.stdout:2/890: mkdir d3/d5/d9/d1c/dda/d104/d3e/d92/d136 0 2024-09-20T20:31:44.809 INFO:tasks.workunit.client.0.smithi070.stdout:4/915: truncate d6/d43/f5c 1474710 0 2024-09-20T20:31:44.809 INFO:tasks.workunit.client.0.smithi070.stdout:7/847: write d2/d19/f27 [2230630,128705] 0 2024-09-20T20:31:44.809 INFO:tasks.workunit.client.0.smithi070.stdout:2/891: truncate d3/de/f6d 2517125 0 2024-09-20T20:31:44.810 INFO:tasks.workunit.client.0.smithi070.stdout:7/848: creat d2/d19/dbe/dd0/f113 x:0 0 0 2024-09-20T20:31:44.810 INFO:tasks.workunit.client.0.smithi070.stdout:2/892: stat d3/d5/f1e 0 2024-09-20T20:31:44.810 INFO:tasks.workunit.client.0.smithi070.stdout:4/916: link d6/d26/c3f d6/d5e/d51/d78/dbc/c126 0 2024-09-20T20:31:44.811 INFO:tasks.workunit.client.0.smithi070.stdout:4/917: read d6/ff [366744,20722] 0 2024-09-20T20:31:44.812 INFO:tasks.workunit.client.0.smithi070.stdout:7/849: read d2/d19/d25/da2/fa4 [21234,34088] 0 2024-09-20T20:31:44.813 INFO:tasks.workunit.client.0.smithi070.stdout:7/850: mkdir d2/dfa/d4a/d114 0 2024-09-20T20:31:44.813 INFO:tasks.workunit.client.0.smithi070.stdout:7/851: chown d2/d30/dad 14437924 1 2024-09-20T20:31:44.814 INFO:tasks.workunit.client.0.smithi070.stdout:7/852: read d2/d30/d63/d69/fae [133301,68640] 0 2024-09-20T20:31:44.815 INFO:tasks.workunit.client.0.smithi070.stdout:7/853: stat d2/f35 0 2024-09-20T20:31:44.815 INFO:tasks.workunit.client.0.smithi070.stdout:7/854: dread - d2/d19/d25/da2/fbb zero size 2024-09-20T20:31:44.819 INFO:tasks.workunit.client.0.smithi070.stdout:9/905: dread d1/df/d25/d69/d85/dad/f54 [0,4194304] 0 2024-09-20T20:31:44.820 INFO:tasks.workunit.client.0.smithi070.stdout:9/906: dread - d1/df/d18/d44/da2/dab/f12c zero size 2024-09-20T20:31:44.822 INFO:tasks.workunit.client.0.smithi070.stdout:7/855: dwrite d2/d8/f18 [0,4194304] 0 2024-09-20T20:31:44.825 INFO:tasks.workunit.client.0.smithi070.stdout:7/856: creat d2/d52/f115 x:0 0 0 2024-09-20T20:31:44.825 INFO:tasks.workunit.client.0.smithi070.stdout:9/907: dwrite d1/df/d25/fff [0,4194304] 0 2024-09-20T20:31:44.827 INFO:tasks.workunit.client.0.smithi070.stdout:9/908: fdatasync d1/df/d38/f97 0 2024-09-20T20:31:44.827 INFO:tasks.workunit.client.0.smithi070.stdout:9/909: dread - d1/df/d84/fe8 zero size 2024-09-20T20:31:44.830 INFO:tasks.workunit.client.0.smithi070.stdout:3/801: sync 2024-09-20T20:31:44.831 INFO:tasks.workunit.client.0.smithi070.stdout:3/802: rename d7/d15/d1a/d48/d57 to d7/d15/d1a/dfb 0 2024-09-20T20:31:44.832 INFO:tasks.workunit.client.0.smithi070.stdout:7/857: dwrite d2/d19/d25/d42/d77/f9b [0,4194304] 0 2024-09-20T20:31:44.832 INFO:tasks.workunit.client.0.smithi070.stdout:3/803: write d7/d15/d1a/d4a/d51/d5b/d9e/fd6 [930246,67205] 0 2024-09-20T20:31:44.832 INFO:tasks.workunit.client.0.smithi070.stdout:7/858: chown d2/d65/feb 120493755 1 2024-09-20T20:31:44.833 INFO:tasks.workunit.client.0.smithi070.stdout:7/859: write d2/d19/f27 [1835148,25673] 0 2024-09-20T20:31:44.834 INFO:tasks.workunit.client.0.smithi070.stdout:7/860: fdatasync d2/f51 0 2024-09-20T20:31:44.835 INFO:tasks.workunit.client.0.smithi070.stdout:7/861: write d2/d19/d25/d42/f4f [2768209,72786] 0 2024-09-20T20:31:44.839 INFO:tasks.workunit.client.0.smithi070.stdout:7/862: dwrite d2/d19/d25/d42/f76 [0,4194304] 0 2024-09-20T20:31:44.841 INFO:tasks.workunit.client.0.smithi070.stdout:7/863: unlink d2/d30/d78/fbf 0 2024-09-20T20:31:44.841 INFO:tasks.workunit.client.0.smithi070.stdout:7/864: write d2/d8/f18 [1322449,89762] 0 2024-09-20T20:31:44.842 INFO:tasks.workunit.client.0.smithi070.stdout:7/865: creat d2/d19/d25/f116 x:0 0 0 2024-09-20T20:31:44.843 INFO:tasks.workunit.client.0.smithi070.stdout:7/866: creat d2/d19/d2e/f117 x:0 0 0 2024-09-20T20:31:44.844 INFO:tasks.workunit.client.0.smithi070.stdout:3/804: symlink d7/d15/d1a/d48/d66/d69/d13/d7a/lfc 0 2024-09-20T20:31:44.844 INFO:tasks.workunit.client.0.smithi070.stdout:7/867: creat d2/dfa/dd4/dd7/f118 x:0 0 0 2024-09-20T20:31:44.844 INFO:tasks.workunit.client.0.smithi070.stdout:3/805: chown d7/d15/d1a/d4a/fc5 451973351 1 2024-09-20T20:31:44.845 INFO:tasks.workunit.client.0.smithi070.stdout:3/806: rmdir d7/d15/d1a/d4a/d51 39 2024-09-20T20:31:44.845 INFO:tasks.workunit.client.0.smithi070.stdout:7/868: link d2/d19/d25/d42/f5a d2/d19/d2e/d101/f119 0 2024-09-20T20:31:44.846 INFO:tasks.workunit.client.0.smithi070.stdout:3/807: mknod d7/d15/d1a/d80/cfd 0 2024-09-20T20:31:44.851 INFO:tasks.workunit.client.0.smithi070.stdout:7/869: dwrite d2/d19/d2e/d101/f119 [0,4194304] 0 2024-09-20T20:31:44.851 INFO:tasks.workunit.client.0.smithi070.stdout:9/910: dread d1/df/d38/fc3 [0,4194304] 0 2024-09-20T20:31:44.851 INFO:tasks.workunit.client.0.smithi070.stdout:7/870: fsync d2/d52/f115 0 2024-09-20T20:31:44.852 INFO:tasks.workunit.client.0.smithi070.stdout:7/871: creat d2/dfa/dd4/dd7/de6/f11a x:0 0 0 2024-09-20T20:31:44.853 INFO:tasks.workunit.client.0.smithi070.stdout:7/872: creat d2/dfa/d4a/d114/f11b x:0 0 0 2024-09-20T20:31:44.854 INFO:tasks.workunit.client.0.smithi070.stdout:7/873: rename d2/d19/d25/ff5 to d2/dfa/dd4/dd7/f11c 0 2024-09-20T20:31:44.855 INFO:tasks.workunit.client.0.smithi070.stdout:7/874: dread - d2/d19/d25/da2/fbb zero size 2024-09-20T20:31:44.855 INFO:tasks.workunit.client.0.smithi070.stdout:7/875: mkdir d2/dfa/dd4/dd7/d11d 0 2024-09-20T20:31:44.856 INFO:tasks.workunit.client.0.smithi070.stdout:7/876: write d2/d30/d63/db4/de7/fec [519934,99350] 0 2024-09-20T20:31:44.856 INFO:tasks.workunit.client.0.smithi070.stdout:9/911: dread d1/df/d25/d69/fb0 [0,4194304] 0 2024-09-20T20:31:44.857 INFO:tasks.workunit.client.0.smithi070.stdout:7/877: chown d2/d19/d25/da2/lfb 110 1 2024-09-20T20:31:44.857 INFO:tasks.workunit.client.0.smithi070.stdout:7/878: creat d2/dfa/dd4/dd7/f11e x:0 0 0 2024-09-20T20:31:44.858 INFO:tasks.workunit.client.0.smithi070.stdout:7/879: mkdir d2/d19/d7c/dde/d100/d11f 0 2024-09-20T20:31:44.859 INFO:tasks.workunit.client.0.smithi070.stdout:7/880: truncate d2/d30/d63/d69/fae 4918526 0 2024-09-20T20:31:44.859 INFO:tasks.workunit.client.0.smithi070.stdout:7/881: rmdir d2/dfa/dd4/dd7 39 2024-09-20T20:31:44.862 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:44.857+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:44.862 INFO:tasks.workunit.client.0.smithi070.stdout:7/882: fdatasync d2/d30/d63/db4/de7/fec 0 2024-09-20T20:31:44.863 INFO:tasks.workunit.client.0.smithi070.stdout:7/883: chown d2/dfa/d4a/d114/f11b 44859 1 2024-09-20T20:31:44.863 INFO:tasks.workunit.client.0.smithi070.stdout:7/884: chown d2/d8/fb6 382120 1 2024-09-20T20:31:44.863 INFO:tasks.workunit.client.0.smithi070.stdout:7/885: fsync d2/d19/dbe/dd0/fe1 0 2024-09-20T20:31:44.864 INFO:tasks.workunit.client.0.smithi070.stdout:7/886: readlink d2/d19/d2e/l94 0 2024-09-20T20:31:44.864 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:44.864 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:44.868 INFO:tasks.workunit.client.0.smithi070.stdout:7/887: getdents d2/dfa/dd4/dd7 0 2024-09-20T20:31:44.868 INFO:tasks.workunit.client.0.smithi070.stdout:7/888: write d2/f35 [1873237,44107] 0 2024-09-20T20:31:44.869 INFO:tasks.workunit.client.0.smithi070.stdout:7/889: readlink d2/d19/d2e/l58 0 2024-09-20T20:31:44.870 INFO:tasks.workunit.client.0.smithi070.stdout:7/890: link d2/d19/dbe/c10d d2/d19/d7c/dde/d100/c120 0 2024-09-20T20:31:44.871 INFO:tasks.workunit.client.0.smithi070.stdout:7/891: mkdir d2/dfa/d121 0 2024-09-20T20:31:44.872 INFO:tasks.workunit.client.0.smithi070.stdout:7/892: unlink d2/d30/d63/db4/de7/fec 0 2024-09-20T20:31:44.872 INFO:tasks.workunit.client.0.smithi070.stdout:7/893: rmdir d2/dfa/d121 0 2024-09-20T20:31:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:7/894: creat d2/d19/dbe/dd0/f122 x:0 0 0 2024-09-20T20:31:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:9/912: dread d1/df/d25/d69/d85/dad/f57 [0,4194304] 0 2024-09-20T20:31:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:7/895: write d2/dfa/dd4/dd7/f11e [629679,17720] 0 2024-09-20T20:31:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:9/913: write d1/df/f70 [1283482,85006] 0 2024-09-20T20:31:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:9/914: unlink d1/df/d18/d44/d77/db8/f107 0 2024-09-20T20:31:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:7/896: getdents d2/d19 0 2024-09-20T20:31:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:9/915: mkdir d1/df/d38/d143 0 2024-09-20T20:31:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:9/916: rename d1/df/d25/d69/daf/lb3 to d1/df/d25/d69/d80/l144 0 2024-09-20T20:31:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:9/917: chown d1/d76/d13b/ddb 11033 1 2024-09-20T20:31:44.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:44.882 INFO:tasks.workunit.client.0.smithi070.stdout:9/918: dwrite d1/df/d25/d69/d80/fd3 [0,4194304] 0 2024-09-20T20:31:44.883 INFO:tasks.workunit.client.0.smithi070.stdout:0/885: sync 2024-09-20T20:31:44.883 INFO:tasks.workunit.client.0.smithi070.stdout:0/886: fdatasync d4/f7 0 2024-09-20T20:31:44.883 INFO:tasks.workunit.client.0.smithi070.stdout:0/887: write d4/d8/d55/dd8/fc5 [220048,70205] 0 2024-09-20T20:31:44.884 INFO:tasks.workunit.client.0.smithi070.stdout:0/888: mknod d4/d8/d12/c11a 0 2024-09-20T20:31:44.885 INFO:tasks.workunit.client.0.smithi070.stdout:0/889: write d4/d8/d55/dd8/d2d/f89 [2412844,61389] 0 2024-09-20T20:31:44.886 INFO:tasks.workunit.client.0.smithi070.stdout:0/890: fsync d4/d8/d55/dd8/d1d/d37/d3e/df8/d3b/fec 0 2024-09-20T20:31:44.911 INFO:tasks.workunit.client.0.smithi070.stdout:3/808: sync 2024-09-20T20:31:44.911 INFO:tasks.workunit.client.0.smithi070.stdout:8/900: sync 2024-09-20T20:31:44.911 INFO:tasks.workunit.client.0.smithi070.stdout:7/897: sync 2024-09-20T20:31:44.912 INFO:tasks.workunit.client.0.smithi070.stdout:2/893: sync 2024-09-20T20:31:44.912 INFO:tasks.workunit.client.0.smithi070.stdout:9/919: sync 2024-09-20T20:31:44.912 INFO:tasks.workunit.client.0.smithi070.stdout:1/985: sync 2024-09-20T20:31:44.912 INFO:tasks.workunit.client.0.smithi070.stdout:4/918: sync 2024-09-20T20:31:44.912 INFO:tasks.workunit.client.0.smithi070.stdout:5/926: sync 2024-09-20T20:31:44.912 INFO:tasks.workunit.client.0.smithi070.stdout:0/891: sync 2024-09-20T20:31:44.912 INFO:tasks.workunit.client.0.smithi070.stdout:5/927: chown f1 43924984 1 2024-09-20T20:31:44.913 INFO:tasks.workunit.client.0.smithi070.stdout:7/898: mkdir d2/dd5/d123 0 2024-09-20T20:31:44.913 INFO:tasks.workunit.client.0.smithi070.stdout:1/986: write d4/d6/d26/fc6 [782481,113621] 0 2024-09-20T20:31:44.913 INFO:tasks.workunit.client.0.smithi070.stdout:3/809: write d7/d15/d1a/d48/d66/d69/f33 [587476,44226] 0 2024-09-20T20:31:44.913 INFO:tasks.workunit.client.0.smithi070.stdout:8/901: symlink d4/d27/d2a/d43/d61/d10d/l132 0 2024-09-20T20:31:44.914 INFO:tasks.workunit.client.0.smithi070.stdout:2/894: getdents d3/de 0 2024-09-20T20:31:44.914 INFO:tasks.workunit.client.0.smithi070.stdout:2/895: fsync d3/f12a 0 2024-09-20T20:31:44.915 INFO:tasks.workunit.client.0.smithi070.stdout:9/920: readlink d1/df/d25/d69/d80/l144 0 2024-09-20T20:31:44.915 INFO:tasks.workunit.client.0.smithi070.stdout:1/987: read d4/d6/d11/d63/de7/d44/d5a/fc1 [99732,2169] 0 2024-09-20T20:31:44.916 INFO:tasks.workunit.client.0.smithi070.stdout:2/896: readlink d3/d5/d9/d1c/lb4 0 2024-09-20T20:31:44.918 INFO:tasks.workunit.client.0.smithi070.stdout:9/921: mknod d1/d76/c145 0 2024-09-20T20:31:44.918 INFO:tasks.workunit.client.0.smithi070.stdout:1/988: creat d4/d32/de6/f158 x:0 0 0 2024-09-20T20:31:44.918 INFO:tasks.workunit.client.0.smithi070.stdout:3/810: link d7/d15/d1a/d48/c7c d7/d15/d1e/cfe 0 2024-09-20T20:31:44.920 INFO:tasks.workunit.client.0.smithi070.stdout:9/922: fdatasync d1/f61 0 2024-09-20T20:31:44.921 INFO:tasks.workunit.client.0.smithi070.stdout:4/919: dwrite d6/d26/f90 [0,4194304] 0 2024-09-20T20:31:44.921 INFO:tasks.workunit.client.0.smithi070.stdout:2/897: getdents d3/d5/dd 0 2024-09-20T20:31:44.922 INFO:tasks.workunit.client.0.smithi070.stdout:1/989: dread d4/d6/d11/d63/d6c/f114 [0,4194304] 0 2024-09-20T20:31:44.922 INFO:tasks.workunit.client.0.smithi070.stdout:3/811: write d7/d15/d1a/d4a/d51/d5b/fe5 [1029818,1552] 0 2024-09-20T20:31:44.922 INFO:tasks.workunit.client.0.smithi070.stdout:5/928: dwrite d2/d7/d60/f91 [0,4194304] 0 2024-09-20T20:31:44.922 INFO:tasks.workunit.client.0.smithi070.stdout:2/898: fdatasync d3/d5/d9/d1c/d4e/f105 0 2024-09-20T20:31:44.923 INFO:tasks.workunit.client.0.smithi070.stdout:1/990: fdatasync d4/d32/d60/dca/dd2/f143 0 2024-09-20T20:31:44.923 INFO:tasks.workunit.client.0.smithi070.stdout:7/899: dwrite d2/dfa/d4a/d114/f11b [0,4194304] 0 2024-09-20T20:31:44.924 INFO:tasks.workunit.client.0.smithi070.stdout:7/900: readlink d2/d19/d25/d61/l67 0 2024-09-20T20:31:44.925 INFO:tasks.workunit.client.0.smithi070.stdout:9/923: mkdir d1/df/d25/d69/daf/d146 0 2024-09-20T20:31:44.925 INFO:tasks.workunit.client.0.smithi070.stdout:8/902: getdents d4/d27/d2a/d43/d61/d10d 0 2024-09-20T20:31:44.926 INFO:tasks.workunit.client.0.smithi070.stdout:1/991: unlink d4/d32/f117 0 2024-09-20T20:31:44.926 INFO:tasks.workunit.client.0.smithi070.stdout:2/899: rename d3/de/d9f to d3/d5/d9/d1c/dda/d104/d3e/d137 0 2024-09-20T20:31:44.926 INFO:tasks.workunit.client.0.smithi070.stdout:3/812: fsync d7/fd 0 2024-09-20T20:31:44.926 INFO:tasks.workunit.client.0.smithi070.stdout:5/929: unlink d2/d4/d98/d5b/d90/da0/f109 0 2024-09-20T20:31:44.927 INFO:tasks.workunit.client.0.smithi070.stdout:7/901: link d2/d19/d2e/cf2 d2/d19/d7c/dde/d100/d11f/c124 0 2024-09-20T20:31:44.927 INFO:tasks.workunit.client.0.smithi070.stdout:1/992: chown d4/d6/d26/f70 211 1 2024-09-20T20:31:44.927 INFO:tasks.workunit.client.0.smithi070.stdout:9/924: chown d1/df/d25/d69/d80/cf4 348026 1 2024-09-20T20:31:44.927 INFO:tasks.workunit.client.0.smithi070.stdout:5/930: mkdir d2/df/d77/d13f 0 2024-09-20T20:31:44.928 INFO:tasks.workunit.client.0.smithi070.stdout:3/813: fsync d7/d15/d1a/d48/d66/d69/d99/dcd/fdd 0 2024-09-20T20:31:44.928 INFO:tasks.workunit.client.0.smithi070.stdout:7/902: write d2/d19/d25/d42/d77/fa1 [1527235,68382] 0 2024-09-20T20:31:44.929 INFO:tasks.workunit.client.0.smithi070.stdout:2/900: unlink d3/d5/d9/d1c/dda/d104/fb3 0 2024-09-20T20:31:44.930 INFO:tasks.workunit.client.0.smithi070.stdout:7/903: symlink d2/d30/dad/l125 0 2024-09-20T20:31:44.932 INFO:tasks.workunit.client.0.smithi070.stdout:0/892: dread d4/d8/d55/dd8/d1d/d37/d3e/ff0 [0,4194304] 0 2024-09-20T20:31:44.933 INFO:tasks.workunit.client.0.smithi070.stdout:3/814: mknod d7/d15/d1a/d48/d66/d69/d13/cff 0 2024-09-20T20:31:44.933 INFO:tasks.workunit.client.0.smithi070.stdout:7/904: unlink d2/d30/d63/db4/cc9 0 2024-09-20T20:31:44.933 INFO:tasks.workunit.client.0.smithi070.stdout:7/905: fsync d2/d8/fa8 0 2024-09-20T20:31:44.933 INFO:tasks.workunit.client.0.smithi070.stdout:8/903: dwrite d4/d27/d2a/d5b/d98/da9/db5/ff2 [0,4194304] 0 2024-09-20T20:31:44.933 INFO:tasks.workunit.client.0.smithi070.stdout:7/906: mknod d2/dfa/d4a/d114/c126 0 2024-09-20T20:31:44.934 INFO:tasks.workunit.client.0.smithi070.stdout:8/904: chown d4/d27/d42/d103/f91 1483740508 1 2024-09-20T20:31:44.935 INFO:tasks.workunit.client.0.smithi070.stdout:7/907: symlink d2/d19/d2e/l127 0 2024-09-20T20:31:44.938 INFO:tasks.workunit.client.0.smithi070.stdout:2/901: dwrite d3/d5/d9/d10/f52 [0,4194304] 0 2024-09-20T20:31:44.941 INFO:tasks.workunit.client.0.smithi070.stdout:0/893: dwrite d4/d8/d55/dd8/d2d/f6c [0,4194304] 0 2024-09-20T20:31:44.943 INFO:tasks.workunit.client.0.smithi070.stdout:7/908: dwrite d2/f35 [4194304,4194304] 0 2024-09-20T20:31:44.943 INFO:tasks.workunit.client.0.smithi070.stdout:8/905: dwrite d4/db/d64/d95/da5/dfb/ffe [0,4194304] 0 2024-09-20T20:31:44.944 INFO:tasks.workunit.client.0.smithi070.stdout:0/894: creat d4/d8/d55/dd8/d1d/d41/dd1/f11b x:0 0 0 2024-09-20T20:31:44.946 INFO:tasks.workunit.client.0.smithi070.stdout:0/895: read d4/d19/fb9 [2704937,5111] 0 2024-09-20T20:31:44.946 INFO:tasks.workunit.client.0.smithi070.stdout:2/902: dwrite d3/f12a [0,4194304] 0 2024-09-20T20:31:44.946 INFO:tasks.workunit.client.0.smithi070.stdout:8/906: mknod d4/d27/d2a/d5b/d98/da9/db5/d11e/c133 0 2024-09-20T20:31:44.946 INFO:tasks.workunit.client.0.smithi070.stdout:2/903: chown d3/d5/d9/d1c/dda 280 1 2024-09-20T20:31:44.947 INFO:tasks.workunit.client.0.smithi070.stdout:0/896: write d4/d8/d55/dd8/d1f/fe7 [645006,69391] 0 2024-09-20T20:31:44.947 INFO:tasks.workunit.client.0.smithi070.stdout:5/931: dread d2/d4/d98/d5b/f26 [0,4194304] 0 2024-09-20T20:31:44.947 INFO:tasks.workunit.client.0.smithi070.stdout:8/907: creat d4/d27/dde/d121/d130/f134 x:0 0 0 2024-09-20T20:31:44.948 INFO:tasks.workunit.client.0.smithi070.stdout:8/908: rmdir d4/d27 39 2024-09-20T20:31:44.949 INFO:tasks.workunit.client.0.smithi070.stdout:5/932: rename d2/d7/d60/dbd/cbe to d2/d4/d98/dc7/d12d/c140 0 2024-09-20T20:31:44.949 INFO:tasks.workunit.client.0.smithi070.stdout:8/909: truncate d4/d27/dc6/f11c 5216081 0 2024-09-20T20:31:44.953 INFO:tasks.workunit.client.0.smithi070.stdout:1/993: truncate d4/d6/d11/f38 3482644 0 2024-09-20T20:31:44.953 INFO:tasks.workunit.client.0.smithi070.stdout:0/897: dwrite d4/d8/f30 [4194304,4194304] 0 2024-09-20T20:31:44.953 INFO:tasks.workunit.client.0.smithi070.stdout:2/904: dwrite d3/d5/d9/f88 [4194304,4194304] 0 2024-09-20T20:31:44.954 INFO:tasks.workunit.client.0.smithi070.stdout:2/905: readlink d3/d5/d9/d1c/dda/d104/d3e/ld0 0 2024-09-20T20:31:44.956 INFO:tasks.workunit.client.0.smithi070.stdout:2/906: mkdir d3/d5/d9/d42/d138 0 2024-09-20T20:31:44.959 INFO:tasks.workunit.client.0.smithi070.stdout:9/925: dwrite d1/df/d18/d46/f55 [0,4194304] 0 2024-09-20T20:31:44.960 INFO:tasks.workunit.client.0.smithi070.stdout:1/994: dwrite d4/d1f/f7a [0,4194304] 0 2024-09-20T20:31:44.960 INFO:tasks.workunit.client.0.smithi070.stdout:1/995: chown d4/d32/d116/c128 390069 1 2024-09-20T20:31:44.962 INFO:tasks.workunit.client.0.smithi070.stdout:1/996: truncate d4/d6/d11/d63/de7/d44/d4b/f10f 847534 0 2024-09-20T20:31:44.962 INFO:tasks.workunit.client.0.smithi070.stdout:1/997: mkdir d4/d6/d159 0 2024-09-20T20:31:44.962 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:44.956+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:44.968 INFO:tasks.workunit.client.0.smithi070.stdout:4/920: sync 2024-09-20T20:31:44.969 INFO:tasks.workunit.client.0.smithi070.stdout:0/898: sync 2024-09-20T20:31:44.969 INFO:tasks.workunit.client.0.smithi070.stdout:4/921: write d6/d7/dc/d20/f55 [1360983,22935] 0 2024-09-20T20:31:44.970 INFO:tasks.workunit.client.0.smithi070.stdout:0/899: creat d4/d8/d55/dd8/f11c x:0 0 0 2024-09-20T20:31:44.971 INFO:tasks.workunit.client.0.smithi070.stdout:0/900: stat d4/d8/d55/dd8/d1d/d37/d3e/df8/fc9 0 2024-09-20T20:31:44.977 INFO:tasks.workunit.client.0.smithi070.stdout:2/907: dread d3/d5/d9/d10/f11 [0,4194304] 0 2024-09-20T20:31:44.978 INFO:tasks.workunit.client.0.smithi070.stdout:7/909: sync 2024-09-20T20:31:44.978 INFO:tasks.workunit.client.0.smithi070.stdout:1/998: sync 2024-09-20T20:31:44.978 INFO:tasks.workunit.client.0.smithi070.stdout:4/922: sync 2024-09-20T20:31:44.979 INFO:tasks.workunit.client.0.smithi070.stdout:0/901: sync 2024-09-20T20:31:44.979 INFO:tasks.workunit.client.0.smithi070.stdout:1/999: rmdir d4/d32/d14b/d14e 0 2024-09-20T20:31:44.980 INFO:tasks.workunit.client.0.smithi070.stdout:4/923: getdents d6/d43/d5a/ddd 0 2024-09-20T20:31:44.981 INFO:tasks.workunit.client.0.smithi070.stdout:4/924: chown d6/d5e/d75/fee 15 1 2024-09-20T20:31:44.981 INFO:tasks.workunit.client.0.smithi070.stdout:0/902: link d4/d8/d55/dd8/d1f/d2e/f6d d4/d48/d4e/d81/f11d 0 2024-09-20T20:31:44.982 INFO:tasks.workunit.client.0.smithi070.stdout:0/903: dread - d4/d8/d12/d10c/f113 zero size 2024-09-20T20:31:44.983 INFO:tasks.workunit.client.0.smithi070.stdout:4/925: read d6/d7/dc/d4a/d81/fa3 [322250,28651] 0 2024-09-20T20:31:44.983 INFO:tasks.workunit.client.0.smithi070.stdout:0/904: stat d4/d19/d82/l10d 0 2024-09-20T20:31:44.983 INFO:tasks.workunit.client.0.smithi070.stdout:2/908: dwrite d3/d5/d9/f48 [0,4194304] 0 2024-09-20T20:31:44.984 INFO:tasks.workunit.client.0.smithi070.stdout:4/926: fdatasync d6/d26/d69/d71/f6d 0 2024-09-20T20:31:44.985 INFO:tasks.workunit.client.0.smithi070.stdout:0/905: rename d4/d48/d4e/f90 to d4/d48/d10f/f11e 0 2024-09-20T20:31:44.986 INFO:tasks.workunit.client.0.smithi070.stdout:2/909: mkdir d3/d5/d9/d1c/d4e/da4/d139 0 2024-09-20T20:31:44.986 INFO:tasks.workunit.client.0.smithi070.stdout:7/910: dwrite d2/d8/f47 [0,4194304] 0 2024-09-20T20:31:44.986 INFO:tasks.workunit.client.0.smithi070.stdout:4/927: truncate d6/d26/d97/fc5 4415627 0 2024-09-20T20:31:44.987 INFO:tasks.workunit.client.0.smithi070.stdout:2/910: write d3/d5/d9/d1c/dda/d104/d3e/d61/db2/ff0 [412536,68117] 0 2024-09-20T20:31:44.988 INFO:tasks.workunit.client.0.smithi070.stdout:7/911: unlink d2/d19/l28 0 2024-09-20T20:31:44.989 INFO:tasks.workunit.client.0.smithi070.stdout:7/912: sync 2024-09-20T20:31:44.989 INFO:tasks.workunit.client.0.smithi070.stdout:4/928: getdents d6/d26/dd7/df1 0 2024-09-20T20:31:44.989 INFO:tasks.workunit.client.0.smithi070.stdout:7/913: mknod d2/d30/d63/d69/c128 0 2024-09-20T20:31:44.990 INFO:tasks.workunit.client.0.smithi070.stdout:9/926: dread d1/df/d18/d46/ffb [0,4194304] 0 2024-09-20T20:31:44.990 INFO:tasks.workunit.client.0.smithi070.stdout:7/914: write d2/d8/f1d [6096664,48232] 0 2024-09-20T20:31:44.990 INFO:tasks.workunit.client.0.smithi070.stdout:4/929: mknod d6/c127 0 2024-09-20T20:31:44.990 INFO:tasks.workunit.client.0.smithi070.stdout:9/927: write f0 [4102246,101533] 0 2024-09-20T20:31:44.991 INFO:tasks.workunit.client.0.smithi070.stdout:2/911: link d3/de/d12/df2/lc0 d3/d5/d9/d1c/dda/d104/d3e/d61/d128/l13a 0 2024-09-20T20:31:44.991 INFO:tasks.workunit.client.0.smithi070.stdout:4/930: readlink d6/d5e/d51/d78/dbc/l10d 0 2024-09-20T20:31:44.991 INFO:tasks.workunit.client.0.smithi070.stdout:2/912: dread - d3/d5/dd/d99/f12c zero size 2024-09-20T20:31:44.991 INFO:tasks.workunit.client.0.smithi070.stdout:4/931: chown d6/d26/deb 1 1 2024-09-20T20:31:44.992 INFO:tasks.workunit.client.0.smithi070.stdout:9/928: dread d1/df/d25/d69/fb0 [0,4194304] 0 2024-09-20T20:31:44.992 INFO:tasks.workunit.client.0.smithi070.stdout:4/932: symlink d6/d26/l128 0 2024-09-20T20:31:44.994 INFO:tasks.workunit.client.0.smithi070.stdout:9/929: rmdir d1/df/d25/d69/daf/de7/d134 0 2024-09-20T20:31:44.997 INFO:tasks.workunit.client.0.smithi070.stdout:2/913: dwrite d3/d5/d9/d10/f52 [0,4194304] 0 2024-09-20T20:31:44.999 INFO:tasks.workunit.client.0.smithi070.stdout:2/914: write d3/d5/d9/d10/f52 [5208420,74576] 0 2024-09-20T20:31:44.999 INFO:tasks.workunit.client.0.smithi070.stdout:4/933: dwrite d6/d26/dd7/f9a [0,4194304] 0 2024-09-20T20:31:45.001 INFO:tasks.workunit.client.0.smithi070.stdout:9/930: write d1/df/d25/f58 [850992,16507] 0 2024-09-20T20:31:45.001 INFO:tasks.workunit.client.0.smithi070.stdout:0/906: truncate d4/d8/d55/dd8/d1d/d41/dd1/f6e 231009 0 2024-09-20T20:31:45.001 INFO:tasks.workunit.client.0.smithi070.stdout:4/934: rmdir d6/d26/d69/d71/d4c/d10b 0 2024-09-20T20:31:45.002 INFO:tasks.workunit.client.0.smithi070.stdout:7/915: creat d2/d19/d25/d42/d77/f129 x:0 0 0 2024-09-20T20:31:45.003 INFO:tasks.workunit.client.0.smithi070.stdout:9/931: creat d1/d76/f147 x:0 0 0 2024-09-20T20:31:45.003 INFO:tasks.workunit.client.0.smithi070.stdout:0/907: rename d4/d8/d55/fb3 to d4/d1b/f11f 0 2024-09-20T20:31:45.003 INFO:tasks.workunit.client.0.smithi070.stdout:4/935: mknod d6/d5e/d6b/d74/dd3/c129 0 2024-09-20T20:31:45.003 INFO:tasks.workunit.client.0.smithi070.stdout:7/916: chown d2/cca 6604631 1 2024-09-20T20:31:45.004 INFO:tasks.workunit.client.0.smithi070.stdout:4/936: rename d6 to d6/d7/dc/d4a/d81/de4/d12a 22 2024-09-20T20:31:45.004 INFO:tasks.workunit.client.0.smithi070.stdout:9/932: mkdir d1/df/d18/d44/d148 0 2024-09-20T20:31:45.004 INFO:tasks.workunit.client.0.smithi070.stdout:5/933: dread d2/d7/d88/f83 [0,4194304] 0 2024-09-20T20:31:45.005 INFO:tasks.workunit.client.0.smithi070.stdout:9/933: mknod d1/df/d38/d143/c149 0 2024-09-20T20:31:45.005 INFO:tasks.workunit.client.0.smithi070.stdout:4/937: symlink d6/d7/dc/d4a/l12b 0 2024-09-20T20:31:45.005 INFO:tasks.workunit.client.0.smithi070.stdout:0/908: link d4/d8/d12/d23/db2/leb d4/d8/d55/dd8/d1d/d37/d3e/df8/d3b/da9/dbd/l120 0 2024-09-20T20:31:45.006 INFO:tasks.workunit.client.0.smithi070.stdout:5/934: rename d2/df/d77 to d2/d4/d98/d4c/dad/dba/dde/d141 0 2024-09-20T20:31:45.007 INFO:tasks.workunit.client.0.smithi070.stdout:4/938: write d6/d7/dc/d4a/d81/fa3 [1763682,20038] 0 2024-09-20T20:31:45.007 INFO:tasks.workunit.client.0.smithi070.stdout:9/934: creat d1/df/d25/d69/d85/d9f/d11e/f14a x:0 0 0 2024-09-20T20:31:45.008 INFO:tasks.workunit.client.0.smithi070.stdout:0/909: mknod d4/d8/d55/dd8/d1d/d37/d3e/df8/d9b/c121 0 2024-09-20T20:31:45.009 INFO:tasks.workunit.client.0.smithi070.stdout:5/935: dread d2/d4/d53/f95 [0,4194304] 0 2024-09-20T20:31:45.010 INFO:tasks.workunit.client.0.smithi070.stdout:3/815: dread d7/d15/d1a/dfb/d75/f7f [0,4194304] 0 2024-09-20T20:31:45.010 INFO:tasks.workunit.client.0.smithi070.stdout:5/936: dread - d2/f101 zero size 2024-09-20T20:31:45.010 INFO:tasks.workunit.client.0.smithi070.stdout:2/915: dwrite d3/f4a [0,4194304] 0 2024-09-20T20:31:45.011 INFO:tasks.workunit.client.0.smithi070.stdout:2/916: chown d3/de/d12/d4f 175 1 2024-09-20T20:31:45.012 INFO:tasks.workunit.client.0.smithi070.stdout:7/917: dwrite d2/d8/fe2 [0,4194304] 0 2024-09-20T20:31:45.013 INFO:tasks.workunit.client.0.smithi070.stdout:0/910: mknod d4/d48/d67/dcf/c122 0 2024-09-20T20:31:45.013 INFO:tasks.workunit.client.0.smithi070.stdout:2/917: creat d3/d5/d9/d1c/dda/d104/d3e/f13b x:0 0 0 2024-09-20T20:31:45.014 INFO:tasks.workunit.client.0.smithi070.stdout:7/918: read - d2/d19/dbe/ff7 zero size 2024-09-20T20:31:45.015 INFO:tasks.workunit.client.0.smithi070.stdout:0/911: chown d4/d8/d55/dd8/d1f/fae 29939543 1 2024-09-20T20:31:45.015 INFO:tasks.workunit.client.0.smithi070.stdout:7/919: fdatasync d2/d30/d63/d69/fae 0 2024-09-20T20:31:45.017 INFO:tasks.workunit.client.0.smithi070.stdout:9/935: dwrite d1/df/d25/d69/fb0 [0,4194304] 0 2024-09-20T20:31:45.020 INFO:tasks.workunit.client.0.smithi070.stdout:3/816: dwrite d7/d15/fc2 [0,4194304] 0 2024-09-20T20:31:45.020 INFO:tasks.workunit.client.0.smithi070.stdout:8/910: dread d4/d27/d2a/f1c [0,4194304] 0 2024-09-20T20:31:45.022 INFO:tasks.workunit.client.0.smithi070.stdout:2/918: dwrite d3/d5/d9/f48 [0,4194304] 0 2024-09-20T20:31:45.023 INFO:tasks.workunit.client.0.smithi070.stdout:4/939: truncate d6/d26/d69/d71/f7e 1932109 0 2024-09-20T20:31:45.023 INFO:tasks.workunit.client.0.smithi070.stdout:4/940: sync 2024-09-20T20:31:45.024 INFO:tasks.workunit.client.0.smithi070.stdout:5/937: write d2/d7/fd4 [4043275,92884] 0 2024-09-20T20:31:45.024 INFO:tasks.workunit.client.0.smithi070.stdout:8/911: rename d4/la7 to d4/d27/d73/d87/l135 0 2024-09-20T20:31:45.024 INFO:tasks.workunit.client.0.smithi070.stdout:9/936: fdatasync d1/df/d25/d69/d85/dad/f94 0 2024-09-20T20:31:45.024 INFO:tasks.workunit.client.0.smithi070.stdout:7/920: dwrite d2/d19/d25/da2/fbb [0,4194304] 0 2024-09-20T20:31:45.026 INFO:tasks.workunit.client.0.smithi070.stdout:2/919: write d3/de/d12/df2/dc2/f98 [337988,68631] 0 2024-09-20T20:31:45.027 INFO:tasks.workunit.client.0.smithi070.stdout:8/912: truncate d4/db/d64/d95/da5/d115/d31/f107 248320 0 2024-09-20T20:31:45.027 INFO:tasks.workunit.client.0.smithi070.stdout:5/938: fdatasync d2/df/d40/f5d 0 2024-09-20T20:31:45.027 INFO:tasks.workunit.client.0.smithi070.stdout:9/937: rename d1/df/d25/d69/cdf to d1/df/d18/d44/da2/db6/dd9/c14b 0 2024-09-20T20:31:45.027 INFO:tasks.workunit.client.0.smithi070.stdout:5/939: chown d2/d4/d53/fa4 0 1 2024-09-20T20:31:45.027 INFO:tasks.workunit.client.0.smithi070.stdout:7/921: symlink d2/d19/d25/d42/d88/l12a 0 2024-09-20T20:31:45.028 INFO:tasks.workunit.client.0.smithi070.stdout:8/913: mknod d4/d27/d2a/d43/d61/d10d/c136 0 2024-09-20T20:31:45.028 INFO:tasks.workunit.client.0.smithi070.stdout:3/817: dread d7/d15/d1a/dfb/d75/f7f [0,4194304] 0 2024-09-20T20:31:45.029 INFO:tasks.workunit.client.0.smithi070.stdout:5/940: symlink d2/d4/d98/d5b/d90/da0/l142 0 2024-09-20T20:31:45.029 INFO:tasks.workunit.client.0.smithi070.stdout:5/941: sync 2024-09-20T20:31:45.030 INFO:tasks.workunit.client.0.smithi070.stdout:3/818: mknod d7/d15/d1a/d48/c100 0 2024-09-20T20:31:45.031 INFO:tasks.workunit.client.0.smithi070.stdout:5/942: link d2/d7/f9 d2/d4/d53/f143 0 2024-09-20T20:31:45.031 INFO:tasks.workunit.client.0.smithi070.stdout:8/914: truncate d4/db/d64/d95/da5/d115/d31/d63/fdb 214409 0 2024-09-20T20:31:45.032 INFO:tasks.workunit.client.0.smithi070.stdout:3/819: mkdir d7/d15/d1e/d60/de9/d101 0 2024-09-20T20:31:45.032 INFO:tasks.workunit.client.0.smithi070.stdout:8/915: readlink d4/d27/d73/l128 0 2024-09-20T20:31:45.033 INFO:tasks.workunit.client.0.smithi070.stdout:5/943: mkdir d2/d4/de/d47/d10b/d144 0 2024-09-20T20:31:45.033 INFO:tasks.workunit.client.0.smithi070.stdout:5/944: sync 2024-09-20T20:31:45.033 INFO:tasks.workunit.client.0.smithi070.stdout:7/922: dread d2/d8/f47 [0,4194304] 0 2024-09-20T20:31:45.034 INFO:tasks.workunit.client.0.smithi070.stdout:8/916: mkdir d4/db/d64/d137 0 2024-09-20T20:31:45.034 INFO:tasks.workunit.client.0.smithi070.stdout:3/820: fdatasync d7/d15/d1a/d4a/d51/d5b/fe5 0 2024-09-20T20:31:45.034 INFO:tasks.workunit.client.0.smithi070.stdout:5/945: dread - d2/df/ff8 zero size 2024-09-20T20:31:45.035 INFO:tasks.workunit.client.0.smithi070.stdout:4/941: dwrite d6/d5e/d75/f88 [0,4194304] 0 2024-09-20T20:31:45.035 INFO:tasks.workunit.client.0.smithi070.stdout:4/942: sync 2024-09-20T20:31:45.035 INFO:tasks.workunit.client.0.smithi070.stdout:2/920: dwrite d3/d5/d9/d42/f93 [0,4194304] 0 2024-09-20T20:31:45.036 INFO:tasks.workunit.client.0.smithi070.stdout:8/917: symlink d4/d27/dc6/l138 0 2024-09-20T20:31:45.036 INFO:tasks.workunit.client.0.smithi070.stdout:4/943: mknod d6/d7/dc/d20/c12c 0 2024-09-20T20:31:45.037 INFO:tasks.workunit.client.0.smithi070.stdout:3/821: getdents d7/d15/d1e/d60/de9/d101 0 2024-09-20T20:31:45.038 INFO:tasks.workunit.client.0.smithi070.stdout:4/944: creat d6/d5e/d51/d78/f12d x:0 0 0 2024-09-20T20:31:45.038 INFO:tasks.workunit.client.0.smithi070.stdout:8/918: link d4/d27/cc5 d4/d27/dde/c139 0 2024-09-20T20:31:45.038 INFO:tasks.workunit.client.0.smithi070.stdout:4/945: sync 2024-09-20T20:31:45.039 INFO:tasks.workunit.client.0.smithi070.stdout:8/919: unlink d4/d27/d42/f44 0 2024-09-20T20:31:45.039 INFO:tasks.workunit.client.0.smithi070.stdout:3/822: creat d7/d15/d1a/d48/d66/d69/d99/dcd/f102 x:0 0 0 2024-09-20T20:31:45.039 INFO:tasks.workunit.client.0.smithi070.stdout:4/946: creat d6/d26/d97/f12e x:0 0 0 2024-09-20T20:31:45.039 INFO:tasks.workunit.client.0.smithi070.stdout:8/920: mkdir d4/d27/d13a 0 2024-09-20T20:31:45.040 INFO:tasks.workunit.client.0.smithi070.stdout:0/912: dread d4/d8/dff/fd7 [0,4194304] 0 2024-09-20T20:31:45.040 INFO:tasks.workunit.client.0.smithi070.stdout:4/947: write d6/d26/f9c [5052399,81615] 0 2024-09-20T20:31:45.040 INFO:tasks.workunit.client.0.smithi070.stdout:3/823: chown d7/d15/d1a/d4a/d51/de2 16435490 1 2024-09-20T20:31:45.042 INFO:tasks.workunit.client.0.smithi070.stdout:9/938: mkdir d1/df/d25/d69/d85/d9f/db9/de3/de5/d14c 0 2024-09-20T20:31:45.042 INFO:tasks.workunit.client.0.smithi070.stdout:8/921: write d4/db/d64/d95/da5/fda [657142,49201] 0 2024-09-20T20:31:45.043 INFO:tasks.workunit.client.0.smithi070.stdout:4/948: mknod d6/d5e/d6b/c12f 0 2024-09-20T20:31:45.043 INFO:tasks.workunit.client.0.smithi070.stdout:3/824: mknod d7/d15/d1e/d60/c103 0 2024-09-20T20:31:45.043 INFO:tasks.workunit.client.0.smithi070.stdout:0/913: write d4/d8/d55/dd8/d1d/d37/d3e/df8/fc9 [3917938,25363] 0 2024-09-20T20:31:45.044 INFO:tasks.workunit.client.0.smithi070.stdout:7/923: truncate d2/d8/f22 1028940 0 2024-09-20T20:31:45.044 INFO:tasks.workunit.client.0.smithi070.stdout:2/921: dwrite d3/d5/dd/d99/fe4 [0,4194304] 0 2024-09-20T20:31:45.044 INFO:tasks.workunit.client.0.smithi070.stdout:9/939: dread - d1/df/d38/f133 zero size 2024-09-20T20:31:45.045 INFO:tasks.workunit.client.0.smithi070.stdout:3/825: write d7/d15/d1a/d48/d66/d69/ffa [336846,99120] 0 2024-09-20T20:31:45.046 INFO:tasks.workunit.client.0.smithi070.stdout:9/940: mkdir d1/df/d25/d69/d85/dad/d14d 0 2024-09-20T20:31:45.046 INFO:tasks.workunit.client.0.smithi070.stdout:0/914: creat d4/d48/d4e/d81/f123 x:0 0 0 2024-09-20T20:31:45.046 INFO:tasks.workunit.client.0.smithi070.stdout:7/924: mknod d2/d30/d63/d69/df3/d10e/c12b 0 2024-09-20T20:31:45.046 INFO:tasks.workunit.client.0.smithi070.stdout:2/922: rename d3/d5/dd/lc9 to d3/d4c/d5c/d129/l13c 0 2024-09-20T20:31:45.047 INFO:tasks.workunit.client.0.smithi070.stdout:3/826: creat d7/d15/d1a/d4a/d51/f104 x:0 0 0 2024-09-20T20:31:45.048 INFO:tasks.workunit.client.0.smithi070.stdout:9/941: mknod d1/d76/d13b/c14e 0 2024-09-20T20:31:45.048 INFO:tasks.workunit.client.0.smithi070.stdout:7/925: chown d2/d19/l21 195 1 2024-09-20T20:31:45.050 INFO:tasks.workunit.client.0.smithi070.stdout:7/926: mknod d2/dd5/c12c 0 2024-09-20T20:31:45.052 INFO:tasks.workunit.client.0.smithi070.stdout:7/927: dread - d2/d30/d63/d69/f111 zero size 2024-09-20T20:31:45.052 INFO:tasks.workunit.client.0.smithi070.stdout:4/949: dwrite d6/d26/fc1 [0,4194304] 0 2024-09-20T20:31:45.053 INFO:tasks.workunit.client.0.smithi070.stdout:7/928: fdatasync d2/dfa/d4a/fb3 0 2024-09-20T20:31:45.053 INFO:tasks.workunit.client.0.smithi070.stdout:5/946: dwrite d2/d4/d98/d4c/dad/dba/dde/d141/f112 [0,4194304] 0 2024-09-20T20:31:45.053 INFO:tasks.workunit.client.0.smithi070.stdout:5/947: dread - d2/d4/f133 zero size 2024-09-20T20:31:45.055 INFO:tasks.workunit.client.0.smithi070.stdout:8/922: dwrite d4/d27/d2a/d5b/d98/ffd [0,4194304] 0 2024-09-20T20:31:45.055 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:45.055 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:45.055 INFO:tasks.workunit.client.0.smithi070.stdout:8/923: readlink d4/db/l23 0 2024-09-20T20:31:45.056 INFO:tasks.workunit.client.0.smithi070.stdout:3/827: rename d7/d15/d1a/d48/d66/d69/d13/d1d/l35 to d7/d15/d1a/d4a/d51/d5b/d88/l105 0 2024-09-20T20:31:45.056 INFO:tasks.workunit.client.0.smithi070.stdout:4/950: truncate d6/d7/dc/d4a/d81/ff2 2158976 0 2024-09-20T20:31:45.057 INFO:tasks.workunit.client.0.smithi070.stdout:8/924: truncate d4/db/d66/d8d/f12d 557294 0 2024-09-20T20:31:45.057 INFO:tasks.workunit.client.0.smithi070.stdout:4/951: fdatasync d6/d26/fbe 0 2024-09-20T20:31:45.060 INFO:tasks.workunit.client.0.smithi070.stdout:8/925: getdents d4 0 2024-09-20T20:31:45.060 INFO:tasks.workunit.client.0.smithi070.stdout:0/915: truncate d4/d8/dff/d112/f6b 1073683 0 2024-09-20T20:31:45.060 INFO:tasks.workunit.client.0.smithi070.stdout:2/923: truncate d3/f75 4450321 0 2024-09-20T20:31:45.061 INFO:tasks.workunit.client.0.smithi070.stdout:8/926: write d4/d27/d42/fb1 [426644,63874] 0 2024-09-20T20:31:45.061 INFO:tasks.workunit.client.0.smithi070.stdout:0/916: mkdir d4/d48/d10f/d124 0 2024-09-20T20:31:45.061 INFO:tasks.workunit.client.0.smithi070.stdout:2/924: write d3/de/d12/d4f/fd2 [1915645,87617] 0 2024-09-20T20:31:45.062 INFO:tasks.workunit.client.0.smithi070.stdout:2/925: chown d3/de/d12/cdd 96 1 2024-09-20T20:31:45.062 INFO:tasks.workunit.client.0.smithi070.stdout:8/927: mkdir d4/db/d64/d95/da5/d115/d39/ddf/d13b 0 2024-09-20T20:31:45.062 INFO:tasks.workunit.client.0.smithi070.stdout:7/929: dread d2/dfa/f7d [0,4194304] 0 2024-09-20T20:31:45.062 INFO:tasks.workunit.client.0.smithi070.stdout:0/917: mknod d4/d8/d55/dd8/d1d/d37/d3e/df8/d3b/da9/dbd/c125 0 2024-09-20T20:31:45.063 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:45.060+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:45.063 INFO:tasks.workunit.client.0.smithi070.stdout:8/928: mknod d4/d27/d42/d103/c13c 0 2024-09-20T20:31:45.064 INFO:tasks.workunit.client.0.smithi070.stdout:2/926: mkdir d3/d5/d9/d79/d13d 0 2024-09-20T20:31:45.064 INFO:tasks.workunit.client.0.smithi070.stdout:0/918: write d4/d48/f72 [3616852,115075] 0 2024-09-20T20:31:45.065 INFO:tasks.workunit.client.0.smithi070.stdout:2/927: write d3/d5/d9/d1c/f107 [71463,744] 0 2024-09-20T20:31:45.065 INFO:tasks.workunit.client.0.smithi070.stdout:0/919: creat d4/dfb/f126 x:0 0 0 2024-09-20T20:31:45.065 INFO:tasks.workunit.client.0.smithi070.stdout:0/920: sync 2024-09-20T20:31:45.065 INFO:tasks.workunit.client.0.smithi070.stdout:8/929: link d4/cb6 d4/db/d64/d95/da5/d115/d31/c13d 0 2024-09-20T20:31:45.066 INFO:tasks.workunit.client.0.smithi070.stdout:0/921: readlink d4/d8/d12/d23/laf 0 2024-09-20T20:31:45.066 INFO:tasks.workunit.client.0.smithi070.stdout:2/928: mkdir d3/d5/d9/d1c/d47/d13e 0 2024-09-20T20:31:45.066 INFO:tasks.workunit.client.0.smithi070.stdout:0/922: stat d4/d8/dff/f104 0 2024-09-20T20:31:45.067 INFO:tasks.workunit.client.0.smithi070.stdout:2/929: creat d3/d5/d9/d1c/dda/f13f x:0 0 0 2024-09-20T20:31:45.067 INFO:tasks.workunit.client.0.smithi070.stdout:0/923: write d4/d8/d12/f50 [1357310,45700] 0 2024-09-20T20:31:45.068 INFO:tasks.workunit.client.0.smithi070.stdout:9/942: dread d1/f61 [0,4194304] 0 2024-09-20T20:31:45.068 INFO:tasks.workunit.client.0.smithi070.stdout:2/930: chown d3/d5/d9/d1c/d47/f106 369098549 1 2024-09-20T20:31:45.068 INFO:tasks.workunit.client.0.smithi070.stdout:0/924: mknod d4/d48/d67/c127 0 2024-09-20T20:31:45.069 INFO:tasks.workunit.client.0.smithi070.stdout:9/943: mkdir d1/d76/d14f 0 2024-09-20T20:31:45.069 INFO:tasks.workunit.client.0.smithi070.stdout:3/828: truncate d7/d15/d1a/d48/d66/d69/d99/fdb 435980 0 2024-09-20T20:31:45.070 INFO:tasks.workunit.client.0.smithi070.stdout:7/930: dwrite d2/d19/d2e/f117 [0,4194304] 0 2024-09-20T20:31:45.070 INFO:tasks.workunit.client.0.smithi070.stdout:0/925: fdatasync d4/d19/d5b/f5f 0 2024-09-20T20:31:45.071 INFO:tasks.workunit.client.0.smithi070.stdout:2/931: truncate d3/d4c/f127 9431110 0 2024-09-20T20:31:45.071 INFO:tasks.workunit.client.0.smithi070.stdout:9/944: symlink d1/df/d18/d44/da2/dab/l150 0 2024-09-20T20:31:45.071 INFO:tasks.workunit.client.0.smithi070.stdout:3/829: write d7/d15/d1a/d80/fe1 [220284,33353] 0 2024-09-20T20:31:45.072 INFO:tasks.workunit.client.0.smithi070.stdout:0/926: creat d4/d8/d55/dd8/d2d/f128 x:0 0 0 2024-09-20T20:31:45.072 INFO:tasks.workunit.client.0.smithi070.stdout:7/931: mkdir d2/d19/d7c/dde/d100/d12d 0 2024-09-20T20:31:45.075 INFO:tasks.workunit.client.0.smithi070.stdout:7/932: fsync d2/d19/d25/f4c 0 2024-09-20T20:31:45.075 INFO:tasks.workunit.client.0.smithi070.stdout:3/830: fdatasync d7/d15/d1a/d48/d66/d69/f8d 0 2024-09-20T20:31:45.075 INFO:tasks.workunit.client.0.smithi070.stdout:0/927: creat d4/d48/d7b/f129 x:0 0 0 2024-09-20T20:31:45.075 INFO:tasks.workunit.client.0.smithi070.stdout:5/948: dwrite d2/df/f22 [0,4194304] 0 2024-09-20T20:31:45.075 INFO:tasks.workunit.client.0.smithi070.stdout:7/933: creat d2/dfa/d4a/f12e x:0 0 0 2024-09-20T20:31:45.075 INFO:tasks.workunit.client.0.smithi070.stdout:7/934: fsync d2/d19/d25/d42/f79 0 2024-09-20T20:31:45.076 INFO:tasks.workunit.client.0.smithi070.stdout:9/945: link d1/df/d25/d69/d85/d9f/fd5 d1/df/d25/d69/d85/dad/d14d/f151 0 2024-09-20T20:31:45.076 INFO:tasks.workunit.client.0.smithi070.stdout:7/935: write d2/dfa/dd4/dd7/f118 [354833,111330] 0 2024-09-20T20:31:45.078 INFO:tasks.workunit.client.0.smithi070.stdout:5/949: creat d2/d4/de/d47/d67/d92/de2/d115/f145 x:0 0 0 2024-09-20T20:31:45.078 INFO:tasks.workunit.client.0.smithi070.stdout:7/936: readlink d2/d19/dbe/dd0/dd3/le8 0 2024-09-20T20:31:45.079 INFO:tasks.workunit.client.0.smithi070.stdout:5/950: rmdir d2/db7 39 2024-09-20T20:31:45.079 INFO:tasks.workunit.client.0.smithi070.stdout:9/946: mkdir d1/df/d25/d69/d10c/d129/d152 0 2024-09-20T20:31:45.080 INFO:tasks.workunit.client.0.smithi070.stdout:7/937: fsync d2/d8/fb6 0 2024-09-20T20:31:45.080 INFO:tasks.workunit.client.0.smithi070.stdout:9/947: fdatasync d1/df/f1b 0 2024-09-20T20:31:45.080 INFO:tasks.workunit.client.0.smithi070.stdout:5/951: symlink d2/d7/l146 0 2024-09-20T20:31:45.082 INFO:tasks.workunit.client.0.smithi070.stdout:5/952: stat d2/df/d40/d13e 0 2024-09-20T20:31:45.082 INFO:tasks.workunit.client.0.smithi070.stdout:9/948: write d1/df/d25/d69/fb0 [3506841,75262] 0 2024-09-20T20:31:45.083 INFO:tasks.workunit.client.0.smithi070.stdout:0/928: dwrite d4/d48/d7b/f129 [0,4194304] 0 2024-09-20T20:31:45.083 INFO:tasks.workunit.client.0.smithi070.stdout:0/929: sync 2024-09-20T20:31:45.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:45.084 INFO:tasks.workunit.client.0.smithi070.stdout:4/952: dread d6/d26/fb2 [0,4194304] 0 2024-09-20T20:31:45.085 INFO:tasks.workunit.client.0.smithi070.stdout:5/953: link d2/db7/d11a/l138 d2/df/d40/da8/l147 0 2024-09-20T20:31:45.085 INFO:tasks.workunit.client.0.smithi070.stdout:4/953: symlink d6/d7/l130 0 2024-09-20T20:31:45.086 INFO:tasks.workunit.client.0.smithi070.stdout:5/954: unlink d2/d4/de/d47/d5f/f108 0 2024-09-20T20:31:45.086 INFO:tasks.workunit.client.0.smithi070.stdout:5/955: sync 2024-09-20T20:31:45.088 INFO:tasks.workunit.client.0.smithi070.stdout:9/949: dwrite d1/df/f70 [0,4194304] 0 2024-09-20T20:31:45.088 INFO:tasks.workunit.client.0.smithi070.stdout:4/954: mkdir d6/d7/dc/d4a/d58/d131 0 2024-09-20T20:31:45.088 INFO:tasks.workunit.client.0.smithi070.stdout:4/955: chown d6/d26/dd7/f9a 11 1 2024-09-20T20:31:45.089 INFO:tasks.workunit.client.0.smithi070.stdout:8/930: dread d4/f28 [0,4194304] 0 2024-09-20T20:31:45.090 INFO:tasks.workunit.client.0.smithi070.stdout:5/956: creat d2/d4/d98/d4c/dad/dba/dde/d141/f148 x:0 0 0 2024-09-20T20:31:45.090 INFO:tasks.workunit.client.0.smithi070.stdout:9/950: mkdir d1/d76/d14f/d153 0 2024-09-20T20:31:45.091 INFO:tasks.workunit.client.0.smithi070.stdout:8/931: mknod d4/db/d64/d95/da5/dfb/c13e 0 2024-09-20T20:31:45.092 INFO:tasks.workunit.client.0.smithi070.stdout:9/951: write d1/df/d18/d46/d127/f139 [429929,15879] 0 2024-09-20T20:31:45.093 INFO:tasks.workunit.client.0.smithi070.stdout:9/952: symlink d1/df/d25/d69/l154 0 2024-09-20T20:31:45.094 INFO:tasks.workunit.client.0.smithi070.stdout:9/953: creat d1/df/d18/d44/d148/f155 x:0 0 0 2024-09-20T20:31:45.095 INFO:tasks.workunit.client.0.smithi070.stdout:9/954: creat d1/df/d18/f156 x:0 0 0 2024-09-20T20:31:45.096 INFO:tasks.workunit.client.0.smithi070.stdout:9/955: dread - d1/df/d84/fe8 zero size 2024-09-20T20:31:45.097 INFO:tasks.workunit.client.0.smithi070.stdout:0/930: read d4/d8/d55/dd8/d1f/ff7 [1611553,30011] 0 2024-09-20T20:31:45.098 INFO:tasks.workunit.client.0.smithi070.stdout:9/956: creat d1/df/d18/f157 x:0 0 0 2024-09-20T20:31:45.099 INFO:tasks.workunit.client.0.smithi070.stdout:2/932: dread d3/de/f39 [0,4194304] 0 2024-09-20T20:31:45.099 INFO:tasks.workunit.client.0.smithi070.stdout:0/931: getdents d4/d8 0 2024-09-20T20:31:45.099 INFO:tasks.workunit.client.0.smithi070.stdout:8/932: write d4/db/d64/d95/da5/d115/f6d [617009,30549] 0 2024-09-20T20:31:45.100 INFO:tasks.workunit.client.0.smithi070.stdout:9/957: fdatasync d1/df/d25/d69/d80/fd3 0 2024-09-20T20:31:45.101 INFO:tasks.workunit.client.0.smithi070.stdout:7/938: dread d2/d8/f22 [0,4194304] 0 2024-09-20T20:31:45.102 INFO:tasks.workunit.client.0.smithi070.stdout:8/933: stat d4/db/d64/d95/da5 0 2024-09-20T20:31:45.102 INFO:tasks.workunit.client.0.smithi070.stdout:2/933: dread - d3/d5/d9/d1c/d47/f106 zero size 2024-09-20T20:31:45.102 INFO:tasks.workunit.client.0.smithi070.stdout:4/956: dwrite d6/d5e/d75/f28 [0,4194304] 0 2024-09-20T20:31:45.102 INFO:tasks.workunit.client.0.smithi070.stdout:3/831: dread d7/d15/fa6 [0,4194304] 0 2024-09-20T20:31:45.102 INFO:tasks.workunit.client.0.smithi070.stdout:0/932: chown d4/d8/d55/dd8/d1d/d37/d38/f63 286 1 2024-09-20T20:31:45.103 INFO:tasks.workunit.client.0.smithi070.stdout:7/939: stat d2/dfa/d4a/d114/c126 0 2024-09-20T20:31:45.104 INFO:tasks.workunit.client.0.smithi070.stdout:5/957: dwrite d2/d7/d60/f6f [0,4194304] 0 2024-09-20T20:31:45.104 INFO:tasks.workunit.client.0.smithi070.stdout:7/940: mkdir d2/d19/d2e/daa/d12f 0 2024-09-20T20:31:45.105 INFO:tasks.workunit.client.0.smithi070.stdout:2/934: getdents d3/d5/d9/d1c/d4e 0 2024-09-20T20:31:45.105 INFO:tasks.workunit.client.0.smithi070.stdout:3/832: link d7/d15/d1a/d48/c100 d7/d15/d1e/c106 0 2024-09-20T20:31:45.105 INFO:tasks.workunit.client.0.smithi070.stdout:0/933: getdents d4/d8 0 2024-09-20T20:31:45.107 INFO:tasks.workunit.client.0.smithi070.stdout:7/941: getdents d2/d30/d78 0 2024-09-20T20:31:45.107 INFO:tasks.workunit.client.0.smithi070.stdout:2/935: fsync d3/d5/d9/d42/f93 0 2024-09-20T20:31:45.109 INFO:tasks.workunit.client.0.smithi070.stdout:0/934: write d4/d8/d55/dd8/d1d/fc6 [4962632,99209] 0 2024-09-20T20:31:45.109 INFO:tasks.workunit.client.0.smithi070.stdout:3/833: symlink d7/d15/d1a/d80/dd8/l107 0 2024-09-20T20:31:45.109 INFO:tasks.workunit.client.0.smithi070.stdout:7/942: symlink d2/dfa/dd4/dd7/de6/l130 0 2024-09-20T20:31:45.109 INFO:tasks.workunit.client.0.smithi070.stdout:2/936: creat d3/d5/d9/d1c/dda/d104/d3e/dbe/f140 x:0 0 0 2024-09-20T20:31:45.109 INFO:tasks.workunit.client.0.smithi070.stdout:0/935: chown d4/d8/dff/f93 177 1 2024-09-20T20:31:45.110 INFO:tasks.workunit.client.0.smithi070.stdout:3/834: write d7/d15/d1a/d48/d66/d69/d99/fe4 [1023021,109259] 0 2024-09-20T20:31:45.110 INFO:tasks.workunit.client.0.smithi070.stdout:7/943: write d2/dfa/f44 [5080823,21392] 0 2024-09-20T20:31:45.110 INFO:tasks.workunit.client.0.smithi070.stdout:0/936: symlink d4/d19/d82/l12a 0 2024-09-20T20:31:45.110 INFO:tasks.workunit.client.0.smithi070.stdout:2/937: creat d3/f141 x:0 0 0 2024-09-20T20:31:45.111 INFO:tasks.workunit.client.0.smithi070.stdout:7/944: write d2/dfa/dd4/dd7/f11c [75371,30755] 0 2024-09-20T20:31:45.111 INFO:tasks.workunit.client.0.smithi070.stdout:3/835: chown d7/d15/d1a/d48/d66/d69/d13/d72/l77 31412 1 2024-09-20T20:31:45.111 INFO:tasks.workunit.client.0.smithi070.stdout:3/836: chown d7/d15/d1e/f2f 14 1 2024-09-20T20:31:45.112 INFO:tasks.workunit.client.0.smithi070.stdout:0/937: creat d4/d8/d55/dd8/d1d/d37/f12b x:0 0 0 2024-09-20T20:31:45.112 INFO:tasks.workunit.client.0.smithi070.stdout:3/837: chown d7/d15/d1e/d60/dd4/fd5 609 1 2024-09-20T20:31:45.114 INFO:tasks.workunit.client.0.smithi070.stdout:0/938: link d4/d8/d55/dd8/d2d/c108 d4/c12c 0 2024-09-20T20:31:45.114 INFO:tasks.workunit.client.0.smithi070.stdout:3/838: write d7/d15/d1a/d4a/d51/d5b/fe5 [1922060,50981] 0 2024-09-20T20:31:45.117 INFO:tasks.workunit.client.0.smithi070.stdout:2/938: dwrite d3/d5/d9/d10/f13 [0,4194304] 0 2024-09-20T20:31:45.117 INFO:tasks.workunit.client.0.smithi070.stdout:7/945: dwrite d2/dfa/d4a/f12e [0,4194304] 0 2024-09-20T20:31:45.124 INFO:tasks.workunit.client.0.smithi070.stdout:2/939: symlink d3/d4c/d5c/d86/d11e/l142 0 2024-09-20T20:31:45.125 INFO:tasks.workunit.client.0.smithi070.stdout:0/939: dwrite d4/d1b/f11f [0,4194304] 0 2024-09-20T20:31:45.125 INFO:tasks.workunit.client.0.smithi070.stdout:0/940: dread - d4/d1b/fee zero size 2024-09-20T20:31:45.125 INFO:tasks.workunit.client.0.smithi070.stdout:8/934: dread d4/db/f11 [0,4194304] 0 2024-09-20T20:31:45.126 INFO:tasks.workunit.client.0.smithi070.stdout:2/940: mkdir d3/d5/d9/d1c/dda/d104/d3e/d61/d128/d143 0 2024-09-20T20:31:45.127 INFO:tasks.workunit.client.0.smithi070.stdout:2/941: dread - d3/d5/dd/f12f zero size 2024-09-20T20:31:45.128 INFO:tasks.workunit.client.0.smithi070.stdout:2/942: getdents d3/d5/d9/d1c/dda/d104/d3e/d92/d136 0 2024-09-20T20:31:45.128 INFO:tasks.workunit.client.0.smithi070.stdout:2/943: mkdir d3/d4c/d5c/d86/d11e/d144 0 2024-09-20T20:31:45.129 INFO:tasks.workunit.client.0.smithi070.stdout:2/944: stat d3/d4c/d5c/d86/cd4 0 2024-09-20T20:31:45.130 INFO:tasks.workunit.client.0.smithi070.stdout:2/945: getdents d3/d5/d9/d1c/d4e 0 2024-09-20T20:31:45.130 INFO:tasks.workunit.client.0.smithi070.stdout:2/946: chown d3/de/f39 53093121 1 2024-09-20T20:31:45.131 INFO:tasks.workunit.client.0.smithi070.stdout:0/941: truncate d4/d8/d55/dd8/d2d/f89 723641 0 2024-09-20T20:31:45.131 INFO:tasks.workunit.client.0.smithi070.stdout:0/942: creat d4/d8/d55/dd8/d1d/d7e/f12d x:0 0 0 2024-09-20T20:31:45.132 INFO:tasks.workunit.client.0.smithi070.stdout:0/943: chown d4/d8/dff 0 1 2024-09-20T20:31:45.132 INFO:tasks.workunit.client.0.smithi070.stdout:2/947: rename d3/de/l20 to d3/d5/d9/d1c/d47/l145 0 2024-09-20T20:31:45.133 INFO:tasks.workunit.client.0.smithi070.stdout:2/948: mknod d3/d5/dd/d99/dae/c146 0 2024-09-20T20:31:45.133 INFO:tasks.workunit.client.0.smithi070.stdout:0/944: write d4/d8/d55/dd8/d1d/d37/d3e/fef [1782864,116271] 0 2024-09-20T20:31:45.133 INFO:tasks.workunit.client.0.smithi070.stdout:0/945: mknod d4/d8/d12/d10c/c12e 0 2024-09-20T20:31:45.134 INFO:tasks.workunit.client.0.smithi070.stdout:0/946: readlink d4/d8/d12/l8f 0 2024-09-20T20:31:45.135 INFO:tasks.workunit.client.0.smithi070.stdout:0/947: write d4/f16 [2155137,76619] 0 2024-09-20T20:31:45.135 INFO:tasks.workunit.client.0.smithi070.stdout:2/949: getdents d3/d5/d9/d1c/d47/d7e 0 2024-09-20T20:31:45.136 INFO:tasks.workunit.client.0.smithi070.stdout:2/950: fdatasync d3/d5/d9/d1c/dda/d104/d3e/d61/db2/f120 0 2024-09-20T20:31:45.138 INFO:tasks.workunit.client.0.smithi070.stdout:2/951: truncate d3/d4c/d5c/d86/dd5/de3/df5/f114 545425 0 2024-09-20T20:31:45.138 INFO:tasks.workunit.client.0.smithi070.stdout:2/952: chown d3/d5/f2e 1198934 1 2024-09-20T20:31:45.139 INFO:tasks.workunit.client.0.smithi070.stdout:9/958: dread d1/df/d25/f96 [0,4194304] 0 2024-09-20T20:31:45.139 INFO:tasks.workunit.client.0.smithi070.stdout:9/959: chown d1/df/f128 81814 1 2024-09-20T20:31:45.140 INFO:tasks.workunit.client.0.smithi070.stdout:9/960: mknod d1/df/d25/d69/d85/c158 0 2024-09-20T20:31:45.141 INFO:tasks.workunit.client.0.smithi070.stdout:2/953: read d3/d5/d9/d1c/dda/d104/d3e/dbe/fe8 [573,101970] 0 2024-09-20T20:31:45.142 INFO:tasks.workunit.client.0.smithi070.stdout:8/935: dread d4/d27/d42/d103/f77 [0,4194304] 0 2024-09-20T20:31:45.143 INFO:tasks.workunit.client.0.smithi070.stdout:9/961: mkdir d1/df/d18/d44/d148/d159 0 2024-09-20T20:31:45.143 INFO:tasks.workunit.client.0.smithi070.stdout:4/957: dread d6/d26/fbe [0,4194304] 0 2024-09-20T20:31:45.143 INFO:tasks.workunit.client.0.smithi070.stdout:2/954: readlink d3/d5/d9/d1c/dda/d104/d3e/ld0 0 2024-09-20T20:31:45.143 INFO:tasks.workunit.client.0.smithi070.stdout:4/958: fdatasync d6/d5e/d51/f10c 0 2024-09-20T20:31:45.144 INFO:tasks.workunit.client.0.smithi070.stdout:5/958: dread d2/d4/d53/d59/f61 [0,4194304] 0 2024-09-20T20:31:45.144 INFO:tasks.workunit.client.0.smithi070.stdout:8/936: creat d4/db/d66/f13f x:0 0 0 2024-09-20T20:31:45.145 INFO:tasks.workunit.client.0.smithi070.stdout:9/962: truncate d1/f11 369779 0 2024-09-20T20:31:45.146 INFO:tasks.workunit.client.0.smithi070.stdout:9/963: chown d1/df/c34 2 1 2024-09-20T20:31:45.146 INFO:tasks.workunit.client.0.smithi070.stdout:8/937: link d4/d27/d2a/f20 d4/d27/d2a/d43/d61/d10d/f140 0 2024-09-20T20:31:45.147 INFO:tasks.workunit.client.0.smithi070.stdout:8/938: fdatasync d4/db/fc9 0 2024-09-20T20:31:45.147 INFO:tasks.workunit.client.0.smithi070.stdout:9/964: getdents d1/df/d18/d46 0 2024-09-20T20:31:45.148 INFO:tasks.workunit.client.0.smithi070.stdout:9/965: dread - d1/d76/f138 zero size 2024-09-20T20:31:45.149 INFO:tasks.workunit.client.0.smithi070.stdout:9/966: sync 2024-09-20T20:31:45.150 INFO:tasks.workunit.client.0.smithi070.stdout:2/955: write f2 [284482,126309] 0 2024-09-20T20:31:45.150 INFO:tasks.workunit.client.0.smithi070.stdout:4/959: dwrite d6/d5e/d51/d63/ff5 [0,4194304] 0 2024-09-20T20:31:45.152 INFO:tasks.workunit.client.0.smithi070.stdout:9/967: creat d1/d76/f15a x:0 0 0 2024-09-20T20:31:45.152 INFO:tasks.workunit.client.0.smithi070.stdout:5/959: dwrite d2/df/d40/f7c [0,4194304] 0 2024-09-20T20:31:45.153 INFO:tasks.workunit.client.0.smithi070.stdout:8/939: read d4/db/d64/d95/da5/d115/d31/d63/fdb [6933,17820] 0 2024-09-20T20:31:45.153 INFO:tasks.workunit.client.0.smithi070.stdout:4/960: creat d6/d7/dc/d4a/d81/de4/f132 x:0 0 0 2024-09-20T20:31:45.153 INFO:tasks.workunit.client.0.smithi070.stdout:2/956: symlink d3/de/d12/l147 0 2024-09-20T20:31:45.154 INFO:tasks.workunit.client.0.smithi070.stdout:4/961: dread - d6/d43/f8e zero size 2024-09-20T20:31:45.154 INFO:tasks.workunit.client.0.smithi070.stdout:0/948: dread d4/d8/d55/dd8/d1d/d37/d38/f57 [0,4194304] 0 2024-09-20T20:31:45.155 INFO:tasks.workunit.client.0.smithi070.stdout:5/960: creat d2/d4/d98/d4c/f149 x:0 0 0 2024-09-20T20:31:45.155 INFO:tasks.workunit.client.0.smithi070.stdout:7/946: dread d2/d8/f10a [0,4194304] 0 2024-09-20T20:31:45.156 INFO:tasks.workunit.client.0.smithi070.stdout:2/957: creat d3/d5/d9/d79/f148 x:0 0 0 2024-09-20T20:31:45.157 INFO:tasks.workunit.client.0.smithi070.stdout:4/962: write d6/f6f [4087040,57475] 0 2024-09-20T20:31:45.157 INFO:tasks.workunit.client.0.smithi070.stdout:5/961: write d2/d4/d98/dc7/da5/fd8 [657937,63083] 0 2024-09-20T20:31:45.158 INFO:tasks.workunit.client.0.smithi070.stdout:5/962: dread - d2/f101 zero size 2024-09-20T20:31:45.158 INFO:tasks.workunit.client.0.smithi070.stdout:3/839: dread d7/d15/d1a/d48/d66/d69/f42 [4194304,4194304] 0 2024-09-20T20:31:45.159 INFO:tasks.workunit.client.0.smithi070.stdout:4/963: chown d6/d7/dc/d20/c12c 229 1 2024-09-20T20:31:45.159 INFO:tasks.workunit.client.0.smithi070.stdout:3/840: readlink d7/d15/d1a/dfb/l9c 0 2024-09-20T20:31:45.159 INFO:tasks.workunit.client.0.smithi070.stdout:8/940: link d4/db/d64/d95/da5/d115/d31/c35 d4/d27/d2a/d5b/d98/da9/db5/c141 0 2024-09-20T20:31:45.160 INFO:tasks.workunit.client.0.smithi070.stdout:2/958: rmdir d3/d5/d9/d42/d138 0 2024-09-20T20:31:45.160 INFO:tasks.workunit.client.0.smithi070.stdout:5/963: truncate d2/d4/de/d47/d5f/f8c 942992 0 2024-09-20T20:31:45.162 INFO:tasks.workunit.client.0.smithi070.stdout:8/941: write d4/d27/d2a/fb7 [963402,100549] 0 2024-09-20T20:31:45.162 INFO:tasks.workunit.client.0.smithi070.stdout:3/841: symlink d7/d15/d1a/d48/l108 0 2024-09-20T20:31:45.162 INFO:tasks.workunit.client.0.smithi070.stdout:2/959: fsync d3/d5/dd/d5a/f5f 0 2024-09-20T20:31:45.162 INFO:tasks.workunit.client.0.smithi070.stdout:3/842: chown f3 869 1 2024-09-20T20:31:45.163 INFO:tasks.workunit.client.0.smithi070.stdout:3/843: fsync d7/d15/fa6 0 2024-09-20T20:31:45.164 INFO:tasks.workunit.client.0.smithi070.stdout:8/942: write d4/d27/d2a/d5b/d6c/da6/fcc [631195,130315] 0 2024-09-20T20:31:45.164 INFO:tasks.workunit.client.0.smithi070.stdout:0/949: dwrite d4/d48/d67/dcd/ff3 [0,4194304] 0 2024-09-20T20:31:45.164 INFO:tasks.workunit.client.0.smithi070.stdout:9/968: write d1/df/d18/d46/f7f [134013,120485] 0 2024-09-20T20:31:45.164 INFO:tasks.workunit.client.0.smithi070.stdout:2/960: mknod d3/d5/d9/d1c/c149 0 2024-09-20T20:31:45.165 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:45.161+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:45.166 INFO:tasks.workunit.client.0.smithi070.stdout:3/844: chown d7/d15/d1e/d60/de9/fec 2146391 1 2024-09-20T20:31:45.166 INFO:tasks.workunit.client.0.smithi070.stdout:0/950: creat d4/d8/d55/dd8/d1f/d2e/f12f x:0 0 0 2024-09-20T20:31:45.166 INFO:tasks.workunit.client.0.smithi070.stdout:2/961: readlink d3/d5/d9/d1c/dda/d104/d3e/d92/lbf 0 2024-09-20T20:31:45.166 INFO:tasks.workunit.client.0.smithi070.stdout:9/969: mknod d1/df/d25/d69/daf/c15b 0 2024-09-20T20:31:45.166 INFO:tasks.workunit.client.0.smithi070.stdout:3/845: symlink d7/d15/d1a/d4a/l109 0 2024-09-20T20:31:45.167 INFO:tasks.workunit.client.0.smithi070.stdout:0/951: creat d4/d8/d55/dd8/d1d/d37/d38/f130 x:0 0 0 2024-09-20T20:31:45.167 INFO:tasks.workunit.client.0.smithi070.stdout:9/970: creat d1/df/d25/f15c x:0 0 0 2024-09-20T20:31:45.167 INFO:tasks.workunit.client.0.smithi070.stdout:0/952: mknod d4/d8/d55/dd8/d1d/d37/c131 0 2024-09-20T20:31:45.168 INFO:tasks.workunit.client.0.smithi070.stdout:3/846: rename d7/d71 to d7/d15/d1a/d48/d66/d69/d10a 0 2024-09-20T20:31:45.168 INFO:tasks.workunit.client.0.smithi070.stdout:4/964: truncate d6/d7/dc/fe 477999 0 2024-09-20T20:31:45.170 INFO:tasks.workunit.client.0.smithi070.stdout:8/943: dread d4/d27/d2a/d7e/fd5 [0,4194304] 0 2024-09-20T20:31:45.170 INFO:tasks.workunit.client.0.smithi070.stdout:0/953: rename d4/d8/d55/dd8/d1d/d37/d3e/fef to d4/d8/d12/d23/f132 0 2024-09-20T20:31:45.171 INFO:tasks.workunit.client.0.smithi070.stdout:4/965: fsync d6/d5e/d75/d40/f56 0 2024-09-20T20:31:45.172 INFO:tasks.workunit.client.0.smithi070.stdout:2/962: dread d3/d5/d9/d10/f13 [0,4194304] 0 2024-09-20T20:31:45.174 INFO:tasks.workunit.client.0.smithi070.stdout:7/947: dwrite d2/d65/fa0 [0,4194304] 0 2024-09-20T20:31:45.175 INFO:tasks.workunit.client.0.smithi070.stdout:7/948: sync 2024-09-20T20:31:45.175 INFO:tasks.workunit.client.0.smithi070.stdout:0/954: fsync d4/d8/d55/dd8/d1d/d37/d3e/df8/fc9 0 2024-09-20T20:31:45.175 INFO:tasks.workunit.client.0.smithi070.stdout:8/944: getdents d4/d27/d42/d103 0 2024-09-20T20:31:45.175 INFO:tasks.workunit.client.0.smithi070.stdout:4/966: rename d6/d5e/d51/d78 to d6/d5e/d51/d78/dbc/d133 22 2024-09-20T20:31:45.176 INFO:tasks.workunit.client.0.smithi070.stdout:4/967: chown d6/d26/dd7/df1 14396 1 2024-09-20T20:31:45.176 INFO:tasks.workunit.client.0.smithi070.stdout:9/971: dwrite d1/df/d18/d44/fc6 [0,4194304] 0 2024-09-20T20:31:45.176 INFO:tasks.workunit.client.0.smithi070.stdout:7/949: chown d2/d8/ca9 154887 1 2024-09-20T20:31:45.177 INFO:tasks.workunit.client.0.smithi070.stdout:7/950: dread - d2/dfa/ffd zero size 2024-09-20T20:31:45.177 INFO:tasks.workunit.client.0.smithi070.stdout:3/847: dwrite d7/d15/d1a/d4a/d51/f104 [0,4194304] 0 2024-09-20T20:31:45.177 INFO:tasks.workunit.client.0.smithi070.stdout:9/972: write d1/d76/f105 [165747,95055] 0 2024-09-20T20:31:45.178 INFO:tasks.workunit.client.0.smithi070.stdout:3/848: chown d7/d15/d1e/d60/dd4 1786880 1 2024-09-20T20:31:45.179 INFO:tasks.workunit.client.0.smithi070.stdout:7/951: creat d2/d30/dad/f131 x:0 0 0 2024-09-20T20:31:45.181 INFO:tasks.workunit.client.0.smithi070.stdout:8/945: mknod d4/d27/d13a/c142 0 2024-09-20T20:31:45.182 INFO:tasks.workunit.client.0.smithi070.stdout:9/973: link d1/df/d25/d69/f8d d1/df/d25/d69/d10c/d129/f15d 0 2024-09-20T20:31:45.182 INFO:tasks.workunit.client.0.smithi070.stdout:5/964: dread d2/d4/d98/f7a [0,4194304] 0 2024-09-20T20:31:45.183 INFO:tasks.workunit.client.0.smithi070.stdout:9/974: readlink d1/d76/l5d 0 2024-09-20T20:31:45.183 INFO:tasks.workunit.client.0.smithi070.stdout:9/975: sync 2024-09-20T20:31:45.183 INFO:tasks.workunit.client.0.smithi070.stdout:8/946: chown d4/db/d64/d95/da5/d115/c3d 10 1 2024-09-20T20:31:45.183 INFO:tasks.workunit.client.0.smithi070.stdout:4/968: dwrite d6/d43/f57 [0,4194304] 0 2024-09-20T20:31:45.183 INFO:tasks.workunit.client.0.smithi070.stdout:9/976: chown d1/df/d18/d44/da2/dcc 18 1 2024-09-20T20:31:45.184 INFO:tasks.workunit.client.0.smithi070.stdout:4/969: chown d6/d26/dd7/df1/c10e 2 1 2024-09-20T20:31:45.186 INFO:tasks.workunit.client.0.smithi070.stdout:7/952: dread d2/d19/dbe/dd0/dd3/fda [4194304,4194304] 0 2024-09-20T20:31:45.186 INFO:tasks.workunit.client.0.smithi070.stdout:9/977: unlink d1/df/d18/l36 0 2024-09-20T20:31:45.187 INFO:tasks.workunit.client.0.smithi070.stdout:3/849: dwrite d7/d15/d1a/d48/d66/d69/d13/d1d/f7b [0,4194304] 0 2024-09-20T20:31:45.188 INFO:tasks.workunit.client.0.smithi070.stdout:4/970: mkdir d6/d5e/d51/d84/d134 0 2024-09-20T20:31:45.188 INFO:tasks.workunit.client.0.smithi070.stdout:7/953: creat d2/d30/d63/d69/df3/d10e/f132 x:0 0 0 2024-09-20T20:31:45.189 INFO:tasks.workunit.client.0.smithi070.stdout:5/965: truncate d2/d7/f49 3873883 0 2024-09-20T20:31:45.189 INFO:tasks.workunit.client.0.smithi070.stdout:3/850: write d7/d15/d1a/d4a/d51/d5b/d88/fe6 [613100,95663] 0 2024-09-20T20:31:45.190 INFO:tasks.workunit.client.0.smithi070.stdout:3/851: chown l6 215911372 1 2024-09-20T20:31:45.190 INFO:tasks.workunit.client.0.smithi070.stdout:4/971: creat d6/d26/d69/d71/f135 x:0 0 0 2024-09-20T20:31:45.191 INFO:tasks.workunit.client.0.smithi070.stdout:5/966: symlink d2/d4/d98/d4c/dad/dba/dde/d141/l14a 0 2024-09-20T20:31:45.191 INFO:tasks.workunit.client.0.smithi070.stdout:4/972: unlink d6/d7/dc/f4d 0 2024-09-20T20:31:45.192 INFO:tasks.workunit.client.0.smithi070.stdout:4/973: read d6/d26/fbe [3386971,52219] 0 2024-09-20T20:31:45.192 INFO:tasks.workunit.client.0.smithi070.stdout:5/967: mknod d2/d4/d98/d4c/c14b 0 2024-09-20T20:31:45.193 INFO:tasks.workunit.client.0.smithi070.stdout:0/955: dread d4/d8/d55/dd8/fc5 [0,4194304] 0 2024-09-20T20:31:45.193 INFO:tasks.workunit.client.0.smithi070.stdout:5/968: rename d2/d4/de/d47/d67/f8e to d2/db7/d11a/d122/d12c/f14c 0 2024-09-20T20:31:45.194 INFO:tasks.workunit.client.0.smithi070.stdout:2/963: dread d3/d5/d9/d1c/dda/d104/f62 [4194304,4194304] 0 2024-09-20T20:31:45.195 INFO:tasks.workunit.client.0.smithi070.stdout:0/956: creat d4/d8/d12/d23/db2/f133 x:0 0 0 2024-09-20T20:31:45.195 INFO:tasks.workunit.client.0.smithi070.stdout:5/969: creat d2/d7/d60/dbd/de6/f14d x:0 0 0 2024-09-20T20:31:45.196 INFO:tasks.workunit.client.0.smithi070.stdout:0/957: write d4/d19/f29 [135674,128941] 0 2024-09-20T20:31:45.196 INFO:tasks.workunit.client.0.smithi070.stdout:5/970: mknod d2/d4/de/d47/d67/d92/de2/c14e 0 2024-09-20T20:31:45.198 INFO:tasks.workunit.client.0.smithi070.stdout:0/958: truncate d4/d8/d55/dd8/d1d/d37/d3e/f83 6055096 0 2024-09-20T20:31:45.199 INFO:tasks.workunit.client.0.smithi070.stdout:0/959: creat d4/d8/d55/dd8/d1d/d7e/f134 x:0 0 0 2024-09-20T20:31:45.201 INFO:tasks.workunit.client.0.smithi070.stdout:3/852: dwrite d7/d15/d1a/d48/d66/d69/fef [0,4194304] 0 2024-09-20T20:31:45.201 INFO:tasks.workunit.client.0.smithi070.stdout:0/960: write d4/d8/fc [2675924,75558] 0 2024-09-20T20:31:45.204 INFO:tasks.workunit.client.0.smithi070.stdout:7/954: truncate d2/d19/d25/d84/f8c 264910 0 2024-09-20T20:31:45.205 INFO:tasks.workunit.client.0.smithi070.stdout:2/964: truncate d3/d5/d9/d10/fad 2425857 0 2024-09-20T20:31:45.206 INFO:tasks.workunit.client.0.smithi070.stdout:0/961: creat d4/d48/d10f/d124/f135 x:0 0 0 2024-09-20T20:31:45.206 INFO:tasks.workunit.client.0.smithi070.stdout:9/978: dread d1/df/d18/d46/f73 [0,4194304] 0 2024-09-20T20:31:45.206 INFO:tasks.workunit.client.0.smithi070.stdout:5/971: dwrite d2/d4/d98/dc7/da5/fd8 [0,4194304] 0 2024-09-20T20:31:45.206 INFO:tasks.workunit.client.0.smithi070.stdout:7/955: creat d2/dfa/d5c/f133 x:0 0 0 2024-09-20T20:31:45.207 INFO:tasks.workunit.client.0.smithi070.stdout:0/962: unlink d4/d48/d7b/fe4 0 2024-09-20T20:31:45.207 INFO:tasks.workunit.client.0.smithi070.stdout:5/972: chown d2/df/d40/l6e 3467 1 2024-09-20T20:31:45.207 INFO:tasks.workunit.client.0.smithi070.stdout:3/853: link d7/d15/d1e/d60/l58 d7/d15/d1a/d48/d66/d69/d13/d1d/l10b 0 2024-09-20T20:31:45.208 INFO:tasks.workunit.client.0.smithi070.stdout:9/979: rmdir d1/d76/d14f/d153 0 2024-09-20T20:31:45.208 INFO:tasks.workunit.client.0.smithi070.stdout:2/965: link d3/d5/d9/d79/f7b d3/d5/d9/d79/d13d/f14a 0 2024-09-20T20:31:45.209 INFO:tasks.workunit.client.0.smithi070.stdout:9/980: readlink d1/df/d25/l33 0 2024-09-20T20:31:45.209 INFO:tasks.workunit.client.0.smithi070.stdout:0/963: getdents d4/d48/d67 0 2024-09-20T20:31:45.209 INFO:tasks.workunit.client.0.smithi070.stdout:5/973: mknod d2/d7/d60/dbd/de6/c14f 0 2024-09-20T20:31:45.209 INFO:tasks.workunit.client.0.smithi070.stdout:2/966: readlink d3/d5/d9/d1c/dda/d104/d3e/lfd 0 2024-09-20T20:31:45.210 INFO:tasks.workunit.client.0.smithi070.stdout:3/854: mkdir d7/d15/d1a/d48/d66/d69/d99/d10c 0 2024-09-20T20:31:45.210 INFO:tasks.workunit.client.0.smithi070.stdout:9/981: rename d1/df/d18/d44 to d1/df/d18/d44/da2/db6/dd9/d15e 22 2024-09-20T20:31:45.210 INFO:tasks.workunit.client.0.smithi070.stdout:9/982: sync 2024-09-20T20:31:45.211 INFO:tasks.workunit.client.0.smithi070.stdout:7/956: dread d2/d8/fe2 [0,4194304] 0 2024-09-20T20:31:45.212 INFO:tasks.workunit.client.0.smithi070.stdout:9/983: chown d1/df/d18/d44/da2/db6/f13f 0 1 2024-09-20T20:31:45.212 INFO:tasks.workunit.client.0.smithi070.stdout:7/957: readlink d2/d30/d63/d69/lcf 0 2024-09-20T20:31:45.213 INFO:tasks.workunit.client.0.smithi070.stdout:3/855: mknod d7/d15/d1a/dfb/d75/c10d 0 2024-09-20T20:31:45.213 INFO:tasks.workunit.client.0.smithi070.stdout:0/964: truncate d4/d8/d55/dd8/d1f/d2e/f6d 1012714 0 2024-09-20T20:31:45.214 INFO:tasks.workunit.client.0.smithi070.stdout:7/958: mknod d2/d19/d25/d42/c134 0 2024-09-20T20:31:45.214 INFO:tasks.workunit.client.0.smithi070.stdout:9/984: link d1/c17 d1/df/d25/d69/daf/d146/c15f 0 2024-09-20T20:31:45.214 INFO:tasks.workunit.client.0.smithi070.stdout:0/965: chown d4/f114 0 1 2024-09-20T20:31:45.215 INFO:tasks.workunit.client.0.smithi070.stdout:8/947: dread d4/db/d64/d95/ff6 [0,4194304] 0 2024-09-20T20:31:45.215 INFO:tasks.workunit.client.0.smithi070.stdout:3/856: mkdir d7/d15/d1e/d60/df1/d10e 0 2024-09-20T20:31:45.217 INFO:tasks.workunit.client.0.smithi070.stdout:2/967: dwrite d3/d5/d9/d10/fce [4194304,4194304] 0 2024-09-20T20:31:45.218 INFO:tasks.workunit.client.0.smithi070.stdout:4/974: dread d6/d43/f60 [0,4194304] 0 2024-09-20T20:31:45.221 INFO:tasks.workunit.client.0.smithi070.stdout:8/948: mkdir d4/d27/d2a/d7e/d143 0 2024-09-20T20:31:45.221 INFO:tasks.workunit.client.0.smithi070.stdout:9/985: creat d1/df/d25/d69/d10c/d129/d152/f160 x:0 0 0 2024-09-20T20:31:45.221 INFO:tasks.workunit.client.0.smithi070.stdout:5/974: write d2/db7/d11a/d122/d12c/f14c [1200864,92446] 0 2024-09-20T20:31:45.221 INFO:tasks.workunit.client.0.smithi070.stdout:5/975: sync 2024-09-20T20:31:45.221 INFO:tasks.workunit.client.0.smithi070.stdout:4/975: symlink d6/d7/dc/d4a/d81/de4/l136 0 2024-09-20T20:31:45.223 INFO:tasks.workunit.client.0.smithi070.stdout:2/968: rmdir d3/d5/d9/d1c/d4e/da4/d139 0 2024-09-20T20:31:45.223 INFO:tasks.workunit.client.0.smithi070.stdout:3/857: creat d7/d15/d1a/d48/d66/d69/d13/f10f x:0 0 0 2024-09-20T20:31:45.223 INFO:tasks.workunit.client.0.smithi070.stdout:8/949: truncate d4/f109 951665 0 2024-09-20T20:31:45.223 INFO:tasks.workunit.client.0.smithi070.stdout:5/976: stat d2/d4/d53/d59/l7b 0 2024-09-20T20:31:45.223 INFO:tasks.workunit.client.0.smithi070.stdout:4/976: fdatasync d6/d43/f8e 0 2024-09-20T20:31:45.224 INFO:tasks.workunit.client.0.smithi070.stdout:5/977: sync 2024-09-20T20:31:45.224 INFO:tasks.workunit.client.0.smithi070.stdout:7/959: dwrite d2/d52/f54 [0,4194304] 0 2024-09-20T20:31:45.224 INFO:tasks.workunit.client.0.smithi070.stdout:0/966: dwrite d4/d8/d55/dd8/f11c [0,4194304] 0 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:4/977: write d6/d5e/d75/f28 [2511213,53592] 0 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:2/969: rename d3/d5/d9/d1c/d47/d7e/c9c to d3/d5/dd/d5a/c14b 0 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:8/950: truncate d4/db/f16 1576080 0 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:9/986: truncate d1/df/d18/d44/da2/db6/dd9/f13d 351630 0 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:4/978: fdatasync d6/d5e/d6b/d74/dd3/ffa 0 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:3/858: mknod d7/d15/d1a/dfb/d75/c110 0 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:9/987: stat d1/df/d25/fa7 0 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:2/970: dread - d3/d5/dd/d99/f116 zero size 2024-09-20T20:31:45.226 INFO:tasks.workunit.client.0.smithi070.stdout:9/988: sync 2024-09-20T20:31:45.227 INFO:tasks.workunit.client.0.smithi070.stdout:7/960: rename d2/d8/c5 to d2/d19/dbe/c135 0 2024-09-20T20:31:45.227 INFO:tasks.workunit.client.0.smithi070.stdout:4/979: stat d6/d5e/d75/f21 0 2024-09-20T20:31:45.227 INFO:tasks.workunit.client.0.smithi070.stdout:7/961: stat d2/d19/d25/f86 0 2024-09-20T20:31:45.227 INFO:tasks.workunit.client.0.smithi070.stdout:3/859: write d7/d15/d1a/ff5 [189993,100823] 0 2024-09-20T20:31:45.228 INFO:tasks.workunit.client.0.smithi070.stdout:2/971: creat d3/d4c/d5c/f14c x:0 0 0 2024-09-20T20:31:45.228 INFO:tasks.workunit.client.0.smithi070.stdout:2/972: sync 2024-09-20T20:31:45.228 INFO:tasks.workunit.client.0.smithi070.stdout:4/980: truncate d6/d5e/d75/f106 823722 0 2024-09-20T20:31:45.228 INFO:tasks.workunit.client.0.smithi070.stdout:3/860: mkdir d7/d15/d1e/d60/d111 0 2024-09-20T20:31:45.228 INFO:tasks.workunit.client.0.smithi070.stdout:7/962: write d2/d19/d25/d42/f5a [3561123,33935] 0 2024-09-20T20:31:45.228 INFO:tasks.workunit.client.0.smithi070.stdout:2/973: mkdir d3/d5/dd/d14d 0 2024-09-20T20:31:45.229 INFO:tasks.workunit.client.0.smithi070.stdout:3/861: stat d7/d15/d1a/dfb/f85 0 2024-09-20T20:31:45.229 INFO:tasks.workunit.client.0.smithi070.stdout:4/981: symlink d6/d43/d5a/ddd/l137 0 2024-09-20T20:31:45.229 INFO:tasks.workunit.client.0.smithi070.stdout:3/862: chown d7/d15/l4b 11654499 1 2024-09-20T20:31:45.229 INFO:tasks.workunit.client.0.smithi070.stdout:7/963: truncate d2/d19/f1a 3492828 0 2024-09-20T20:31:45.229 INFO:tasks.workunit.client.0.smithi070.stdout:2/974: creat d3/d5/d9/d1c/dda/d104/d3e/d61/f14e x:0 0 0 2024-09-20T20:31:45.232 INFO:tasks.workunit.client.0.smithi070.stdout:2/975: creat d3/d5/dd/d99/ddb/f14f x:0 0 0 2024-09-20T20:31:45.233 INFO:tasks.workunit.client.0.smithi070.stdout:2/976: write d3/d5/d9/d1c/dda/d104/d3e/f102 [308931,45560] 0 2024-09-20T20:31:45.233 INFO:tasks.workunit.client.0.smithi070.stdout:2/977: fdatasync d3/d5/d10e/f111 0 2024-09-20T20:31:45.234 INFO:tasks.workunit.client.0.smithi070.stdout:3/863: dwrite d7/d15/d1a/d4a/f4d [4194304,4194304] 0 2024-09-20T20:31:45.234 INFO:tasks.workunit.client.0.smithi070.stdout:3/864: fdatasync d7/d15/d1e/d65/f9a 0 2024-09-20T20:31:45.236 INFO:tasks.workunit.client.0.smithi070.stdout:3/865: symlink d7/d15/d1a/d48/d66/d69/d10a/l112 0 2024-09-20T20:31:45.240 INFO:tasks.workunit.client.0.smithi070.stdout:2/978: dwrite d3/de/d12/d1a/fc6 [0,4194304] 0 2024-09-20T20:31:45.243 INFO:tasks.workunit.client.0.smithi070.stdout:5/978: truncate d2/d7/fd4 2652140 0 2024-09-20T20:31:45.243 INFO:tasks.workunit.client.0.smithi070.stdout:3/866: dwrite d7/d15/d1a/d48/d66/d69/d13/d1d/fe0 [0,4194304] 0 2024-09-20T20:31:45.244 INFO:tasks.workunit.client.0.smithi070.stdout:0/967: truncate d4/f16 6852640 0 2024-09-20T20:31:45.244 INFO:tasks.workunit.client.0.smithi070.stdout:8/951: write d4/db/f32 [4858548,81169] 0 2024-09-20T20:31:45.245 INFO:tasks.workunit.client.0.smithi070.stdout:9/989: truncate d1/df/d18/d44/f12f 1442228 0 2024-09-20T20:31:45.245 INFO:tasks.workunit.client.0.smithi070.stdout:8/952: write d4/ffc [387481,83894] 0 2024-09-20T20:31:45.245 INFO:tasks.workunit.client.0.smithi070.stdout:0/968: read d4/d8/d55/dd8/d1d/d37/d3e/df8/d3b/da9/fc1 [646097,9371] 0 2024-09-20T20:31:45.246 INFO:tasks.workunit.client.0.smithi070.stdout:9/990: read - d1/df/d38/dac/f131 zero size 2024-09-20T20:31:45.246 INFO:tasks.workunit.client.0.smithi070.stdout:0/969: creat d4/d1b/f136 x:0 0 0 2024-09-20T20:31:45.247 INFO:tasks.workunit.client.0.smithi070.stdout:9/991: fdatasync d1/df/d18/d44/da2/dcc/fe0 0 2024-09-20T20:31:45.247 INFO:tasks.workunit.client.0.smithi070.stdout:8/953: truncate d4/db/d64/d95/da5/d115/d31/f107 615036 0 2024-09-20T20:31:45.248 INFO:tasks.workunit.client.0.smithi070.stdout:0/970: write d4/d48/d7b/ffe [366007,63451] 0 2024-09-20T20:31:45.248 INFO:tasks.workunit.client.0.smithi070.stdout:9/992: chown d1/df 60887312 1 2024-09-20T20:31:45.248 INFO:tasks.workunit.client.0.smithi070.stdout:0/971: sync 2024-09-20T20:31:45.250 INFO:tasks.workunit.client.0.smithi070.stdout:9/993: mknod d1/df/d18/d44/da2/dcc/c161 0 2024-09-20T20:31:45.251 INFO:tasks.workunit.client.0.smithi070.stdout:2/979: dwrite d3/de/d12/f7a [0,4194304] 0 2024-09-20T20:31:45.251 INFO:tasks.workunit.client.0.smithi070.stdout:7/964: truncate d2/dfa/f44 1204871 0 2024-09-20T20:31:45.252 INFO:tasks.workunit.client.0.smithi070.stdout:4/982: dwrite d6/d26/d69/d71/f79 [0,4194304] 0 2024-09-20T20:31:45.253 INFO:tasks.workunit.client.0.smithi070.stdout:7/965: write d2/d30/d63/ffe [370709,81011] 0 2024-09-20T20:31:45.254 INFO:tasks.workunit.client.0.smithi070.stdout:7/966: fsync d2/d8/f18 0 2024-09-20T20:31:45.254 INFO:tasks.workunit.client.0.smithi070.stdout:5/979: truncate d2/d4/de/d47/d67/d92/f86 1747038 0 2024-09-20T20:31:45.254 INFO:tasks.workunit.client.0.smithi070.stdout:4/983: write d6/d43/f118 [916698,72376] 0 2024-09-20T20:31:45.254 INFO:tasks.workunit.client.0.smithi070.stdout:2/980: dread - d3/d5/d9/d1c/dda/d104/d3e/f101 zero size 2024-09-20T20:31:45.256 INFO:tasks.workunit.client.0.smithi070.stdout:7/967: write d2/d30/d63/ffe [179742,10681] 0 2024-09-20T20:31:45.256 INFO:tasks.workunit.client.0.smithi070.stdout:5/980: creat d2/d4/d53/f150 x:0 0 0 2024-09-20T20:31:45.256 INFO:tasks.workunit.client.0.smithi070.stdout:4/984: rename d6/d43/d5a to d6/d43/d5a/ddd/d138 22 2024-09-20T20:31:45.257 INFO:tasks.workunit.client.0.smithi070.stdout:5/981: fsync d2/d4/de/d47/f51 0 2024-09-20T20:31:45.258 INFO:tasks.workunit.client.0.smithi070.stdout:8/954: dwrite d4/d27/d2a/d7e/fd5 [0,4194304] 0 2024-09-20T20:31:45.259 INFO:tasks.workunit.client.0.smithi070.stdout:7/968: write d2/d19/ff9 [486692,52940] 0 2024-09-20T20:31:45.261 INFO:tasks.workunit.client.0.smithi070.stdout:9/994: dwrite d1/df/d25/d9e/f113 [0,4194304] 0 2024-09-20T20:31:45.261 INFO:tasks.workunit.client.0.smithi070.stdout:4/985: symlink d6/d5e/d75/l139 0 2024-09-20T20:31:45.261 INFO:tasks.workunit.client.0.smithi070.stdout:7/969: truncate d2/dfa/ffd 146788 0 2024-09-20T20:31:45.262 INFO:tasks.workunit.client.0.smithi070.stdout:0/972: dread d4/d8/d55/dd8/d2d/f96 [0,4194304] 0 2024-09-20T20:31:45.264 INFO:tasks.workunit.client.0.smithi070.stdout:8/955: link d4/d27/d2a/d5b/d98/da9/cc1 d4/d27/d2a/d5b/d98/da9/db5/c144 0 2024-09-20T20:31:45.264 INFO:tasks.workunit.client.0.smithi070.stdout:2/981: dwrite d3/d5/d9/d1c/d47/d7e/f115 [0,4194304] 0 2024-09-20T20:31:45.265 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:45.259+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:45.266 INFO:tasks.workunit.client.0.smithi070.stdout:8/956: symlink d4/db/d64/d7b/l145 0 2024-09-20T20:31:45.267 INFO:tasks.workunit.client.0.smithi070.stdout:8/957: sync 2024-09-20T20:31:45.268 INFO:tasks.workunit.client.0.smithi070.stdout:5/982: dwrite d2/d7/d60/dbd/dcd/ff1 [0,4194304] 0 2024-09-20T20:31:45.269 INFO:tasks.workunit.client.0.smithi070.stdout:8/958: chown d4/d27/d2a/d5b/d98/da9/db5/dc0/f113 1537 1 2024-09-20T20:31:45.270 INFO:tasks.workunit.client.0.smithi070.stdout:9/995: truncate d1/df/d18/d44/fc6 2456472 0 2024-09-20T20:31:45.270 INFO:tasks.workunit.client.0.smithi070.stdout:5/983: dread - d2/d4/d98/d4c/dad/dba/fc6 zero size 2024-09-20T20:31:45.271 INFO:tasks.workunit.client.0.smithi070.stdout:7/970: dwrite d2/dfa/d5c/f133 [0,4194304] 0 2024-09-20T20:31:45.271 INFO:tasks.workunit.client.0.smithi070.stdout:8/959: write d4/db/d64/d95/da5/d115/d39/fe4 [321296,55840] 0 2024-09-20T20:31:45.271 INFO:tasks.workunit.client.0.smithi070.stdout:5/984: mknod d2/d4/d98/d5b/c151 0 2024-09-20T20:31:45.272 INFO:tasks.workunit.client.0.smithi070.stdout:0/973: dwrite d4/d8/d55/dd8/d1d/d41/dd1/f6e [0,4194304] 0 2024-09-20T20:31:45.273 INFO:tasks.workunit.client.0.smithi070.stdout:0/974: rmdir d4/d8 39 2024-09-20T20:31:45.273 INFO:tasks.workunit.client.0.smithi070.stdout:5/985: write d2/d4/d98/f5a [125484,130210] 0 2024-09-20T20:31:45.273 INFO:tasks.workunit.client.0.smithi070.stdout:8/960: chown d4/db/d64/d95/fbe 347 1 2024-09-20T20:31:45.273 INFO:tasks.workunit.client.0.smithi070.stdout:5/986: sync 2024-09-20T20:31:45.273 INFO:tasks.workunit.client.0.smithi070.stdout:7/971: creat d2/dfa/dd4/dd7/d11d/f136 x:0 0 0 2024-09-20T20:31:45.274 INFO:tasks.workunit.client.0.smithi070.stdout:8/961: rmdir d4/db/d64/d95/da5/dfb 39 2024-09-20T20:31:45.274 INFO:tasks.workunit.client.0.smithi070.stdout:5/987: dread - d2/d4/d98/d5b/d90/f13d zero size 2024-09-20T20:31:45.277 INFO:tasks.workunit.client.0.smithi070.stdout:0/975: symlink d4/d8/d55/dd8/d1d/d41/dd1/d109/l137 0 2024-09-20T20:31:45.278 INFO:tasks.workunit.client.0.smithi070.stdout:7/972: truncate d2/d19/f107 1141130 0 2024-09-20T20:31:45.279 INFO:tasks.workunit.client.0.smithi070.stdout:0/976: dread - d4/d1b/f9f zero size 2024-09-20T20:31:45.279 INFO:tasks.workunit.client.0.smithi070.stdout:9/996: dwrite d1/df/d18/d44/d77/f100 [0,4194304] 0 2024-09-20T20:31:45.279 INFO:tasks.workunit.client.0.smithi070.stdout:7/973: write d2/d30/d63/f81 [348891,62917] 0 2024-09-20T20:31:45.280 INFO:tasks.workunit.client.0.smithi070.stdout:8/962: dread d4/db/d64/f93 [0,4194304] 0 2024-09-20T20:31:45.280 INFO:tasks.workunit.client.0.smithi070.stdout:9/997: rmdir d1/df/d18/d44/da2 39 2024-09-20T20:31:45.280 INFO:tasks.workunit.client.0.smithi070.stdout:0/977: creat d4/d48/d67/dcd/f138 x:0 0 0 2024-09-20T20:31:45.281 INFO:tasks.workunit.client.0.smithi070.stdout:9/998: read - d1/df/d84/f91 zero size 2024-09-20T20:31:45.281 INFO:tasks.workunit.client.0.smithi070.stdout:7/974: fdatasync d2/d30/d63/db4/fb8 0 2024-09-20T20:31:45.281 INFO:tasks.workunit.client.0.smithi070.stdout:8/963: truncate d4/db/d66/f13f 805201 0 2024-09-20T20:31:45.282 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:45.282 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:45.282 INFO:tasks.workunit.client.0.smithi070.stdout:7/975: chown d2/dd5/lf4 696 1 2024-09-20T20:31:45.282 INFO:tasks.workunit.client.0.smithi070.stdout:5/988: dwrite d2/d4/d53/d59/f8d [0,4194304] 0 2024-09-20T20:31:45.283 INFO:tasks.workunit.client.0.smithi070.stdout:0/978: mkdir d4/d8/d55/dd8/d1d/d37/d139 0 2024-09-20T20:31:45.283 INFO:tasks.workunit.client.0.smithi070.stdout:8/964: symlink d4/db/l146 0 2024-09-20T20:31:45.284 INFO:tasks.workunit.client.0.smithi070.stdout:0/979: mknod d4/d8/d55/dd8/d2d/c13a 0 2024-09-20T20:31:45.285 INFO:tasks.workunit.client.0.smithi070.stdout:5/989: rename d2/d4/d98/dc7/df5 to d2/d4/d98/d5b/d90/d152 0 2024-09-20T20:31:45.285 INFO:tasks.workunit.client.0.smithi070.stdout:8/965: creat d4/d27/d2a/d43/d61/d10d/f147 x:0 0 0 2024-09-20T20:31:45.285 INFO:tasks.workunit.client.0.smithi070.stdout:7/976: truncate d2/d19/d25/d42/f79 2136848 0 2024-09-20T20:31:45.286 INFO:tasks.workunit.client.0.smithi070.stdout:0/980: rmdir d4/d48/d67/dcf 39 2024-09-20T20:31:45.286 INFO:tasks.workunit.client.0.smithi070.stdout:5/990: symlink d2/d7/d60/dbd/de6/l153 0 2024-09-20T20:31:45.286 INFO:tasks.workunit.client.0.smithi070.stdout:7/977: write d2/d19/f27 [3376232,90504] 0 2024-09-20T20:31:45.288 INFO:tasks.workunit.client.0.smithi070.stdout:5/991: creat d2/d4/de/d47/d67/d92/de2/f154 x:0 0 0 2024-09-20T20:31:45.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/992: readlink d2/d4/de/d47/d67/d92/de2/l134 0 2024-09-20T20:31:45.289 INFO:tasks.workunit.client.0.smithi070.stdout:5/993: fdatasync d2/d4/d98/d4c/dad/dba/fc6 0 2024-09-20T20:31:45.290 INFO:tasks.workunit.client.0.smithi070.stdout:5/994: mknod d2/d4/d98/d4c/c155 0 2024-09-20T20:31:45.291 INFO:tasks.workunit.client.0.smithi070.stdout:5/995: symlink d2/d4/de/l156 0 2024-09-20T20:31:45.291 INFO:tasks.workunit.client.0.smithi070.stdout:5/996: rmdir d2/db7/d11a/d122 39 2024-09-20T20:31:45.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:45.294 INFO:tasks.workunit.client.0.smithi070.stdout:5/997: symlink d2/d4/d98/d5b/d90/da0/l157 0 2024-09-20T20:31:45.294 INFO:tasks.workunit.client.0.smithi070.stdout:3/867: dread d7/d15/f4f [0,4194304] 0 2024-09-20T20:31:45.295 INFO:tasks.workunit.client.0.smithi070.stdout:5/998: mknod d2/d4/de/d47/d10b/d144/c158 0 2024-09-20T20:31:45.295 INFO:tasks.workunit.client.0.smithi070.stdout:5/999: chown d2/df/d40/lbb 432 1 2024-09-20T20:31:45.297 INFO:tasks.workunit.client.0.smithi070.stdout:2/982: dread d3/d5/d9/d1c/dda/d104/d3e/f102 [0,4194304] 0 2024-09-20T20:31:45.300 INFO:tasks.workunit.client.0.smithi070.stdout:3/868: dwrite d7/d15/d1a/d4a/d51/d5b/fb3 [0,4194304] 0 2024-09-20T20:31:45.300 INFO:tasks.workunit.client.0.smithi070.stdout:8/966: truncate d4/d27/d2a/d5b/d6c/da6/fb9 3331761 0 2024-09-20T20:31:45.301 INFO:tasks.workunit.client.0.smithi070.stdout:2/983: truncate d3/d5/d9/d1c/dda/d104/d3e/dbe/fe8 975464 0 2024-09-20T20:31:45.301 INFO:tasks.workunit.client.0.smithi070.stdout:8/967: read - d4/db/d64/d7b/fa1 zero size 2024-09-20T20:31:45.302 INFO:tasks.workunit.client.0.smithi070.stdout:3/869: creat d7/d15/d1e/d60/df1/f113 x:0 0 0 2024-09-20T20:31:45.304 INFO:tasks.workunit.client.0.smithi070.stdout:2/984: read d3/de/d12/d4f/f122 [3005909,33469] 0 2024-09-20T20:31:45.304 INFO:tasks.workunit.client.0.smithi070.stdout:8/968: read d4/db/d66/f6a [3710334,107456] 0 2024-09-20T20:31:45.305 INFO:tasks.workunit.client.0.smithi070.stdout:3/870: creat d7/d15/d1a/d48/d66/d69/f114 x:0 0 0 2024-09-20T20:31:45.305 INFO:tasks.workunit.client.0.smithi070.stdout:0/981: dwrite d4/d8/d55/dd8/d1f/d2e/f6d [0,4194304] 0 2024-09-20T20:31:45.306 INFO:tasks.workunit.client.0.smithi070.stdout:0/982: stat d4/d8/d12/d23/db2 0 2024-09-20T20:31:45.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:45.308 INFO:tasks.workunit.client.0.smithi070.stdout:7/978: truncate d2/d65/fc3 2967558 0 2024-09-20T20:31:45.308 INFO:tasks.workunit.client.0.smithi070.stdout:8/969: fdatasync d4/db/d66/f74 0 2024-09-20T20:31:45.308 INFO:tasks.workunit.client.0.smithi070.stdout:2/985: mknod d3/d5/d9/d1c/dda/d104/d3e/dbe/c150 0 2024-09-20T20:31:45.308 INFO:tasks.workunit.client.0.smithi070.stdout:3/871: mknod d7/d15/d1a/d4a/d51/d5b/d9e/c115 0 2024-09-20T20:31:45.309 INFO:tasks.workunit.client.0.smithi070.stdout:0/983: mkdir d4/d8/d12/d13b 0 2024-09-20T20:31:45.309 INFO:tasks.workunit.client.0.smithi070.stdout:7/979: write d2/f10 [6010038,44001] 0 2024-09-20T20:31:45.310 INFO:tasks.workunit.client.0.smithi070.stdout:2/986: stat d3/d5/d9/d1c/dda/d104/d3e/c8e 0 2024-09-20T20:31:45.310 INFO:tasks.workunit.client.0.smithi070.stdout:3/872: truncate d7/d15/d1a/f78 1944091 0 2024-09-20T20:31:45.310 INFO:tasks.workunit.client.0.smithi070.stdout:7/980: creat d2/d19/d7c/dde/f137 x:0 0 0 2024-09-20T20:31:45.311 INFO:tasks.workunit.client.0.smithi070.stdout:2/987: chown d3/d5/d9/d1c/dda/f13f 22132 1 2024-09-20T20:31:45.311 INFO:tasks.workunit.client.0.smithi070.stdout:8/970: rename d4/db/f32 to d4/db/d64/d95/da5/d115/f148 0 2024-09-20T20:31:45.312 INFO:tasks.workunit.client.0.smithi070.stdout:2/988: unlink d3/d5/d9/d1c/d4e/da4/cdc 0 2024-09-20T20:31:45.313 INFO:tasks.workunit.client.0.smithi070.stdout:2/989: mknod d3/d4c/d5c/d86/d11e/d133/c151 0 2024-09-20T20:31:45.314 INFO:tasks.workunit.client.0.smithi070.stdout:2/990: unlink d3/d5/d9/d1c/f8c 0 2024-09-20T20:31:45.318 INFO:tasks.workunit.client.0.smithi070.stdout:0/984: truncate d4/d8/d55/dd8/d1d/d37/d3e/f83 2281066 0 2024-09-20T20:31:45.319 INFO:tasks.workunit.client.0.smithi070.stdout:8/971: dwrite d4/db/d66/f74 [0,4194304] 0 2024-09-20T20:31:45.322 INFO:tasks.workunit.client.0.smithi070.stdout:9/999: dread d1/df/d25/d69/fb0 [0,4194304] 0 2024-09-20T20:31:45.323 INFO:tasks.workunit.client.0.smithi070.stdout:2/991: dwrite d3/f36 [0,4194304] 0 2024-09-20T20:31:45.324 INFO:tasks.workunit.client.0.smithi070.stdout:0/985: mknod d4/d48/d4e/d81/c13c 0 2024-09-20T20:31:45.328 INFO:tasks.workunit.client.0.smithi070.stdout:7/981: dread d2/d65/fa3 [0,4194304] 0 2024-09-20T20:31:45.329 INFO:tasks.workunit.client.0.smithi070.stdout:4/986: dread d6/d7/f3e [0,4194304] 0 2024-09-20T20:31:45.329 INFO:tasks.workunit.client.0.smithi070.stdout:7/982: mknod d2/d30/d63/c138 0 2024-09-20T20:31:45.331 INFO:tasks.workunit.client.0.smithi070.stdout:0/986: dwrite d4/d48/d4e/d81/f11d [0,4194304] 0 2024-09-20T20:31:45.332 INFO:tasks.workunit.client.0.smithi070.stdout:0/987: dread - d4/dfb/f126 zero size 2024-09-20T20:31:45.334 INFO:tasks.workunit.client.0.smithi070.stdout:0/988: write d4/d8/d55/dd8/d1d/d37/d3e/df8/ffa [1005875,58081] 0 2024-09-20T20:31:45.334 INFO:tasks.workunit.client.0.smithi070.stdout:7/983: rename d2/d19/d25/d42/f5a to d2/d30/d63/f139 0 2024-09-20T20:31:45.335 INFO:tasks.workunit.client.0.smithi070.stdout:0/989: fsync d4/d48/d7b/fc3 0 2024-09-20T20:31:45.336 INFO:tasks.workunit.client.0.smithi070.stdout:4/987: dwrite d6/d26/d69/fbd [0,4194304] 0 2024-09-20T20:31:45.336 INFO:tasks.workunit.client.0.smithi070.stdout:7/984: truncate d2/dfa/f44 1517295 0 2024-09-20T20:31:45.336 INFO:tasks.workunit.client.0.smithi070.stdout:7/985: fsync d2/d19/d2e/f60 0 2024-09-20T20:31:45.337 INFO:tasks.workunit.client.0.smithi070.stdout:3/873: dread d7/d15/d1a/d48/d66/d69/d13/d72/fb0 [0,4194304] 0 2024-09-20T20:31:45.337 INFO:tasks.workunit.client.0.smithi070.stdout:0/990: symlink d4/d19/d5b/l13d 0 2024-09-20T20:31:45.338 INFO:tasks.workunit.client.0.smithi070.stdout:3/874: chown d7/d15/d1e/d60/c90 7135 1 2024-09-20T20:31:45.338 INFO:tasks.workunit.client.0.smithi070.stdout:0/991: creat d4/d48/d4e/f13e x:0 0 0 2024-09-20T20:31:45.341 INFO:tasks.workunit.client.0.smithi070.stdout:7/986: write d2/d19/d2e/f41 [1024405,113555] 0 2024-09-20T20:31:45.343 INFO:tasks.workunit.client.0.smithi070.stdout:7/987: truncate d2/f68 4582539 0 2024-09-20T20:31:45.343 INFO:tasks.workunit.client.0.smithi070.stdout:4/988: dwrite d6/d26/d69/d71/f5b [0,4194304] 0 2024-09-20T20:31:45.345 INFO:tasks.workunit.client.0.smithi070.stdout:7/988: creat d2/d30/d63/f13a x:0 0 0 2024-09-20T20:31:45.346 INFO:tasks.workunit.client.0.smithi070.stdout:4/989: truncate d6/d26/d69/d71/fa9 333850 0 2024-09-20T20:31:45.346 INFO:tasks.workunit.client.0.smithi070.stdout:3/875: dwrite d7/d15/d1e/d60/df1/f113 [0,4194304] 0 2024-09-20T20:31:45.346 INFO:tasks.workunit.client.0.smithi070.stdout:7/989: readlink d2/d30/l8e 0 2024-09-20T20:31:45.347 INFO:tasks.workunit.client.0.smithi070.stdout:3/876: write d7/fdc [887821,41171] 0 2024-09-20T20:31:45.347 INFO:tasks.workunit.client.0.smithi070.stdout:4/990: creat d6/d5e/d51/d78/dbc/f13a x:0 0 0 2024-09-20T20:31:45.348 INFO:tasks.workunit.client.0.smithi070.stdout:3/877: creat d7/d15/d1e/d60/de9/d101/f116 x:0 0 0 2024-09-20T20:31:45.348 INFO:tasks.workunit.client.0.smithi070.stdout:4/991: mkdir d6/d26/d97/d13b 0 2024-09-20T20:31:45.349 INFO:tasks.workunit.client.0.smithi070.stdout:3/878: chown d7/d15/d1a/d48/d66/d69/d13/d72/ca1 499 1 2024-09-20T20:31:45.349 INFO:tasks.workunit.client.0.smithi070.stdout:4/992: getdents d6/d5e/d51/d84 0 2024-09-20T20:31:45.350 INFO:tasks.workunit.client.0.smithi070.stdout:3/879: mknod d7/d15/d1a/d4a/d51/d5b/dca/c117 0 2024-09-20T20:31:45.350 INFO:tasks.workunit.client.0.smithi070.stdout:4/993: fsync d6/d5e/d75/d40/f102 0 2024-09-20T20:31:45.351 INFO:tasks.workunit.client.0.smithi070.stdout:3/880: fsync d7/d15/d1e/d65/ff6 0 2024-09-20T20:31:45.351 INFO:tasks.workunit.client.0.smithi070.stdout:4/994: read d6/d5e/f70 [7538602,32574] 0 2024-09-20T20:31:45.352 INFO:tasks.workunit.client.0.smithi070.stdout:3/881: chown d7/d15/d1a/d48/d66/d69/d99/dcd 2090 1 2024-09-20T20:31:45.353 INFO:tasks.workunit.client.0.smithi070.stdout:4/995: creat d6/d5e/d51/d78/dbc/f13c x:0 0 0 2024-09-20T20:31:45.353 INFO:tasks.workunit.client.0.smithi070.stdout:3/882: creat d7/d15/d1a/d48/d66/d69/d13/d1d/f118 x:0 0 0 2024-09-20T20:31:45.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/996: getdents d6/d26/d97/d13b 0 2024-09-20T20:31:45.354 INFO:tasks.workunit.client.0.smithi070.stdout:3/883: read d7/d15/d1a/d80/d8e/fa7 [522364,60789] 0 2024-09-20T20:31:45.354 INFO:tasks.workunit.client.0.smithi070.stdout:4/997: readlink d6/d7/dc/d4a/l12b 0 2024-09-20T20:31:45.355 INFO:tasks.workunit.client.0.smithi070.stdout:7/990: read d2/d19/d25/f86 [2036235,81207] 0 2024-09-20T20:31:45.356 INFO:tasks.workunit.client.0.smithi070.stdout:4/998: read d6/d26/fc1 [1562141,33293] 0 2024-09-20T20:31:45.356 INFO:tasks.workunit.client.0.smithi070.stdout:7/991: creat d2/d30/dad/f13b x:0 0 0 2024-09-20T20:31:45.356 INFO:tasks.workunit.client.0.smithi070.stdout:4/999: chown d6/d5e/d6b/f100 8 1 2024-09-20T20:31:45.358 INFO:tasks.workunit.client.0.smithi070.stdout:7/992: link d2/d19/d25/d42/d77/f129 d2/d30/d78/f13c 0 2024-09-20T20:31:45.359 INFO:tasks.workunit.client.0.smithi070.stdout:7/993: write d2/d19/dbe/dd0/f113 [861813,1290] 0 2024-09-20T20:31:45.360 INFO:tasks.workunit.client.0.smithi070.stdout:3/884: dwrite d7/d15/d1a/d48/d66/d69/f42 [0,4194304] 0 2024-09-20T20:31:45.363 INFO:tasks.workunit.client.0.smithi070.stdout:2/992: dread d3/d5/d9/d1c/d47/d7e/f84 [0,4194304] 0 2024-09-20T20:31:45.365 INFO:tasks.workunit.client.0.smithi070.stdout:3/885: dread d7/d15/d1a/d4a/d51/d5b/f6a [0,4194304] 0 2024-09-20T20:31:45.366 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:45.361+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:45.366 INFO:tasks.workunit.client.0.smithi070.stdout:7/994: dwrite d2/d8/fcb [0,4194304] 0 2024-09-20T20:31:45.366 INFO:tasks.workunit.client.0.smithi070.stdout:0/992: dread d4/d8/dff/f93 [0,4194304] 0 2024-09-20T20:31:45.367 INFO:tasks.workunit.client.0.smithi070.stdout:7/995: symlink d2/d30/l13d 0 2024-09-20T20:31:45.370 INFO:tasks.workunit.client.0.smithi070.stdout:3/886: truncate d7/d15/d1a/d48/d66/d69/d99/fdb 1409256 0 2024-09-20T20:31:45.370 INFO:tasks.workunit.client.0.smithi070.stdout:2/993: dwrite d3/d5/dd/f15 [0,4194304] 0 2024-09-20T20:31:45.372 INFO:tasks.workunit.client.0.smithi070.stdout:3/887: mkdir d7/d15/d1a/d4a/d51/de2/d119 0 2024-09-20T20:31:45.373 INFO:tasks.workunit.client.0.smithi070.stdout:3/888: fdatasync d7/d15/d1a/d48/d66/d69/f39 0 2024-09-20T20:31:45.374 INFO:tasks.workunit.client.0.smithi070.stdout:7/996: read d2/f51 [316905,32045] 0 2024-09-20T20:31:45.375 INFO:tasks.workunit.client.0.smithi070.stdout:7/997: write d2/d19/dbe/dd0/f113 [1652537,99458] 0 2024-09-20T20:31:45.377 INFO:tasks.workunit.client.0.smithi070.stdout:7/998: creat d2/d19/d25/f13e x:0 0 0 2024-09-20T20:31:45.377 INFO:tasks.workunit.client.0.smithi070.stdout:7/999: unlink d2/d19/d25/d42/f9d 0 2024-09-20T20:31:45.378 INFO:tasks.workunit.client.0.smithi070.stdout:3/889: dwrite d7/d15/d1e/d65/f5c [0,4194304] 0 2024-09-20T20:31:45.380 INFO:tasks.workunit.client.0.smithi070.stdout:3/890: creat d7/d15/d1a/d4a/d51/d5b/d9e/f11a x:0 0 0 2024-09-20T20:31:45.390 INFO:tasks.workunit.client.0.smithi070.stdout:0/993: dread d4/d1b/f3d [0,4194304] 0 2024-09-20T20:31:45.391 INFO:tasks.workunit.client.0.smithi070.stdout:0/994: write d4/d8/d12/d23/f100 [4478065,88094] 0 2024-09-20T20:31:45.394 INFO:tasks.workunit.client.0.smithi070.stdout:8/972: sync 2024-09-20T20:31:45.394 INFO:tasks.workunit.client.0.smithi070.stdout:2/994: sync 2024-09-20T20:31:45.394 INFO:tasks.workunit.client.0.smithi070.stdout:0/995: truncate d4/d8/d55/dd8/d1d/d37/d3e/df8/d3b/da9/f10a 335943 0 2024-09-20T20:31:45.394 INFO:tasks.workunit.client.0.smithi070.stdout:0/996: fdatasync d4/d1b/f98 0 2024-09-20T20:31:45.395 INFO:tasks.workunit.client.0.smithi070.stdout:8/973: write d4/d27/d2a/fb7 [706972,89055] 0 2024-09-20T20:31:45.396 INFO:tasks.workunit.client.0.smithi070.stdout:0/997: link d4/d8/d12/c15 d4/d48/d4e/d81/c13f 0 2024-09-20T20:31:45.397 INFO:tasks.workunit.client.0.smithi070.stdout:0/998: unlink d4/d8/dff/d112/f9d 0 2024-09-20T20:31:45.400 INFO:tasks.workunit.client.0.smithi070.stdout:2/995: dwrite d3/d5/d9/d1c/d47/d7e/f115 [0,4194304] 0 2024-09-20T20:31:45.404 INFO:tasks.workunit.client.0.smithi070.stdout:3/891: dread d7/d15/d1a/d48/d66/d69/f39 [0,4194304] 0 2024-09-20T20:31:45.404 INFO:tasks.workunit.client.0.smithi070.stdout:0/999: dwrite d4/d8/db6/fca [0,4194304] 0 2024-09-20T20:31:45.405 INFO:tasks.workunit.client.0.smithi070.stdout:3/892: fdatasync d7/d15/f2d 0 2024-09-20T20:31:45.405 INFO:tasks.workunit.client.0.smithi070.stdout:8/974: dwrite d4/db/d64/d95/da5/d115/d31/d63/fc2 [0,4194304] 0 2024-09-20T20:31:45.405 INFO:tasks.workunit.client.0.smithi070.stdout:8/975: chown d4/d27/dde 127 1 2024-09-20T20:31:45.407 INFO:tasks.workunit.client.0.smithi070.stdout:2/996: getdents d3/d4c/d5c/d86/d11e/d133 0 2024-09-20T20:31:45.407 INFO:tasks.workunit.client.0.smithi070.stdout:8/976: creat d4/db/d64/d95/da5/d115/d31/d63/f149 x:0 0 0 2024-09-20T20:31:45.408 INFO:tasks.workunit.client.0.smithi070.stdout:8/977: symlink d4/db/d64/d95/da5/d115/d39/l14a 0 2024-09-20T20:31:45.409 INFO:tasks.workunit.client.0.smithi070.stdout:8/978: unlink d4/d27/d2a/d5b/d98/da9/le3 0 2024-09-20T20:31:45.411 INFO:tasks.workunit.client.0.smithi070.stdout:8/979: rename d4/d27/d2a/d5b/d6c/c11a to d4/db/d64/d95/da5/d115/d39/ddf/c14b 0 2024-09-20T20:31:45.412 INFO:tasks.workunit.client.0.smithi070.stdout:8/980: write d4/db/d64/d95/ff6 [4881182,12141] 0 2024-09-20T20:31:45.413 INFO:tasks.workunit.client.0.smithi070.stdout:8/981: chown d4/db/d64/d95/da5 1 1 2024-09-20T20:31:45.413 INFO:tasks.workunit.client.0.smithi070.stdout:2/997: dwrite d3/d5/d9/d1c/dda/f113 [0,4194304] 0 2024-09-20T20:31:45.422 INFO:tasks.workunit.client.0.smithi070.stdout:3/893: dread d7/d15/fc2 [0,4194304] 0 2024-09-20T20:31:45.422 INFO:tasks.workunit.client.0.smithi070.stdout:3/894: chown d7/d15/d1a/d48/d66/d69/ffa 29 1 2024-09-20T20:31:45.423 INFO:tasks.workunit.client.0.smithi070.stdout:3/895: creat d7/d15/d1e/d60/d111/f11b x:0 0 0 2024-09-20T20:31:45.424 INFO:tasks.workunit.client.0.smithi070.stdout:3/896: write d7/d15/d1a/dfb/f85 [502756,73726] 0 2024-09-20T20:31:45.427 INFO:tasks.workunit.client.0.smithi070.stdout:3/897: dread d7/d15/d1a/d4a/d51/d5b/fb3 [0,4194304] 0 2024-09-20T20:31:45.427 INFO:tasks.workunit.client.0.smithi070.stdout:3/898: mkdir d7/d15/d1a/d4a/d11c 0 2024-09-20T20:31:45.429 INFO:tasks.workunit.client.0.smithi070.stdout:3/899: rename d7/d15/d1a/d4a/d51/d5b/d9e/fbc to d7/d15/d1e/d65/d9d/f11d 0 2024-09-20T20:31:45.436 INFO:tasks.workunit.client.0.smithi070.stdout:3/900: dread d7/d15/d1e/d60/dd4/ff4 [0,4194304] 0 2024-09-20T20:31:45.437 INFO:tasks.workunit.client.0.smithi070.stdout:3/901: chown d7/lf 14168 1 2024-09-20T20:31:45.438 INFO:tasks.workunit.client.0.smithi070.stdout:3/902: rename d7/d15/d1a/d48/d66/d69/d13/fb4 to d7/d15/d1e/d60/f11e 0 2024-09-20T20:31:45.439 INFO:tasks.workunit.client.0.smithi070.stdout:3/903: write d7/d15/d1a/d48/d66/d69/ffa [1008827,100867] 0 2024-09-20T20:31:45.441 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:45.441 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:45.444 INFO:tasks.workunit.client.0.smithi070.stdout:2/998: sync 2024-09-20T20:31:45.445 INFO:tasks.workunit.client.0.smithi070.stdout:8/982: sync 2024-09-20T20:31:45.445 INFO:tasks.workunit.client.0.smithi070.stdout:2/999: dread - d3/d5/dd/d99/ddb/ff9 zero size 2024-09-20T20:31:45.445 INFO:tasks.workunit.client.0.smithi070.stdout:8/983: symlink d4/d27/dc6/l14c 0 2024-09-20T20:31:45.446 INFO:tasks.workunit.client.0.smithi070.stdout:8/984: chown d4/d27/d2a/d43/d61/l6e 66189 1 2024-09-20T20:31:45.447 INFO:tasks.workunit.client.0.smithi070.stdout:8/985: link d4/db/d64/d95/da5/dfb/c13e d4/d27/dde/d121/c14d 0 2024-09-20T20:31:45.449 INFO:tasks.workunit.client.0.smithi070.stdout:8/986: mknod d4/d27/d2a/d5b/d98/da9/db5/c14e 0 2024-09-20T20:31:45.449 INFO:tasks.workunit.client.0.smithi070.stdout:8/987: stat d4/d27/d2a/d5b/d98/da9/db5/d11e/f122 0 2024-09-20T20:31:45.453 INFO:tasks.workunit.client.0.smithi070.stdout:8/988: truncate d4/db/d64/d95/da5/dfb/ffe 1920004 0 2024-09-20T20:31:45.454 INFO:tasks.workunit.client.0.smithi070.stdout:8/989: getdents d4 0 2024-09-20T20:31:45.454 INFO:tasks.workunit.client.0.smithi070.stdout:8/990: creat d4/f14f x:0 0 0 2024-09-20T20:31:45.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:45.456 INFO:tasks.workunit.client.0.smithi070.stdout:8/991: read d4/db/d64/d95/da5/d115/f6d [571019,16583] 0 2024-09-20T20:31:45.456 INFO:tasks.workunit.client.0.smithi070.stdout:8/992: stat d4/d27/dc6/l14c 0 2024-09-20T20:31:45.457 INFO:tasks.workunit.client.0.smithi070.stdout:8/993: truncate d4/d27/d2a/d43/d61/d10d/f117 8992131 0 2024-09-20T20:31:45.457 INFO:tasks.workunit.client.0.smithi070.stdout:8/994: readlink d4/db/d64/d95/da5/l11d 0 2024-09-20T20:31:45.464 INFO:tasks.workunit.client.0.smithi070.stdout:8/995: dwrite d4/db/d66/f84 [0,4194304] 0 2024-09-20T20:31:45.464 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:45.465 INFO:tasks.workunit.client.0.smithi070.stdout:8/996: getdents d4/db/d64/d137 0 2024-09-20T20:31:45.466 INFO:tasks.workunit.client.0.smithi070.stdout:8/997: readlink d4/d27/dc6/le0 0 2024-09-20T20:31:45.466 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:45.459+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:45.466 INFO:tasks.workunit.client.0.smithi070.stdout:8/998: write d4/db/d66/f84 [9727793,117948] 0 2024-09-20T20:31:45.467 INFO:tasks.workunit.client.0.smithi070.stdout:8/999: rename d4/d27/dde/c139 to d4/d27/d2a/d5b/d98/da9/c150 0 2024-09-20T20:31:45.483 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:45.483 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:45.496 INFO:tasks.workunit.client.0.smithi070.stdout:3/904: sync 2024-09-20T20:31:45.497 INFO:tasks.workunit.client.0.smithi070.stdout:3/905: write d7/d15/d1a/d48/d66/f93 [5054699,123346] 0 2024-09-20T20:31:45.498 INFO:tasks.workunit.client.0.smithi070.stdout:3/906: getdents d7/d15/d1a/d80/dd8 0 2024-09-20T20:31:45.499 INFO:tasks.workunit.client.0.smithi070.stdout:3/907: rename d7/d15/d1a/d4a/d7d to d7/d15/d1a/d80/d8e/d11f 0 2024-09-20T20:31:45.499 INFO:tasks.workunit.client.0.smithi070.stdout:3/908: fsync d7/d15/d1a/d48/d66/d69/d13/f2e 0 2024-09-20T20:31:45.503 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:45.504 INFO:tasks.workunit.client.0.smithi070.stdout:3/909: truncate d7/d15/d1a/d48/d66/d69/fef 377323 0 2024-09-20T20:31:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:3/910: write d7/d15/d1a/d48/f50 [2344502,57289] 0 2024-09-20T20:31:45.510 INFO:tasks.workunit.client.0.smithi070.stdout:3/911: dwrite d7/d15/d1a/d4a/f4d [4194304,4194304] 0 2024-09-20T20:31:45.512 INFO:tasks.workunit.client.0.smithi070.stdout:3/912: rmdir d7/d15/d1e/d65 39 2024-09-20T20:31:45.526 INFO:tasks.workunit.client.0.smithi070.stdout:3/913: dread d7/d15/d1e/f49 [0,4194304] 0 2024-09-20T20:31:45.527 INFO:tasks.workunit.client.0.smithi070.stdout:3/914: creat d7/d15/d1a/d4a/d51/d5b/d88/f120 x:0 0 0 2024-09-20T20:31:45.527 INFO:tasks.workunit.client.0.smithi070.stdout:3/915: dread - d7/d15/d1e/d60/fc1 zero size 2024-09-20T20:31:45.528 INFO:tasks.workunit.client.0.smithi070.stdout:3/916: write d7/d15/d1a/d48/d66/d69/d13/d1d/fab [77444,36443] 0 2024-09-20T20:31:45.529 INFO:tasks.workunit.client.0.smithi070.stdout:3/917: write d7/d15/d1a/d48/d66/d69/d13/f2e [1121769,83362] 0 2024-09-20T20:31:45.529 INFO:tasks.workunit.client.0.smithi070.stdout:3/918: mknod d7/d15/d1e/d60/d111/c121 0 2024-09-20T20:31:45.536 INFO:tasks.workunit.client.0.smithi070.stdout:3/919: truncate f4 2726176 0 2024-09-20T20:31:45.537 INFO:tasks.workunit.client.0.smithi070.stdout:3/920: symlink d7/d15/d1a/d80/d8e/d11f/l122 0 2024-09-20T20:31:45.537 INFO:tasks.workunit.client.0.smithi070.stdout:3/921: unlink d7/d15/d1a/d48/d66/de7/lf9 0 2024-09-20T20:31:45.538 INFO:tasks.workunit.client.0.smithi070.stdout:3/922: chown d7/d15/d1a/d80/dd9 463 1 2024-09-20T20:31:45.542 INFO:tasks.workunit.client.0.smithi070.stdout:3/923: write d7/d15/d1a/d48/d66/d69/fef [61699,1276] 0 2024-09-20T20:31:45.543 INFO:tasks.workunit.client.0.smithi070.stdout:3/924: write d7/d15/d1a/d4a/fc5 [3084063,18070] 0 2024-09-20T20:31:45.548 INFO:tasks.workunit.client.0.smithi070.stdout:3/925: dwrite d7/d15/f4f [0,4194304] 0 2024-09-20T20:31:45.550 INFO:tasks.workunit.client.0.smithi070.stdout:3/926: creat d7/d15/d1a/d4a/f123 x:0 0 0 2024-09-20T20:31:45.555 INFO:tasks.workunit.client.0.smithi070.stdout:3/927: truncate d7/d15/d1a/d4a/f4d 3339094 0 2024-09-20T20:31:45.556 INFO:tasks.workunit.client.0.smithi070.stdout:3/928: link d7/d15/d1a/dfb/c63 d7/d15/d1a/d4a/c124 0 2024-09-20T20:31:45.557 INFO:tasks.workunit.client.0.smithi070.stdout:3/929: chown d7/d15/d1a/d48/d66/cf8 87637616 1 2024-09-20T20:31:45.557 INFO:tasks.workunit.client.0.smithi070.stdout:3/930: symlink d7/d15/d1a/d80/d8e/d11f/l125 0 2024-09-20T20:31:45.558 INFO:tasks.workunit.client.0.smithi070.stdout:3/931: symlink d7/d15/d1a/d48/d66/d69/d99/d10c/l126 0 2024-09-20T20:31:45.559 INFO:tasks.workunit.client.0.smithi070.stdout:3/932: creat d7/d15/d1a/d4a/d51/d5b/d88/f127 x:0 0 0 2024-09-20T20:31:45.560 INFO:tasks.workunit.client.0.smithi070.stdout:3/933: chown d7/d15/d1e/d65/d9d/fb2 0 1 2024-09-20T20:31:45.560 INFO:tasks.workunit.client.0.smithi070.stdout:3/934: readlink d7/d15/d1a/d48/d66/d69/d10a/l112 0 2024-09-20T20:31:45.563 INFO:tasks.workunit.client.0.smithi070.stdout:3/935: read d7/d15/d1a/ff5 [134760,128902] 0 2024-09-20T20:31:45.563 INFO:tasks.workunit.client.0.smithi070.stdout:3/936: creat d7/d15/d1e/d65/d9d/f128 x:0 0 0 2024-09-20T20:31:45.566 INFO:tasks.workunit.client.0.smithi070.stdout:3/937: dread d7/d15/fc2 [0,4194304] 0 2024-09-20T20:31:45.567 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:45.559+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:45.572 INFO:tasks.workunit.client.0.smithi070.stdout:3/938: dread d7/d15/d1a/d4a/d51/d5b/d88/fe6 [0,4194304] 0 2024-09-20T20:31:45.573 INFO:tasks.workunit.client.0.smithi070.stdout:3/939: truncate d7/d15/d1a/d48/d66/d69/f8d 1433820 0 2024-09-20T20:31:45.590 INFO:tasks.workunit.client.0.smithi070.stdout:3/940: dread d7/d15/d1a/d48/d66/d69/feb [0,4194304] 0 2024-09-20T20:31:45.591 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:45.591 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:45.591 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:45.591 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:45.592 INFO:tasks.workunit.client.0.smithi070.stdout:3/941: rename d7/d15/d1a/d48/d66/d69/d13/f2e to d7/d15/d1a/d48/d66/d69/d13/f129 0 2024-09-20T20:31:45.598 INFO:tasks.workunit.client.0.smithi070.stdout:3/942: dwrite d7/d15/d1a/d48/d66/d69/d99/dcd/fce [0,4194304] 0 2024-09-20T20:31:45.598 INFO:tasks.workunit.client.0.smithi070.stdout:3/943: fdatasync d7/d15/d1a/d4a/d51/d5b/d88/fe6 0 2024-09-20T20:31:45.599 INFO:tasks.workunit.client.0.smithi070.stdout:3/944: write d7/d15/d1a/d48/d66/d69/d13/d1d/f7b [3321872,98421] 0 2024-09-20T20:31:45.604 INFO:tasks.workunit.client.0.smithi070.stdout:3/945: dwrite d7/d15/d1a/f44 [4194304,4194304] 0 2024-09-20T20:31:45.605 INFO:tasks.workunit.client.0.smithi070.stdout:3/946: fsync d7/d15/d1a/d4a/d51/d5b/d88/f120 0 2024-09-20T20:31:45.606 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:45.609 INFO:tasks.workunit.client.0.smithi070.stdout:3/947: dwrite d7/d15/d1a/f44 [0,4194304] 0 2024-09-20T20:31:45.611 INFO:tasks.workunit.client.0.smithi070.stdout:3/948: mknod d7/d15/d1a/d48/d66/d69/d99/dcd/c12a 0 2024-09-20T20:31:45.616 INFO:tasks.workunit.client.0.smithi070.stdout:3/949: dwrite d7/fd7 [0,4194304] 0 2024-09-20T20:31:45.617 INFO:tasks.workunit.client.0.smithi070.stdout:3/950: mkdir d7/d15/d1e/d60/de9/d12b 0 2024-09-20T20:31:45.668 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:45.663+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:45.703 INFO:tasks.workunit.client.0.smithi070.stdout:3/951: sync 2024-09-20T20:31:45.706 INFO:tasks.workunit.client.0.smithi070.stdout:3/952: write d7/d15/d1a/d4a/d51/d5b/fb3 [2583186,13328] 0 2024-09-20T20:31:45.707 INFO:tasks.workunit.client.0.smithi070.stdout:3/953: symlink d7/d15/d1e/d65/l12c 0 2024-09-20T20:31:45.709 INFO:tasks.workunit.client.0.smithi070.stdout:3/954: truncate d7/d15/fa6 253889 0 2024-09-20T20:31:45.715 INFO:tasks.workunit.client.0.smithi070.stdout:3/955: write d7/d15/d1a/dfb/f59 [2539366,77175] 0 2024-09-20T20:31:45.721 INFO:tasks.workunit.client.0.smithi070.stdout:3/956: dread d7/d15/d1a/f44 [0,4194304] 0 2024-09-20T20:31:45.723 INFO:tasks.workunit.client.0.smithi070.stdout:3/957: mknod d7/d15/d1e/d60/df1/c12d 0 2024-09-20T20:31:45.725 INFO:tasks.workunit.client.0.smithi070.stdout:3/958: dread - d7/d15/d1a/d48/d66/d69/d13/d1d/f118 zero size 2024-09-20T20:31:45.726 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:45.726 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:45.727 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:45.727 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:45.727 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:45.727 INFO:tasks.workunit.client.0.smithi070.stdout:3/959: rename d7/d15/d1a/lac to d7/d15/d1a/d4a/d51/d5b/d88/l12e 0 2024-09-20T20:31:45.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:45.742 INFO:tasks.workunit.client.0.smithi070.stdout:3/960: dread d7/fd [0,4194304] 0 2024-09-20T20:31:45.743 INFO:tasks.workunit.client.0.smithi070.stdout:3/961: mknod d7/d15/d1e/c12f 0 2024-09-20T20:31:45.745 INFO:tasks.workunit.client.0.smithi070.stdout:3/962: mkdir d7/d15/d1a/dfb/d75/d130 0 2024-09-20T20:31:45.747 INFO:tasks.workunit.client.0.smithi070.stdout:3/963: creat d7/d15/d1a/d48/d66/d69/d13/d1d/f131 x:0 0 0 2024-09-20T20:31:45.748 INFO:tasks.workunit.client.0.smithi070.stdout:3/964: write d7/d15/d1e/da9/fbd [2406410,96310] 0 2024-09-20T20:31:45.768 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:45.763+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:45.773 INFO:tasks.workunit.client.0.smithi070.stdout:3/965: dread d7/d15/d1a/d48/d66/d69/f19 [0,4194304] 0 2024-09-20T20:31:45.774 INFO:tasks.workunit.client.0.smithi070.stdout:3/966: symlink d7/d15/d1a/l132 0 2024-09-20T20:31:45.787 INFO:tasks.workunit.client.0.smithi070.stdout:3/967: dwrite d7/d15/d1a/d48/d66/d69/d13/d1d/f7b [0,4194304] 0 2024-09-20T20:31:45.791 INFO:tasks.workunit.client.0.smithi070.stdout:3/968: mknod d7/d15/d1e/d60/df1/d10e/c133 0 2024-09-20T20:31:45.794 INFO:tasks.workunit.client.0.smithi070.stdout:3/969: creat d7/d15/d1a/d4a/f134 x:0 0 0 2024-09-20T20:31:45.796 INFO:tasks.workunit.client.0.smithi070.stdout:3/970: truncate d7/d15/d1a/d48/d66/d69/f114 811774 0 2024-09-20T20:31:45.804 INFO:tasks.workunit.client.0.smithi070.stdout:3/971: truncate d7/d15/d1e/d65/d9d/fb2 792114 0 2024-09-20T20:31:45.808 INFO:tasks.workunit.client.0.smithi070.stdout:3/972: truncate d7/d15/d1a/d48/d66/d69/ffa 1673155 0 2024-09-20T20:31:45.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910936637000001, 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.867 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.868 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.868 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.868 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.869 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.869 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:45.869 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.869 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.869 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.869 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:45.870 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.871 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:45.872 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.873 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.874 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910885126, 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.875 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:45.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910838672000001, 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:45.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:45.885 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910800471, 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:45.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.890 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910768892, 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:45.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910717397999999, 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.896 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:45.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910683053, 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.904 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.905 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.906 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910652154999999, 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:45.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.908 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.909 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910603091, 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.912 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.915 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.917 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.910570326, 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.918 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:45.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.892360554, 2024-09-20T20:31:45.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:45.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:45.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.928 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.891804326000001, 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.929 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:45.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.891309175, 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.934 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:45.939 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.890643538999999, 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:45.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:45.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:45.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.890048844000001, 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:45.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:45.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.88992232, 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:45.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:45.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.889839035, 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:45.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.888858581999999, 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.962 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.963 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.967 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.888747601, 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.968 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:45.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.972 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 13.883160597, 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:45.973 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:45.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:45.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:45.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:45.978 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:45.980 INFO:tasks.workunit.client.0.smithi070.stdout:3/973: sync 2024-09-20T20:31:45.980 INFO:tasks.workunit.client.0.smithi070.stdout:3/974: link d7/ced d7/d15/d1e/d60/c135 0 2024-09-20T20:31:45.980 INFO:tasks.workunit.client.0.smithi070.stdout:3/975: read d7/d15/d1a/d48/d66/d69/ffa [379262,43557] 0 2024-09-20T20:31:45.980 INFO:tasks.workunit.client.0.smithi070.stdout:3/976: sync 2024-09-20T20:31:45.980 INFO:tasks.workunit.client.0.smithi070.stdout:3/977: dread d7/fd [0,4194304] 0 2024-09-20T20:31:45.981 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:45.981 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:45.977+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:46.056 INFO:tasks.workunit.client.0.smithi070.stdout:3/978: sync 2024-09-20T20:31:46.060 INFO:tasks.workunit.client.0.smithi070.stdout:3/979: link d7/d15/d1a/d48/d66/d69/d13/d1d/l81 d7/d15/d1a/d4a/l136 0 2024-09-20T20:31:46.071 INFO:tasks.workunit.client.0.smithi070.stdout:3/980: dwrite d7/d15/d1a/d48/d66/fc0 [0,4194304] 0 2024-09-20T20:31:46.074 INFO:tasks.workunit.client.0.smithi070.stdout:3/981: mkdir d7/d15/d1a/d80/dd8/d137 0 2024-09-20T20:31:46.081 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:46.077+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:46.088 INFO:tasks.workunit.client.0.smithi070.stdout:3/982: dwrite d7/f9 [8388608,4194304] 0 2024-09-20T20:31:46.090 INFO:tasks.workunit.client.0.smithi070.stdout:3/983: write d7/d15/d1e/d60/fc1 [545818,107690] 0 2024-09-20T20:31:46.092 INFO:tasks.workunit.client.0.smithi070.stdout:3/984: symlink d7/d15/d1a/d80/dd9/l138 0 2024-09-20T20:31:46.094 INFO:tasks.workunit.client.0.smithi070.stdout:3/985: mknod d7/d15/d1a/d48/d66/c139 0 2024-09-20T20:31:46.104 INFO:tasks.workunit.client.0.smithi070.stdout:3/986: dread d7/d15/d1a/d48/d66/d69/d10a/fb8 [0,4194304] 0 2024-09-20T20:31:46.105 INFO:tasks.workunit.client.0.smithi070.stdout:3/987: fdatasync d7/f14 0 2024-09-20T20:31:46.107 INFO:tasks.workunit.client.0.smithi070.stdout:3/988: mkdir d7/d15/d1a/d4a/d51/d5b/d88/d13a 0 2024-09-20T20:31:46.118 INFO:tasks.workunit.client.0.smithi070.stdout:3/989: dwrite d7/d15/d1a/d48/d66/fc0 [0,4194304] 0 2024-09-20T20:31:46.120 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:46.120 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:46.121 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:46.121 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:46.122 INFO:tasks.workunit.client.0.smithi070.stdout:3/990: mknod d7/d15/d1a/d4a/d51/de2/d119/c13b 0 2024-09-20T20:31:46.123 INFO:tasks.workunit.client.0.smithi070.stdout:3/991: symlink d7/d15/d1a/d80/l13c 0 2024-09-20T20:31:46.134 INFO:tasks.workunit.client.0.smithi070.stdout:3/992: dwrite d7/ff2 [0,4194304] 0 2024-09-20T20:31:46.136 INFO:tasks.workunit.client.0.smithi070.stdout:3/993: write d7/d15/d1a/d4a/d51/d5b/f6c [4251401,94772] 0 2024-09-20T20:31:46.138 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:46.143 INFO:tasks.workunit.client.0.smithi070.stdout:3/994: rename d7/d15/d1a/d48/c100 to d7/d15/d1a/d4a/d51/de2/c13d 0 2024-09-20T20:31:46.144 INFO:tasks.workunit.client.0.smithi070.stdout:3/995: write d7/d15/d1a/d48/d66/d69/f114 [1818480,30677] 0 2024-09-20T20:31:46.145 INFO:tasks.workunit.client.0.smithi070.stdout:3/996: creat d7/d15/d1a/d4a/d51/de2/f13e x:0 0 0 2024-09-20T20:31:46.146 INFO:tasks.workunit.client.0.smithi070.stdout:3/997: mknod d7/d15/d1a/d4a/c13f 0 2024-09-20T20:31:46.147 INFO:tasks.workunit.client.0.smithi070.stdout:3/998: chown d7/d15/d1a/d4a/lcc 566285 1 2024-09-20T20:31:46.149 INFO:tasks.workunit.client.0.smithi070.stdout:3/999: unlink d7/d15/d1a/d48/d66/d69/d13/d1d/l10b 0 2024-09-20T20:31:46.152 INFO:tasks.workunit.client.0.smithi070.stderr:+ rm -rf -- ./tmp.XDIi8MGPiX 2024-09-20T20:31:46.181 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:46.176+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:46.260 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:46.260 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:46.260 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:46.274 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:46.282 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:46.276+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:46.383 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:31:46.380+0000 7fc76e267640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22914) UID: 0 2024-09-20T20:31:46.404 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:373 3.2 3:4272d415:::200.0000000b:head [write 778889~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4460831210000009, 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105808761, 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953111+0000", 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953113+0000", 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5999999999999999e-06 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953122+0000", 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0729999999999994e-06 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953145+0000", 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3312999999999999e-05 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953162+0000", 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6402999999999999e-05 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054491+0000", 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10132910000000001 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054636+0000", 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014555699999999999 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.054826+0000", 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019007299999999999 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058425+0000", 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035988589999999998 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058640+0000", 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021432800000000001 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058775+0000", 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013597500000000001 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058920+0000", 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014448 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:374 3.2 3:4272d415:::200.0000000b:head [write 780291~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:46.410 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4452662249999992, 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.106652574, 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953928+0000", 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953930+0000", 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1900000000000002e-06 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953942+0000", 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1355999999999999e-05 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953968+0000", 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6380000000000002e-05 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.953983+0000", 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4686e-05 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055691+0000", 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101707783 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055801+0000", 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110568 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.055978+0000", 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000177119 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.058598+0000", 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002620196 2024-09-20T20:31:46.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060327+0000", 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017290210000000001 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060476+0000", 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000148527 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060581+0000", 2024-09-20T20:31:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010474799999999999 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:375 3.2 3:4272d415:::200.0000000b:head [write 781692~2432 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4434211250000004, 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.106557868, 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955773+0000", 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955776+0000", 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4569999999999999e-06 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955790+0000", 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4532000000000001e-05 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955845+0000", 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4401999999999999e-05 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.955887+0000", 2024-09-20T20:31:46.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2648999999999998e-05 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056678+0000", 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100791148 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056801+0000", 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012273399999999999 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.056976+0000", 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017484299999999999 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062015+0000", 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050385459999999996 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062053+0000", 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8569000000000003e-05 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062221+0000", 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016815299999999999 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062331+0000", 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010983499999999999 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:376 3.2 3:4272d415:::200.0000000b:head [write 784124~1407 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4431096120000007, 2024-09-20T20:31:46.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.108173241, 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956085+0000", 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956087+0000", 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0870000000000001e-06 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956116+0000", 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9042000000000001e-05 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956142+0000", 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6452999999999999e-05 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956155+0000", 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2306e-05 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059009+0000", 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10285475199999999 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059206+0000", 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019710300000000001 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.059539+0000", 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033236600000000001 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062493+0000", 2024-09-20T20:31:46.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029542629999999999 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.063998+0000", 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001504921 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064139+0000", 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000141347 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064258+0000", 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000118601 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:377 3.2 3:4272d415:::200.0000000b:head [write 785531~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.442553771, 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.109408697, 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956641+0000", 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956643+0000", 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1299999999999999e-06 2024-09-20T20:31:46.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956654+0000", 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.115e-05 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956681+0000", 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6726000000000001e-05 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956695+0000", 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4893e-05 2024-09-20T20:31:46.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060694+0000", 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103998043 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.060878+0000", 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018448499999999999 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.061167+0000", 2024-09-20T20:31:46.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000289194 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065734+0000", 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045670190000000003 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065780+0000", 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5658999999999998e-05 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.065933+0000", 2024-09-20T20:31:46.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015302 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066049+0000", 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116378 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:378 3.2 3:4272d415:::200.0000000b:head [write 786941~2442 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4424485259999997, 2024-09-20T20:31:46.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.111232968, 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956746+0000", 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956747+0000", 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7999999999999993e-07 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956760+0000", 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3696000000000001e-05 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956774+0000", 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3266e-05 2024-09-20T20:31:46.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.956783+0000", 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8899999999999996e-06 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062642+0000", 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10585894999999999 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.062863+0000", 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022100200000000001 2024-09-20T20:31:46.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.063215+0000", 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035195000000000002 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066222+0000", 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003007904 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067697+0000", 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014745629999999999 2024-09-20T20:31:46.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067866+0000", 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000168849 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.067979+0000", 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011291800000000001 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.437 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:379 3.2 3:4272d415:::200.0000000b:head [write 789383~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4421704930000008, 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11286650500000001, 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957024+0000", 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957025+0000", 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.33e-06 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957037+0000", 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1936999999999999e-05 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957056+0000", 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8459999999999999e-05 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957066+0000", 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0266e-05 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064381+0000", 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107315483 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064643+0000", 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026130800000000003 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.064877+0000", 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023413899999999999 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069614+0000", 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0047370750000000003 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069654+0000", 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0541999999999999e-05 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069786+0000", 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013186400000000001 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069890+0000", 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104101 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:380 3.2 3:4272d415:::200.0000000b:head [write 790782~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4420548380000007, 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11330689300000001, 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957140+0000", 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957141+0000", 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3400000000000001e-06 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957150+0000", 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8230000000000001e-06 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957171+0000", 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1331999999999998e-05 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957231+0000", 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9698999999999999e-05 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066361+0000", 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.109130173 2024-09-20T20:31:46.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066587+0000", 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022618599999999999 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.066926+0000", 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033860299999999998 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.069996+0000", 2024-09-20T20:31:46.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003070672 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070196+0000", 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019970599999999999 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070339+0000", 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000143067 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070446+0000", 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107292 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:381 3.2 3:4272d415:::200.0000000b:head [write 792697~6542 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4419154180000007, 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117989833, 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.448 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957279+0000", 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957286+0000", 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0829999999999998e-06 2024-09-20T20:31:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957305+0000", 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9216e-05 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957321+0000", 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5787e-05 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.957331+0000", 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8500000000000006e-06 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068072+0000", 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11074125899999999 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068198+0000", 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126007 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.068391+0000", 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019251899999999999 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070149+0000", 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017585910000000001 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.074999+0000", 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048502629999999996 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075145+0000", 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014563 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075269+0000", 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123628 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:382 3.2 3:4272d415:::200.0000000b:head [write 799239~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.453 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4408020120000007, 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117478417, 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958392+0000", 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958395+0000", 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1030000000000002e-06 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958409+0000", 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4059999999999999e-05 2024-09-20T20:31:46.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958442+0000", 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2085999999999997e-05 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958466+0000", 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070538+0000", 2024-09-20T20:31:46.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11207286399999999 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.070770+0000", 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023195799999999999 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.071118+0000", 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034751299999999998 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075415+0000", 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042975080000000002 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075621+0000", 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000205622 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075757+0000", 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608399999999999 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075871+0000", 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113577 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:383 3.2 3:4272d415:::200.0000000b:head [write 800641~1918 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4406258130000005, 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11757527299999999, 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.459 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958569+0000", 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958575+0000", 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6540000000000002e-06 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958586+0000", 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1293e-05 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958612+0000", 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5792e-05 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958634+0000", 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1287000000000001e-05 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072108+0000", 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.113474767 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072345+0000", 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000237178 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.072615+0000", 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026950800000000001 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075583+0000", 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002967679 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.075895+0000", 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031276699999999998 2024-09-20T20:31:46.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076020+0000", 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012504700000000001 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076144+0000", 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123301 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:384 3.2 3:4272d415:::200.0000000b:head [write 802559~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4405341210000007, 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.119348309, 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:46.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958660+0000", 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958662+0000", 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3859999999999999e-06 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958678+0000", 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6779999999999999e-05 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958705+0000", 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6403000000000001e-05 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.958732+0000", 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6818999999999999e-05 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073242+0000", 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.114510876 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073474+0000", 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023108499999999999 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.073807+0000", 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033322700000000001 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076255+0000", 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024479860000000001 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.077749+0000", 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014944820000000001 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.077892+0000", 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014243700000000001 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078009+0000", 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116828 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:385 3.2 3:4272d415:::200.0000000b:head [write 804479~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:46.470 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4400590379999993, 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121337555, 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959135+0000", 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959137+0000", 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0499999999999999e-06 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959165+0000", 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7256000000000001e-05 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959238+0000", 2024-09-20T20:31:46.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2974999999999998e-05 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959259+0000", 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1005999999999998e-05 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076373+0000", 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.117114513 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076598+0000", 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022489100000000001 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.076941+0000", 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00034298999999999999 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080222+0000", 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032812589999999999 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080337+0000", 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115148 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080411+0000", 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3891000000000001e-05 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080473+0000", 2024-09-20T20:31:46.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1575999999999995e-05 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:386 3.2 3:4272d415:::200.0000000b:head [write 806408~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4398841220000005, 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12330429499999999, 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959310+0000", 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959312+0000", 2024-09-20T20:31:46.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1129999999999999e-06 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959322+0000", 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5570000000000001e-06 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959386+0000", 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3805000000000003e-05 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959407+0000", 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1583e-05 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078149+0000", 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.11874132900000001 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078289+0000", 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014025999999999999 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.078474+0000", 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018509599999999999 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080317+0000", 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001842752 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082471+0000", 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021539160000000001 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082550+0000", 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9515e-05 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082615+0000", 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4369000000000007e-05 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:387 3.2 3:4272d415:::200.0000000b:head [write 807809~2445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4397628949999994, 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12458949499999999, 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959431+0000", 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959433+0000", 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.364e-06 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959496+0000", 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2744999999999996e-05 2024-09-20T20:31:46.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959525+0000", 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9346e-05 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959541+0000", 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6143000000000001e-05 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079333+0000", 2024-09-20T20:31:46.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.119791804 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079451+0000", 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117821 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.079630+0000", 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017930999999999999 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082759+0000", 2024-09-20T20:31:46.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031291050000000001 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083884+0000", 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011246699999999999 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083957+0000", 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3192e-05 2024-09-20T20:31:46.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084021+0000", 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3995e-05 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:388 3.2 3:4272d415:::200.0000000b:head [write 810254~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4396291639999994, 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12698309799999999, 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.487 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959565+0000", 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959566+0000", 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.316e-06 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959584+0000", 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7183000000000001e-05 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959603+0000", 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9474e-05 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959618+0000", 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4491999999999999e-05 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080537+0000", 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120919765 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080655+0000", 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011762 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.080836+0000", 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018099699999999999 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083744+0000", 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029083220000000001 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086406+0000", 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026616650000000001 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086484+0000", 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7511999999999999e-05 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086548+0000", 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4752000000000006e-05 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:389 3.2 3:4272d415:::200.0000000b:head [write 811657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4395340999999995, 2024-09-20T20:31:46.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12703187799999999, 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959660+0000", 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959661+0000", 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7000000000000004e-07 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959678+0000", 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7357e-05 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959691+0000", 2024-09-20T20:31:46.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2176e-05 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959699+0000", 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4030000000000007e-06 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081607+0000", 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121908401 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081736+0000", 2024-09-20T20:31:46.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857999999999999 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.081922+0000", 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018580300000000001 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083854+0000", 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019327669999999999 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086573+0000", 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027184370000000002 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086642+0000", 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8841e-05 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086692+0000", 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0343000000000002e-05 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:390 3.2 3:4272d415:::200.0000000b:head [write 813056~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4394832209999997, 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12969470299999999, 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:46.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959711+0000", 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959712+0000", 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4e-07 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959716+0000", 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2570000000000001e-06 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959733+0000", 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6903000000000001e-05 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959744+0000", 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.049e-05 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082847+0000", 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123103439 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.082956+0000", 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010941400000000001 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.083149+0000", 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000192843 2024-09-20T20:31:46.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086278+0000", 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031285480000000001 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089265+0000", 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029868920000000001 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089341+0000", 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6075000000000006e-05 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089406+0000", 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5001999999999999e-05 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 814477~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.439440952, 2024-09-20T20:31:46.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12979708400000001, 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959753+0000", 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959754+0000", 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4000000000000001e-07 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959766+0000", 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2403e-05 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959782+0000", 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5224e-05 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.959791+0000", 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2760000000000006e-06 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084105+0000", 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.124313734 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084235+0000", 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129877 2024-09-20T20:31:46.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.084418+0000", 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018307999999999999 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.086381+0000", 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019628890000000002 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089429+0000", 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030487800000000001 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089499+0000", 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9791999999999999e-05 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089550+0000", 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1388999999999999e-05 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 816399~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.4306996240000007, 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12436905700000001, 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:46.509 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968495+0000", 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:46.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968497+0000", 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1859999999999999e-06 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968511+0000", 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3740000000000001e-05 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968540+0000", 2024-09-20T20:31:46.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9039000000000001e-05 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:36.968566+0000", 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6703000000000002e-05 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085239+0000", 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.116672501 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085380+0000", 2024-09-20T20:31:46.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014088999999999999 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.085619+0000", 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023910899999999999 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.089129+0000", 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003510567 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092708+0000", 2024-09-20T20:31:46.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003578566 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092798+0000", 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0241000000000006e-05 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:37.092864+0000", 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5514999999999999e-05 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:46.515 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:46.516 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:46.511+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:46.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:31:46.565 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-20T20:31:46.565 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:31:46.565 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-09-20T20:31:46.565 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:31:46.566 INFO:teuthology.orchestra.console.smithi079:Power off 2024-09-20T20:31:46.566 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-20T20:31:46.588 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2024-09-20T20:31:46.616 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:46.611+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:46.648 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:31:46.649 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:46.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-20T20:31:46.717 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:46.713+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:46.783 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:46.784 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:31:46.784 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-20T20:31:46.784 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-20T20:31:46.784 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:46.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-20T20:31:46.819 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:46.811+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:46.820 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:31:46.919 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:46.915+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:46.925 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:31:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-20T20:31:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-20T20:31:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-20T20:31:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.932978026, 2024-09-20T20:31:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036531337999999997, 2024-09-20T20:31:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986855+0000", 2024-09-20T20:31:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986858+0000", 2024-09-20T20:31:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0699999999999998e-06 2024-09-20T20:31:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.986872+0000", 2024-09-20T20:31:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3713999999999999e-05 2024-09-20T20:31:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987155+0000", 2024-09-20T20:31:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028294399999999998 2024-09-20T20:31:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987187+0000", 2024-09-20T20:31:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2416000000000003e-05 2024-09-20T20:31:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002665+0000", 2024-09-20T20:31:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015477964 2024-09-20T20:31:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.002936+0000", 2024-09-20T20:31:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027096800000000001 2024-09-20T20:31:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.003873+0000", 2024-09-20T20:31:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00093691900000000003 2024-09-20T20:31:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.009913+0000", 2024-09-20T20:31:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060400970000000003 2024-09-20T20:31:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023202+0000", 2024-09-20T20:31:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013288957000000001 2024-09-20T20:31:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023289+0000", 2024-09-20T20:31:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6996999999999994e-05 2024-09-20T20:31:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023387+0000", 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7292000000000003e-05 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.932601072, 2024-09-20T20:31:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036850339000000003, 2024-09-20T20:31:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987232+0000", 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987234+0000", 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987245+0000", 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987271+0000", 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5522999999999999e-05 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987295+0000", 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4113000000000001e-05 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004608+0000", 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017313496000000001 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.004919+0000", 2024-09-20T20:31:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031012699999999999 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.005274+0000", 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035529099999999998 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011909+0000", 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066352690000000001 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.023494+0000", 2024-09-20T20:31:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011584624 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024023+0000", 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052909300000000001 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024083+0000", 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9695999999999999e-05 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.93249702999999, 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037099129000000002, 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987336+0000", 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987338+0000", 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987346+0000", 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-20T20:31:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.987367+0000", 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1163999999999999e-05 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988397+0000", 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010304419999999999 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006519+0000", 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018121103 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.006851+0000", 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033267700000000003 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.007140+0000", 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028833800000000002 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.011926+0000", 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047859360000000002 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024212+0000", 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012286267 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024343+0000", 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130882 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.024435+0000", 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2659999999999997e-05 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.931107767, 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036445572000000002, 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988725+0000", 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988727+0000", 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.17e-06 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988773+0000", 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.676e-05 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988794+0000", 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0772999999999999e-05 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988813+0000", 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.874e-05 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010346+0000", 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021533212999999999 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010541+0000", 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195322 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.010812+0000", 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000270971 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.014713+0000", 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039006409999999998 2024-09-20T20:31:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025025+0000", 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010312333 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025099+0000", 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4056999999999999e-05 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025171+0000", 2024-09-20T20:31:46.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1592000000000002e-05 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.930999224, 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037846657999999998, 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988834+0000", 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988835+0000", 2024-09-20T20:31:46.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.19e-06 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988841+0000", 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988860+0000", 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8955999999999999e-05 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988879+0000", 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8196e-05 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015352+0000", 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026473772999999999 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.015564+0000", 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211418 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.016020+0000", 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000456377 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.021756+0000", 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057357650000000003 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026550+0000", 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047938410000000001 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026623+0000", 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3528999999999993e-05 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026681+0000", 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7352999999999998e-05 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.961 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.930933938, 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037980355, 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988899+0000", 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988900+0000", 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988907+0000", 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7900000000000002e-06 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988926+0000", 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8363e-05 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:54.988940+0000", 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.468e-05 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019312+0000", 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030371339000000001 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.019524+0000", 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021226200000000001 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.020257+0000", 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073337700000000001 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.025220+0000", 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049625820000000001 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026752+0000", 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015326249999999999 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026822+0000", 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9397e-05 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:29:55.026880+0000", 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7776999999999999e-05 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:9757 4.3a 4:5e14edba:::10000002cd2.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.083969561, 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039178256000000002, 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9757 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835864+0000", 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.835867+0000", 2024-09-20T20:31:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8899999999999999e-06 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840142+0000", 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042754359999999996 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840177+0000", 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5045000000000001e-05 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840192+0000", 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4922e-05 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840396+0000", 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840663+0000", 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026629300000000002 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.840888+0000", 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022530200000000001 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.872083+0000", 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031194700999999998 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.874767+0000", 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002683904 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.874918+0000", 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015160600000000001 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:33.875042+0000", 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012374 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:10774 4.3a 4:5e0e6c10:::100000030da.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:38.501065+0000", 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.4187685049999992, 2024-09-20T20:31:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036791427000000002, 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10774 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.501065+0000", 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.501065+0000", 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.501066+0000", 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3060000000000001e-06 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.508780+0000", 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077137960000000002 2024-09-20T20:31:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.508803+0000", 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3030000000000001e-05 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.508815+0000", 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.188e-05 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.508904+0000", 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9128000000000005e-05 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.509055+0000", 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015088600000000001 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.509261+0000", 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020597899999999999 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522839+0000", 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013577804000000001 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.537679+0000", 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014840549999999999 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.537770+0000", 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0797999999999994e-05 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.537856+0000", 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6269999999999999e-05 2024-09-20T20:31:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:10780 4.a 4:5357c130:::10000003141.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:38.516952+0000", 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.4028807830000005, 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040564015000000002, 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10780 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.516952+0000", 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.516952+0000", 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.516954+0000", 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8020000000000001e-06 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522706+0000", 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057515190000000001 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522727+0000", 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1151000000000001e-05 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522741+0000", 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3794e-05 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.522855+0000", 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000114449 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.523017+0000", 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016183500000000001 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.523162+0000", 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014510900000000001 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.525970+0000", 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002807763 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.557422+0000", 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031452200999999999 2024-09-20T20:31:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.557475+0000", 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3266000000000001e-05 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:38.557516+0000", 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1125999999999999e-05 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12089 4.2a 4:563a304a:::100000030f9.00000000:head [write 0~4194304 [2@2192397]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.073453+0000", 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.8463801259999997, 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039102537, 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12089 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.073453+0000", 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.073453+0000", 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.073454+0000", 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2860000000000001e-06 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085223+0000", 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011768096 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085263+0000", 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0924999999999999e-05 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085287+0000", 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3334999999999999e-05 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085391+0000", 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103834 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085469+0000", 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8837000000000004e-05 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.085594+0000", 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124578 2024-09-20T20:31:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.094370+0000", 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087759629999999995 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.112455+0000", 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018084939000000001 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.112504+0000", 2024-09-20T20:31:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9512000000000003e-05 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.112556+0000", 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1232e-05 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12095 4.2b 4:d69ce1d4:::1000000342f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.086762+0000", 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.8330713789999997, 2024-09-20T20:31:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036362173999999997, 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12095 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.086762+0000", 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.086762+0000", 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.086763+0000", 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.569999999999999e-07 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.104709+0000", 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017945875999999999 2024-09-20T20:31:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.104736+0000", 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7364000000000001e-05 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.104748+0000", 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2112e-05 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.104936+0000", 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018784699999999999 2024-09-20T20:31:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.105306+0000", 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037007199999999999 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.105589+0000", 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028299299999999999 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.120503+0000", 2024-09-20T20:31:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014913768000000001 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.122998+0000", 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024948499999999998 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.123060+0000", 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2612000000000003e-05 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.123124+0000", 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3723e-05 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12451 4.e 4:72c16fae:::100000030b2.00000002:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.621629+0000", 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.2982037809999998, 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036712871000000001, 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12451 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.621629+0000", 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.621629+0000", 2024-09-20T20:31:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.621631+0000", 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.105e-06 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629780+0000", 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081492600000000002 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629809+0000", 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9084000000000001e-05 2024-09-20T20:31:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629822+0000", 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3533000000000001e-05 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.629981+0000", 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015873499999999999 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.630264+0000", 2024-09-20T20:31:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028236800000000002 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.630675+0000", 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00041126599999999998 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658174+0000", 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027499440999999999 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658191+0000", 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6728e-05 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658266+0000", 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5091000000000003e-05 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.658342+0000", 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6260000000000005e-05 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4469.0:12449 4.16 e54/17 4:6beb77ce:::10000003426.00000000:head v 54'186, mlcod=54'184)", 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.626777+0000", 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.2930561530000002, 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038996825999999998, 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.626777+0000", 2024-09-20T20:31:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.626777+0000", 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.626779+0000", 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5600000000000001e-06 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.632778+0000", 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059994480000000001 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.632793+0000", 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4399999999999999e-05 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.632805+0000", 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2676e-05 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.651961+0000", 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019156197 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.652015+0000", 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3159999999999999e-05 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665742+0000", 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013727694 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.665774+0000", 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1690999999999999e-05 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12540 4.25 4:a72d0a59:::10000003358.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.777271+0000", 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.1425621850000001, 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051660642999999999, 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12540 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.777271+0000", 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.777271+0000", 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.777272+0000", 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7599999999999996e-07 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.788936+0000", 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011664529 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.788958+0000", 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1325999999999999e-05 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.788969+0000", 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1677e-05 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.789035+0000", 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5736999999999998e-05 2024-09-20T20:31:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.789136+0000", 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101143 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.789279+0000", 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014254200000000001 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.800199+0000", 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010920533 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.828871+0000", 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028671594000000002 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.828910+0000", 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8596000000000001e-05 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.828932+0000", 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.209e-05 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12652 4.a 4:521a33ef:::10000003133.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:41.903305+0000", 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.0165278679999998, 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037984942000000001, 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12652 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.903305+0000", 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.903305+0000", 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.903307+0000", 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0540000000000002e-06 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.911686+0000", 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083781700000000008 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.911726+0000", 2024-09-20T20:31:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0315999999999998e-05 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.911744+0000", 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8281e-05 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.911826+0000", 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1667000000000003e-05 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.911907+0000", 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1170999999999999e-05 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.912034+0000", 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000126644 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.916497+0000", 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044635869999999998 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.940802+0000", 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024304723 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.940890+0000", 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7678999999999999e-05 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:41.941290+0000", 2024-09-20T20:31:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040065000000000001 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12762 4.2b 4:d5496710:::100000033cf.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:42.054320+0000", 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8655130450000001, 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059499145000000003, 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12762 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.054320+0000", 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.054320+0000", 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.054322+0000", 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5030000000000001e-06 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.059735+0000", 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005413635 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.059760+0000", 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4922999999999998e-05 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.059774+0000", 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4005000000000001e-05 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.059886+0000", 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011192 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.060128+0000", 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024226900000000001 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.060303+0000", 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000174642 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.067309+0000", 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070061120000000001 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.113701+0000", 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046391905999999997 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.113767+0000", 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5497e-05 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.113819+0000", 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2732999999999998e-05 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:12776 4.c 4:32462b5b:::10000003545.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:42.064103+0000", 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8557299330000001, 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037373417999999999, 2024-09-20T20:31:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12776 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.064103+0000", 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.064103+0000", 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.064104+0000", 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9100000000000004e-07 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.074681+0000", 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010577332 2024-09-20T20:31:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.074694+0000", 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2361000000000001e-05 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.074700+0000", 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9959999999999999e-06 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.074798+0000", 2024-09-20T20:31:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8790999999999997e-05 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.075093+0000", 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000294734 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.075433+0000", 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034014100000000002 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.081264+0000", 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0058303260000000003 2024-09-20T20:31:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.101368+0000", 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020104638000000001 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.101422+0000", 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3653000000000003e-05 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.101477+0000", 2024-09-20T20:31:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4855000000000002e-05 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:13247 4.22 4:45e455a7:::10000003122.00000000:head [write 0~4194304 [2@94253]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:42.506473+0000", 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4133602490000001, 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037756522000000001, 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13247 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.506473+0000", 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.506473+0000", 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.506476+0000", 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0240000000000002e-06 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.517975+0000", 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011498944000000001 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.517998+0000", 2024-09-20T20:31:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2909e-05 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.518013+0000", 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5472999999999999e-05 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.518160+0000", 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000146236 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.518298+0000", 2024-09-20T20:31:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000138338 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.518466+0000", 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016788400000000001 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.522917+0000", 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044507619999999996 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.544034+0000", 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021117617000000002 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.544123+0000", 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9096000000000002e-05 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.544230+0000", 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106239 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:13395 4.35 4:ad7be3b1:::100000032df.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:42.661687+0000", 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.2581466749999999, 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039062759000000002, 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13395 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.661687+0000", 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.661687+0000", 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.661688+0000", 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7859999999999999e-06 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.671638+0000", 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0099501380000000007 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.671688+0000", 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9212999999999998e-05 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.671701+0000", 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.296e-05 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.671836+0000", 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013485999999999999 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.671978+0000", 2024-09-20T20:31:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014293699999999999 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.672238+0000", 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025953700000000001 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.684229+0000", 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011991144 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.700618+0000", 2024-09-20T20:31:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0163886 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.700691+0000", 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3685999999999999e-05 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.700749+0000", 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7898e-05 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4469.0:13523 4.22 4:469102ec:::10000003699.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-20T20:31:42.804302+0000", 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.1155310820000004, 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039343635000000002, 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4469", 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/2963134731", 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13523 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.804302+0000", 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.804302+0000", 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.804304+0000", 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5290000000000001e-06 2024-09-20T20:31:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.812809+0000", 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085050509999999996 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.812835+0000", 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6553000000000001e-05 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.812848+0000", 2024-09-20T20:31:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2391999999999999e-05 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.812909+0000", 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1037000000000005e-05 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.813050+0000", 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014106399999999999 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.813156+0000", 2024-09-20T20:31:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106303 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.819087+0000", 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059310639999999998 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.843510+0000", 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024422572 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.843572+0000", 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2457000000000002e-05 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-20T20:31:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-20T20:31:42.843646+0000", 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3613000000000001e-05 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-20T20:31:47.045 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:31:47.046 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:47.047 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:47.039+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:47.147 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:47.145+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:47.190 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:47.191 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:47.191 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:47.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:47.248 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:47.245+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:47.333 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:47.333 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:47.333 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:47.333 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:47.334 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:47.348 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:47.350 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:47.343+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:47.450 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:47.443+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:47.471 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51336315499999996, 2024-09-20T20:31:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:31:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:31:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:31:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:31:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:31:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:31:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:31:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:31:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:31:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:31:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:31:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:31:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:31:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:31:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:31:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:31:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:31:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:31:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:31:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:31:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:31:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:31:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:31:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51318034099999998, 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51310492200000002, 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:31:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:31:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51300739399999995, 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:31:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:31:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51293745199999996, 2024-09-20T20:31:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:31:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:31:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:31:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:31:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:31:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:31:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:31:47.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:31:47.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:31:47.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:31:47.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:31:47.509 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.510 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.510 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.510 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.510 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:47.510 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51284678100000003, 2024-09-20T20:31:47.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:31:47.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:31:47.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:31:47.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:31:47.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:31:47.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:31:47.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51246018800000004, 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.517 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:31:47.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:31:47.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:31:47.522 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.511806435, 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:31:47.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.528 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51170479700000004, 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:31:47.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:31:47.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:31:47.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51162864900000005, 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.534 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:31:47.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:31:47.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.539 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.51135786699999997, 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.540 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:31:47.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.546 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.50717101399999998, 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:31:47.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:31:47.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:31:47.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:31:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:31:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:31:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.50532092699999998, 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:31:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.558 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.559 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:47.559 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.50512827299999996, 2024-09-20T20:31:47.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:31:47.559 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.559 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.559 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.559 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:47.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:47.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:31:47.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:31:47.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:31:47.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:47.566 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.50484537200000001, 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:47.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:31:47.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:31:47.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.50184167199999996, 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:31:47.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:31:47.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:31:47.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:47.577 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.49874859399999999, 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:31:47.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.49836388399999998, 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.589 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:47.590 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.49639056199999998, 2024-09-20T20:31:47.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:31:47.590 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.590 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.590 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.590 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:47.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:47.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:31:47.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:31:47.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:31:47.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:31:47.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:31:47.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:31:47.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:31:47.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:31:47.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:31:47.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:31:47.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:31:47.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:31:47.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:31:47.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:31:47.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:31:47.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:31:47.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:31:47.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:31:47.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:31:47.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:31:47.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:31:47.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:31:47.600 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.600 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.600 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.601 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:47.601 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:47.601 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.496263864, 2024-09-20T20:31:47.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:31:47.602 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:47.602 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:47.602 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:47.602 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:47.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:47.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:47.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:47.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:47.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:47.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:47.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:31:47.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:31:47.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:47.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:31:47.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:31:47.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:47.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:47.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:31:47.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:31:47.609 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.609 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.609 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.609 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:47.609 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:47.609 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:47.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:47.611 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:47.612 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:47.609+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:47.712 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:47.709+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:47.745 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:47.745 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:47.745 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:47.745 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:47.760 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:47.777 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:47.777 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:47.798 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:47.799 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:47.813 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:47.807+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:47.824 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:47.913 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:47.909+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:47.921 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:47.922 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:47.936 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:48.014 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:48.007+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:48.110 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:48.110 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:48.115 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:48.111+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:48.128 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:48.216 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:48.213+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:48.287 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:48.288 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:48.302 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:48.347 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:48.343+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:48.417 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:48.411+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:48.425 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:48.425 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:48.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:48.527 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:48.523+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:48.606 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:48.606 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:48.619 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:48.615+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:48.620 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:48.719 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:48.717+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:48.754 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:48.754 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:48.769 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:48.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:31:48.855 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:48.853+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:48.921 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:48.917+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:48.938 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:48.939 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:48.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:49.039 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:49.037+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:49.123 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:49.121+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:49.139 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:49.139 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:49.159 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:49.218 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:31:49.224 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:49.219+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:49.297 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:49.297 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:49.312 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:49.356 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:49.351+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:49.427 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:49.425+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:49.478 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:49.478 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:49.494 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:49.527 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:49.525+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:49.615 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:49.615 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:49.628 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:49.629 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:49.625+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:49.729 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:49.727+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:49.761 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:49.761 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:49.776 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:49.830 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:49.823+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:49.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:49.902 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:49.902 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:49.917 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:49.930 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:49.923+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:49.984 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-20T20:31:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-20T20:31:50.002 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:50.002 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:50.025 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:50.025 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:50.031 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:50.029+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:50.045 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:50.045 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.091149821999998, 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.046 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.047 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:50.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:50.051 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.091098311, 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:50.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:50.054 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.055 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.056 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.091051857, 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:50.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.059 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.060 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.091013656000001, 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.062 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.063 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:50.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:50.065 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.066 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.067 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.090982077, 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.068 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:50.069 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.071 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.072 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.090930582999999, 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.073 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.074 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.075 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.076 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.077 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.078 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.090896237999999, 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.079 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.080 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.081 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:50.082 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.083 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.090865340000001, 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.084 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:50.085 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.087 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:50.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.090816276000002, 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.090 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.091 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.092 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.093 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:50.094 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.090783511000001, 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:50.095 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.096 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.097 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.098 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.099 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:50.100 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.072573738999999, 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.101 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.102 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.104 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.105 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.106 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.072017510999999, 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.107 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.108 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:50.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.071522359999999, 2024-09-20T20:31:50.112 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:50.113 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.114 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:50.115 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.116 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.117 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.070856723999999, 2024-09-20T20:31:50.118 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.119 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:50.120 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.121 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:50.122 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.123 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.070262028999998, 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.124 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.125 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.126 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.127 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:50.128 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.070135505, 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.129 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:50.130 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:50.131 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:50.132 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:50.133 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.070052220000001, 2024-09-20T20:31:50.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:50.136 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.138 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:50.139 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.069071767000001, 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.140 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:50.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:50.142 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.143 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:50.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.068960786000002, 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.146 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.147 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.148 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:50.150 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 18.063373781999999, 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:50.151 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:50.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:50.156 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:50.157 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:50.158 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:50.159 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:50.151+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:50.259 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:50.255+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:50.301 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:50.301 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:50.301 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:50.301 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:50.315 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:50.363 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:50.359+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:50.367 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-20T20:31:50.368 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-20T20:31:50.460 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:50.455+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:50.485 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:50.485 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:50.485 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:50.485 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:50.485 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:50.500 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:50.589 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T20:31:50.598 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:50.587+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:50.663 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:50.661+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7150331319999998, 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:31:50.673 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:31:50.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7148503179999999, 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.679 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:31:50.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:31:50.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.684 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.714774899, 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.689 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7146773710000001, 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.714607429, 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:31:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:31:50.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7145167580000003, 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:31:50.700 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:31:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.705 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7141301650000003, 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:31:50.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:31:50.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7134764119999999, 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.711 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:31:50.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:31:50.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:50.716 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.713374774, 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:31:50.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7132986260000003, 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.722 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:50.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:31:50.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.727 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.713027844, 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:50.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:31:50.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7088409909999998, 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.706990904, 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.738 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:31:50.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.743 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7067982499999999, 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:31:50.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.706515349, 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:31:50.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:31:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7035116490000002, 2024-09-20T20:31:50.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:31:50.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:31:50.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7004185710000002, 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:50.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:50.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:31:50.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:31:50.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.7000338610000001, 2024-09-20T20:31:50.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:31:50.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:31:50.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:31:50.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.6980605390000001, 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:50.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:31:50.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:31:50.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.6979338410000002, 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:50.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:31:50.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:31:50.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:50.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:50.781 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:50.783 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:50.779+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:50.784 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:50.784 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-09-20T20:31:50.884 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:50.879+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:50.912 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:50.912 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:50.913 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:50.913 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:50.926 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:50.984 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:50.979+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:51.049 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:51.050 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:51.050 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:51.050 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:51.050 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:51.063 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:51.107 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:51.105+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:51.185 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:51.181+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261675483000001, 2024-09-20T20:31:51.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:51.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.221 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261623971999999, 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.223 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:51.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261577517999999, 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.227 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:51.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.232 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261539317, 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:51.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:51.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:51.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261507737999999, 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:51.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:51.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:51.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261456244000001, 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.243 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:51.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:51.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:51.248 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261421898999998, 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:51.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:51.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261391001, 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:51.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:51.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261341937000001, 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:51.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:51.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.261309172000001, 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.264 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:51.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.243099399999998, 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:51.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:51.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:51.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.274 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.242543172000001, 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.275 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:51.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:51.279 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:51.280 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.242048020999999, 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:51.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:51.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.241382385000001, 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:51.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.240787690000001, 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.291 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.296 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.240661165999999, 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:51.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:51.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.240577881, 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:51.303 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:51.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:51.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.239597428, 2024-09-20T20:31:51.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:51.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:51.312 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.239486447000001, 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:51.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 19.233899442999999, 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.318 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:51.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:51.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:51.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:51.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:51.323 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:51.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:31:51.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:51.326 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:51.318+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:51.426 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:51.421+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:51.458 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:51.458 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:51.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:6686 3.1c 3.e92d9c9c (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:51.233766+0000", 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.22320085200000001, 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.22324751100000001, 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for peered", 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.233766+0000", 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.233766+0000", 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.233767+0000", 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2200000000000003e-07 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.233783+0000", 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6620999999999999e-05 2024-09-20T20:31:51.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.233802+0000", 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8601999999999999e-05 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.233811+0000", 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5699999999999999e-06 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.233881+0000", 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9035000000000006e-05 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.233889+0000", 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8899999999999996e-06 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.242017+0000", 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081279179999999996 2024-09-20T20:31:51.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for peered", 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:51.242032+0000", 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4959e-05 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 1 2024-09-20T20:31:51.463 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:51.474 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:51.526 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:51.521+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:51.598 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:51.598 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:51.598 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:51.598 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:51.598 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:51.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:51.655 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:51.650+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:51.729 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:51.722+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:51.732 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7754492840000005, 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:31:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:31:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.77526647, 2024-09-20T20:31:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:31:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:31:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7751910510000002, 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:31:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:31:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7750935229999998, 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:31:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:31:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:31:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7750235810000001, 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:31:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:31:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7749329100000004, 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:31:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7745463170000004, 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:31:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7738925639999996, 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:31:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7737909260000002, 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7737147780000004, 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:31:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7734439960000001, 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:31:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7692571429999999, 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:31:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:31:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7674070559999997, 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:31:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7672144020000005, 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:31:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:31:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7669315010000002, 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:31:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7639278010000004, 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:31:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:31:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7608347230000003, 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7604500129999998, 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:31:51.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:31:51.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:31:51.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:51.833 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7584766910000003, 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:51.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:31:51.838 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7583499930000004, 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:31:51.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:51.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:51.844 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:51.846 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:51.838+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:51.846 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:51.947 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:51.945+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:51.977 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:51.977 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:51.977 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:51.978 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:51.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:52.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:52.047 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:52.042+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:52.149 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:52.146+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:52.158 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:52.158 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:52.158 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:52.158 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:52.158 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:52.173 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:52.179 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:31:52.200 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:52.223 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:52.229 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:31:52.230 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:31:52.241 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:31:52.255 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:52.242+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:52.299 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:52.300 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:52.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:52.349 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:52.345+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:52.446 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:52.446 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:52.450 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:52.445+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:52.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:52.551 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:52.549+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:52.580 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:52.580 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:52.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:52.652 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:52.649+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:52.716 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:52.716 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:52.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:52.775 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:52.773+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:52.853 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:52.846+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:52.861 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:52.861 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:52.875 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:52.954 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:52.946+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:53.042 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:53.043 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:53.055 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:53.050+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:53.057 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:53.156 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:53.150+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:53.186 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:53.187 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:53.201 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:53.257 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:53.253+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:53.338 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:53.338 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:53.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:53.358 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:53.353+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:53.459 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:53.454+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:53.477 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:53.477 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:53.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:53.583 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:53.578+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:53.660 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:53.660 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:53.661 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:53.657+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:53.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:53.761 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:53.757+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:53.807 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:53.807 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:53.821 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:53.863 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:53.858+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:53.964 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:53.958+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:53.992 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:53.992 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:54.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:54.065 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:54.061+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:54.133 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:54.133 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:54.152 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:54.199 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:54.194+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:54.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:54.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:31:54.267 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:54.265+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:54.294 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:54.294 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:54.308 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:54.370 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:31:54.399 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:54.394+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:54.408 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:54.408 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:54.428 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:54.432 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:31:54.433 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:31:54.468 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:54.462+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:54.473 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:54.473 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:54.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:54.575 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:54.570+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.7007133100000003, 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.656 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:31:54.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:31:54.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:31:54.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.7005304959999998, 2024-09-20T20:31:54.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:31:54.665 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:31:54.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:31:54.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:31:54.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:31:54.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.671 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.700455077, 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:31:54.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:31:54.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:31:54.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:31:54.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:31:54.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:31:54.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:31:54.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:31:54.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:31:54.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:31:54.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:31:54.679 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.679 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.679 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.679 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.679 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:54.680 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.7003575489999996, 2024-09-20T20:31:54.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:31:54.680 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.680 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.680 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.680 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:54.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:54.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:31:54.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:31:54.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:31:54.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:31:54.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:31:54.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:31:54.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:31:54.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:31:54.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:31:54.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:31:54.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:31:54.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:31:54.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:31:54.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:31:54.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:31:54.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:31:54.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:31:54.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:31:54.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:31:54.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:31:54.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:31:54.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:31:54.690 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.690 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.690 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.691 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.691 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:54.691 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.7002876069999999, 2024-09-20T20:31:54.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:31:54.691 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.691 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:31:54.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:31:54.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:31:54.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.7001969360000002, 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.697 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:31:54.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:31:54.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6998103430000002, 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:31:54.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:31:54.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:31:54.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:31:54.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:31:54.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6991565900000003, 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:31:54.709 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:31:54.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:31:54.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:31:54.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.699054952, 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.715 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:31:54.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:31:54.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.720 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6989788040000002, 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:54.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6987080219999999, 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:54.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6945211689999997, 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.731 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:31:54.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:31:54.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.736 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6926710820000004, 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:31:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.741 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6924784280000003, 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:31:54.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:54.747 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.692195527, 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:31:54.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.752 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6891918270000001, 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:31:54.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:31:54.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:31:54.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:54.759 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6860987490000001, 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:54.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:31:54.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:54.765 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6857140390000005, 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:31:54.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6837407170000001, 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:31:54.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.6836140190000002, 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:54.776 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:31:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:54.782 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:54.783 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:54.784 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:54.781+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:54.785 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T20:31:54.884 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:54.878+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:54.894 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-09-20T20:31:54.920 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:54.920 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:54.920 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:54.920 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:54.934 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:54.985 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:54.981+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:55.051 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:55.052 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:55.052 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:55.052 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:55.052 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:55.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:55.111 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:55.109+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:55.187 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:55.178+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:55.259 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:31:55.262 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:55.262 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:55.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:55.262 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:55.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.262 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306912744000002, 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:55.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:55.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306861232999999, 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:55.268 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.270 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:55.273 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306814779, 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.275 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:55.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:55.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.279 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.280 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306776578000001, 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:55.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:55.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.286 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306744998999999, 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.288 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:55.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.291 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.293 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306693504999998, 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.298 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306659159999999, 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:55.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:55.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:55.304 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306628262, 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:55.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:55.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:55.309 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306579198000001, 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.310 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:55.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.315 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.306546433000001, 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:55.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:55.320 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.288336660999999, 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:55.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:55.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.325 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.326 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.287780433000002, 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:55.331 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.287285281999999, 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.332 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:55.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:55.337 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.286619645999998, 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:55.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.342 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.286024951000002, 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:55.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:55.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.285898426999999, 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:55.348 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:55.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:55.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.285815142000001, 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:55.358 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.284834689, 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:55.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:55.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:55.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.284723708000001, 2024-09-20T20:31:55.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:55.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:55.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:55.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 23.279136703999999, 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:55.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:55.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:55.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.375 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.375 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:55.375 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:55.375 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:55.377 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:55.377 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:55.373+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:55.477 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:55.473+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:55.509 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:55.509 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:55.510 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:55.510 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:55.523 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:55.578 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:55.573+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:55.641 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:55.641 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:55.642 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:55.642 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:55.642 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:55.655 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:55.679 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:55.677+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:55.779 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8221609309999991, 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:31:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:31:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8219781170000005, 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:31:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:31:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8219026980000006, 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.795 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8218051699999993, 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:55.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:31:55.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:31:55.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.801 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8217352279999997, 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:31:55.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8216445570000008, 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.807 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:31:55.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:31:55.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.812 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8212579640000008, 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8206042109999991, 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.818 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.823 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8205025730000006, 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:31:55.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:31:55.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:55.829 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8204264250000008, 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:55.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:31:55.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:31:55.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:31:55.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:31:55.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:31:55.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:31:55.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:31:55.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:31:55.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.835 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8201556429999997, 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:31:55.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:31:55.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.841 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8159687899999994, 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:31:55.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:31:55.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8141187030000001, 2024-09-20T20:31:55.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:31:55.852 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8139260489999991, 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:31:55.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:31:55.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8136431480000006, 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:31:55.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:31:55.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:31:55.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8106394479999999, 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:31:55.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8075463700000007, 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:31:55.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8071616600000002, 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.875 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:31:55.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:31:55.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:31:55.880 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8051883380000007, 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:31:55.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:31:55.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.8050616399999999, 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:55.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:55.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:55.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:55.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:55.892 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:55.895 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:55.895 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:55.889+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:55.996 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:55.990+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:56.027 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:56.027 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:56.027 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:31:56.027 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:56.041 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:56.097 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:56.090+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:56.175 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:56.175 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:56.175 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:56.175 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:56.175 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:56.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:56.198 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:56.190+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:56.298 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:56.290+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382552478000001, 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:56.339 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:56.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.344 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382500966999999, 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:56.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:56.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382454512999999, 2024-09-20T20:31:56.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:56.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382416312, 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.356 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.357 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:56.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:56.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:56.360 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382384732999999, 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.361 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.362 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:56.363 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:56.364 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.365 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:56.366 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382333239000001, 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.367 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:56.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:56.369 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:56.370 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382298894000002, 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.372 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:56.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.375 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.376 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382267995999999, 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:56.377 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.378 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:56.379 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:56.380 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.381 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.382 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382218932000001, 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.383 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.385 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:56.386 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.387 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.382186167, 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.388 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.389 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:56.390 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:56.391 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:56.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.393 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.363976395000002, 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.394 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.395 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.396 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.397 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:56.398 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.363420167000001, 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.399 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.400 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.401 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.402 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.362925015999998, 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.404 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:56.405 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.406 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.407 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:56.408 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.409 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.362259380000001, 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.410 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:56.411 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:56.412 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.413 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.414 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.361664685000001, 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:56.415 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:56.416 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.417 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.418 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.419 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.361538160999999, 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.420 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.421 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.422 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.423 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.424 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.361454876, 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.425 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.426 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:56.427 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.428 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.360474422999999, 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.430 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.431 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.432 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.433 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.434 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.360363442000001, 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.435 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.436 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.437 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.438 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.439 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 24.354776438000002, 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:56.440 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:56.441 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:56.442 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:56.443 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:56.444 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:56.445 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:56.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:31:56.447 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:56.448 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:56.441+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:56.548 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:56.545+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:31:56.581 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:56.581 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:56.581 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:56.581 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:56.596 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:56.602 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:56.624 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:56.624 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:56.627 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:31:56.627 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:31:56.648 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:56.642+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:56.722 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:56.722 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:56.736 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:56.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-20T20:31:56.749 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:56.745+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:56.851 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:56.842+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:56.911 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:56.911 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:56.925 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:56.971 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:56.966+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:57.053 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:57.046+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:57.058 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:57.058 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:57.072 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:57.153 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:57.149+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:57.211 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:57.211 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:57.229 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:57.271 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:57.269+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:57.355 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:57.350+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:57.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:31:57.398 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:57.398 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:57.413 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:57.463 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:57.458+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:57.545 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:57.545 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:57.556 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:57.553+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:57.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:57.657 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:57.653+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:57.724 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:57.724 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:57.739 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:57.757 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:57.753+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:57.858 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:57.853+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:57.861 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:57.861 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:57.876 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:57.959 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:57.954+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:58.012 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:58.012 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:58.027 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:58.060 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:58.054+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:58.161 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:58.154+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:58.168 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:58.168 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:58.188 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:58.262 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:58.257+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:58.266 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:31:58.338 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:58.338 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:58.359 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:58.403 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:58.401+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:58.463 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:58.458+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:58.502 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:58.502 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:58.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:58.563 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:58.558+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:58.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:31:58.664 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:58.661+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:58.687 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:31:58.687 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:31:58.702 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:31:58.765 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:58.758+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:58.775 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:31:58.775 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:31:58.796 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:31:58.796 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:31:58.799 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:31:58.799 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:31:58.829 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:58.829 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:58.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.872414521, 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:58.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.872231706999999, 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.835 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:31:58.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.840 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.872156287999999, 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:31:58.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:31:58.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.87205876, 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:31:58.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:31:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:31:58.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:58.851 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.871988818, 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:31:58.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:31:58.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:31:58.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.871898147, 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:58.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.871511554, 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.862 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:31:58.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.870857801, 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:31:58.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.870756162999999, 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:31:58.873 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:31:58.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:31:58.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.870680015, 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.879 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:31:58.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.870409233, 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.889 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.86622238, 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:31:58.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:31:58.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:31:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:58.895 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.864372293000001, 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:31:58.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.900 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.864179639, 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:31:58.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:31:58.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.906 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.863896737999999, 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:31:58.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:31:58.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:31:58.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.860893038, 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.912 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:31:58.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.857799959999999, 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:31:58.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.857415250000001, 2024-09-20T20:31:58.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:31:58.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:31:58.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.855441927999999, 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.929 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:31:58.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.934 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.85531523, 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:58.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:58.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:58.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:31:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:31:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:58.940 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:58.940 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:58.940 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T20:31:58.950 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:58.937+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:58.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:31:59.042 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:59.034+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:59.051 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-09-20T20:31:59.051 INFO:teuthology.orchestra.console.smithi079:Power off completed 2024-09-20T20:31:59.086 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:59.086 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:59.086 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.086 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:12441 3.14 3:2e600548:::200.0000001a:head [write 3965576~3235 [fadvise_dontneed] in=3235b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-20T20:31:59.086 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:59.082477+0000", 2024-09-20T20:31:59.086 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.001374323, 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001421959, 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:59.082477+0000", 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:59.082477+0000", 2024-09-20T20:31:59.087 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:59.082478+0000", 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.47e-07 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:59.082484+0000", 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.2249999999999997e-06 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:59.082499+0000", 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5038000000000001e-05 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:59.082508+0000", 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1889999999999996e-06 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:59.082627+0000", 2024-09-20T20:31:59.089 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000118966 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:59.082862+0000", 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023463100000000001 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: ], 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 1 2024-09-20T20:31:59.090 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:59.100 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:31:59.150 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:59.145+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:59.244 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:59.238+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:59.253 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:59.253 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:31:59.253 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:31:59.253 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:31:59.253 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:59.268 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:31:59.359 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:59.357+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:59.445 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:59.438+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:59.452 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:31:59.452 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:31:59.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.498113684, 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:59.453 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.454 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.455 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:31:59.456 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.457 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.458 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.498062173000001, 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.459 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.460 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.461 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.462 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:31:59.463 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.498015719000001, 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.464 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.465 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.466 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:31:59.467 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:31:59.468 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.469 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.497977517999999, 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.470 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.471 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:31:59.472 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:31:59.473 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.497945939000001, 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.475 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:31:59.476 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:31:59.477 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:31:59.478 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.479 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.480 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.497894445, 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.481 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.482 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:31:59.483 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:31:59.484 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:31:59.485 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.4978601, 2024-09-20T20:31:59.486 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.487 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.488 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:31:59.489 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:31:59.490 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:31:59.491 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.497829201999998, 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.492 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.493 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:31:59.494 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:31:59.495 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.496 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.497 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.497780138, 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.498 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:31:59.499 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:31:59.500 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:31:59.501 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.502 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:59.503 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.497747372999999, 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:31:59.504 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:31:59.505 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:31:59.506 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.507 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.507 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:31:59.507 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:31:59.507 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.507 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.507 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.508 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:31:59.508 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:31:59.508 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.508 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.508 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.508 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:31:59.508 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:31:59.508 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:31:59.509 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:31:59.510 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.510 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.510 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.510 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:31:59.510 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:31:59.510 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.510 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.510 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.511 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.479537601000001, 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.513 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.514 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.515 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:31:59.516 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:31:59.517 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.518 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:31:59.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:31:59.519 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.519 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.519 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.519 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:31:59.519 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:31:59.519 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.519 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.520 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.520 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.520 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.520 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.520 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:59.520 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.478981373, 2024-09-20T20:31:59.520 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:31:59.520 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.521 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:31:59.522 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:31:59.523 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.524 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:31:59.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:31:59.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.525 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.525 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:31:59.525 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:31:59.525 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.525 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:31:59.526 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.527 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.527 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:31:59.527 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:31:59.527 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.527 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.527 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.527 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.528 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.478486222000001, 2024-09-20T20:31:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:31:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.529 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.530 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:31:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:31:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:31:59.531 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:31:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:31:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.532 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.533 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:31:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:31:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:31:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:31:59.534 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.535 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:31:59.536 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.477820586, 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.537 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:31:59.538 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.539 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:31:59.540 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:31:59.541 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.542 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.477225891, 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.543 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:31:59.544 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.545 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:31:59.546 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:31:59.547 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.477099367000001, 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.548 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.549 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.550 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.551 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:31:59.552 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.553 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.477016081999999, 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.554 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.555 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.556 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.557 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.558 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.476035628999998, 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.559 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:31:59.560 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.561 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:31:59.562 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:31:59.563 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.564 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.475924647999999, 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.565 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:31:59.566 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:31:59.567 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:31:59.568 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:31:59.569 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 27.470337644000001, 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:31:59.570 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:31:59.571 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:31:59.572 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:31:59.573 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.574 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.575 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.576 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.577 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:31:59.577 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:31:59.578 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:31:59.580 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:31:59.581 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:59.576+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:59.681 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:59.676+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:59.715 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:59.715 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:59.716 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:31:59.716 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:59.730 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:31:59.782 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:59.780+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:59.854 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:59.854 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:31:59.854 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:31:59.854 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:31:59.854 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:31:59.868 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:31:59.915 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:31:59.910+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:31:59.984 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:31:59.980+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:31:59.991 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.034661432, 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:59.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:31:59.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:31:59.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:31:59.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.034478618, 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:31:59.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:31:59.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:32:00.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:32:00.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:32:00.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.034403199, 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:32:00.003 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:32:00.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:32:00.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:32:00.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.034305671, 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:32:00.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:32:00.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:32:00.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:32:00.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.034235729000001, 2024-09-20T20:32:00.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:32:00.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:32:00.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.034145058, 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:32:00.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:32:00.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:32:00.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.033758465, 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:32:00.025 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:00.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:32:00.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.033104712, 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.031 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:32:00.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:32:00.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:32:00.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:32:00.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:32:00.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:32:00.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:32:00.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.033003074, 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:32:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:32:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:32:00.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:32:00.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:32:00.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:32:00.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:32:00.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:32:00.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:32:00.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:32:00.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:32:00.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:32:00.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:32:00.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:32:00.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:32:00.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:32:00.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:32:00.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:32:00.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:32:00.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:32:00.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:32:00.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:32:00.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.048 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.048 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.049 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:00.049 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.032926926, 2024-09-20T20:32:00.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:32:00.049 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.049 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.049 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.049 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:00.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:00.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:32:00.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:32:00.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:32:00.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:32:00.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:32:00.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:32:00.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:32:00.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:32:00.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:32:00.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:32:00.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:32:00.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:32:00.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:32:00.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:32:00.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:32:00.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:32:00.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:32:00.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:32:00.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:32:00.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:32:00.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:32:00.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:32:00.060 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.060 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.060 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.061 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.061 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:00.061 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.032656144000001, 2024-09-20T20:32:00.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:32:00.061 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.061 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.062 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.062 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:00.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:00.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:32:00.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:32:00.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:32:00.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:32:00.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:32:00.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:32:00.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:32:00.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:32:00.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:32:00.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:32:00.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:32:00.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:32:00.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:32:00.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:32:00.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:32:00.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:32:00.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:32:00.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:32:00.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:32:00.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:32:00.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:32:00.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:32:00.073 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.073 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.074 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.074 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:00.074 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.028469291, 2024-09-20T20:32:00.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:32:00.075 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.075 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.075 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.075 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:00.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:00.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:32:00.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:32:00.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:32:00.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:32:00.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:32:00.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:32:00.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:32:00.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:32:00.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:32:00.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:32:00.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:32:00.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:32:00.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:32:00.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:32:00.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:32:00.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:32:00.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:32:00.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:32:00.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:32:00.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:32:00.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:32:00.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:32:00.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.086 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.087 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.087 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:00.087 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.026619203999999, 2024-09-20T20:32:00.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:32:00.087 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.087 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.087 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.088 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:00.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:00.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:32:00.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:32:00.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:32:00.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:32:00.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:32:00.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:32:00.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:32:00.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:32:00.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:32:00.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:32:00.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:32:00.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:32:00.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:32:00.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:32:00.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:32:00.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:32:00.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:32:00.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:32:00.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:32:00.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:32:00.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:32:00.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:32:00.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.098 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.099 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.099 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:00.099 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.02642655, 2024-09-20T20:32:00.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:32:00.100 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.100 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.100 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.100 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:00.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:00.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:32:00.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:32:00.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:32:00.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:32:00.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:32:00.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:32:00.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:32:00.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:32:00.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:32:00.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:32:00.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:32:00.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:32:00.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:32:00.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:32:00.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:32:00.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:32:00.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:32:00.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:32:00.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:32:00.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:32:00.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:32:00.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:32:00.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.111 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.111 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.112 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:00.112 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.026143649, 2024-09-20T20:32:00.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:32:00.112 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.112 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.112 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.112 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:00.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:00.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:32:00.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:32:00.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:32:00.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:32:00.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:32:00.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:32:00.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:32:00.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:32:00.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.120 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.023139949000001, 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.020046871, 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:00.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:32:00.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:32:00.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:32:00.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:32:00.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.019662160999999, 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.017688839, 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.136 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:32:00.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:32:00.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:32:00.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:32:00.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.017562141000001, 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:00.141 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:00.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:00.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:00.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:00.146 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:00.148 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:00.150 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:00.144+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:00.248 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:00.244+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:00.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-20T20:32:00.298 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:00.298 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:00.299 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:32:00.299 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:00.312 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:00.355 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:00.352+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:00.450 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:00.442+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:00.474 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:00.475 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:00.475 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:32:00.475 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:32:00.475 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:00.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:00.551 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:00.544+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655722033, 2024-09-20T20:32:00.612 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.613 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:32:00.614 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.615 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.616 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.617 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655670522000001, 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:00.618 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:32:00.619 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.620 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:32:00.621 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.622 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655624068000002, 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.623 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.624 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.625 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.626 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.627 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:00.628 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655585866999999, 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.629 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:32:00.630 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.631 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.632 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.633 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655554288000001, 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.634 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.635 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.636 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.637 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:32:00.638 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655502794, 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.639 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.640 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.641 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.642 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.643 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.644 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655468449000001, 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:00.645 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.646 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.647 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.648 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655437550999999, 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:32:00.651 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:32:00.652 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.653 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.654 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655388487, 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.655 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:32:00.656 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.657 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.658 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.659 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:00.660 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.655355721999999, 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.661 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:32:00.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:32:00.663 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:32:00.664 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.665 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.637145950000001, 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.666 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:32:00.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:32:00.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:32:00.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:32:00.670 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.636589722, 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.671 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.672 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.673 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:32:00.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:32:00.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.636094571000001, 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:32:00.676 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:32:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:32:00.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:32:00.680 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.681 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.635428935, 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.682 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.683 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.684 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.685 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.686 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.63483424, 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.687 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.688 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.689 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.690 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.691 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.634707716000001, 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.692 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.693 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.694 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.695 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.696 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:00.697 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.634624430999999, 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:00.698 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:32:00.699 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:32:00.700 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:32:00.701 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.702 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.633643977999998, 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.703 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.704 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:32:00.705 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:32:00.706 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.707 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.633532997, 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.708 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.709 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:32:00.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:32:00.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:32:00.712 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 28.627945993000001, 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:32:00.713 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.714 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.715 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.716 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.717 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:00.718 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:00.720 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:00.720 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:00.714+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:00.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:32:00.821 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:00.816+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:00.852 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:00.852 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:32:00.852 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:32:00.852 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:00.867 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:00.912 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:32:00.921 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:00.914+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:00.933 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:32:00.934 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:32:00.954 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:32:00.954 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:32:00.958 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:32:00.958 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:32:00.995 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:00.995 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:01.011 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:01.059 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:01.054+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:01.123 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:01.118+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:01.209 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:01.209 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:01.225 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:01.220+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:01.232 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:01.276 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-20T20:32:01.326 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:01.318+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:01.372 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:01.372 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:01.386 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:01.431 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:01.428+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:01.509 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:01.509 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:01.524 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:01.528 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:01.522+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:01.629 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:01.624+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:01.690 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:01.690 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:01.705 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:01.755 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:01.750+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:01.830 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:01.822+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:01.844 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:01.845 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:01.860 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:01.931 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:01.928+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:02.032 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:02.026+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:02.033 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:02.034 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:02.049 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:02.135 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:02.130+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:02.233 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:02.226+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:02.258 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:02.258 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:02.278 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:02.334 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:02.328+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:02.409 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:02.409 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:02.423 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:02.435 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:02.430+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:02.536 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:02.532+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:02.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-09-20T20:32:02.593 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:02.594 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:02.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:02.651 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:02.648+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:02.738 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:02.732+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:02.779 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:02.779 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:02.794 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:02.839 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:02.832+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:02.933 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:02.933 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:02.939 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:02.934+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:02.947 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:02.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:32:03.041 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:03.036+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:32:03.106 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:32:03.106 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:32:03.121 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:03.122 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:03.125 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:32:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:32:03.129 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:32:03.129 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:32:03.137 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:03.142 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:03.136+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:03.243 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:03.234+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:03.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-20T20:32:03.304 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:03.304 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:32:03.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:32:03.304 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:32:03.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.305 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.305 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:03.305 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.348450973999999, 2024-09-20T20:32:03.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:32:03.305 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.305 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.306 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.306 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:03.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:03.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:32:03.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:32:03.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:32:03.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:32:03.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:32:03.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:32:03.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:32:03.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:32:03.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:32:03.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:32:03.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:32:03.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:32:03.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:32:03.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:32:03.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:32:03.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:32:03.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:32:03.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:32:03.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:32:03.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:32:03.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:32:03.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:32:03.317 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.317 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.317 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.318 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.318 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:03.318 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.34826816, 2024-09-20T20:32:03.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.323 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.348192740999998, 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:32:03.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.348095213000001, 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:32:03.329 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:32:03.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:32:03.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:32:03.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.348025271000001, 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:32:03.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:32:03.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.347934599999999, 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.340 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:32:03.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:32:03.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.347548007, 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:32:03.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:32:03.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:32:03.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.346894253999999, 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.351 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:32:03.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:32:03.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:32:03.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.346792615999998, 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:32:03.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:32:03.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.346716468, 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:32:03.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:32:03.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:32:03.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:03.367 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.346445685999999, 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:32:03.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.372 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.342258832999999, 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:03.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.340408746000001, 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:32:03.378 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:32:03.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:32:03.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.340216091999999, 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:32:03.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.339933191, 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.389 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:32:03.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.394 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.336929490999999, 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:32:03.399 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.333836413, 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:32:03.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:32:03.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.333451703000001, 2024-09-20T20:32:03.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:32:03.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:32:03.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:32:03.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.331478381, 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:32:03.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:32:03.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:32:03.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.331351683000001, 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:03.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:32:03.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:32:03.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:32:03.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:03.421 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:03.423 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:03.423 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:03.416+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:03.503 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-20T20:32:03.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-20T20:32:03.524 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:03.520+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:03.553 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:03.554 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:32:03.554 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:03.567 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:03.625 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:03.618+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:03.725 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:03.722+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:03.735 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:03.735 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:03.735 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:32:03.735 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:32:03.735 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:03.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:03.787 DEBUG:teuthology.parallel:result is None 2024-09-20T20:32:03.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-20T20:32:03.806 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-20T20:32:03.806 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-20T20:32:03.817 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-20T20:32:03.818 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:32:03.818 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T20:32:03.827 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:03.822+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:03.853 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:32:03.853 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T20:32:03.875 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 3009114~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919641548000001, 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069634367000000003, 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.876 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950755+0000", 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3300000000000001e-07 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.877 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950763+0000", 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.0639999999999994e-06 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950789+0000", 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.5405000000000002e-05 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950796+0000", 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5689999999999999e-06 2024-09-20T20:32:03.878 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008459+0000", 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.057662996000000001 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.008761+0000", 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030134699999999999 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.009203+0000", 2024-09-20T20:32:03.879 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00044246999999999998 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015104+0000", 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059004360000000002 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020183+0000", 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0050796490000000003 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.880 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020300+0000", 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000116734 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020389+0000", 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.8963999999999997e-05 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919590036999999, 2024-09-20T20:32:03.881 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.882 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:32:03.883 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.884 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.885 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.886 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919543582999999, 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.887 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.888 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.888 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:03.888 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.888 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.888 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.889 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.889 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:03.889 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.890 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.891 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.892 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:03.893 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919505382000001, 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:03.894 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.895 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.896 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:32:03.897 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.898 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919473802999999, 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:32:03.900 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:32:03.901 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.902 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.903 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919422309000002, 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.904 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:32:03.905 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.907 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.908 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.909 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919387963999998, 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:03.910 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.911 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:32:03.912 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:32:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.914 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919357066, 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.915 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:32:03.916 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.917 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.918 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.919 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.920 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919308002000001, 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.921 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.922 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.923 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.924 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.925 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.919275237000001, 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.926 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.927 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.928 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.929 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.930 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:190 3.1d 3:bec1251c:::200.00000007:head [write 3068701~1416 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.901065464999999, 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069122846000000002, 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.931 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969331+0000", 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969332+0000", 2024-09-20T20:32:03.932 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2500000000000001e-06 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969341+0000", 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.1260000000000004e-06 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969372+0000", 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0555000000000001e-05 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969417+0000", 2024-09-20T20:32:03.933 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.5701000000000002e-05 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029247+0000", 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059830039000000002 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029476+0000", 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000228571 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.029844+0000", 2024-09-20T20:32:03.934 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000367642 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.037988+0000", 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.008144142 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038382+0000", 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00039391900000000001 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.935 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038412+0000", 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0501000000000002e-05 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038454+0000", 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.1399999999999997e-05 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.900509237000001, 2024-09-20T20:32:03.936 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.937 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.938 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.939 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:32:03.940 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.941 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.900014085999999, 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.942 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.943 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.944 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.945 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.899348450000002, 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:03.947 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:32:03.948 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.949 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.950 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.951 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.898753755000001, 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.952 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:32:03.953 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:32:03.954 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:32:03.955 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:32:03.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.898627230999999, 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:32:03.957 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.958 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.959 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.960 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.961 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.962 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.898543946, 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.963 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.965 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.966 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.967 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.897563493, 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.968 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.969 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.970 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.971 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.972 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.897452512000001, 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.973 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.974 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.975 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.976 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.977 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:199 3.1d 3:bec1251c:::200.00000007:head [write 3090782~8970 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:03.978 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 31.891865507999999, 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070851863000000001, 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978531+0000", 2024-09-20T20:32:03.979 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978533+0000", 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.04e-06 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978560+0000", 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7455000000000001e-05 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:03.980 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978588+0000", 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.7878999999999999e-05 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.978603+0000", 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5122e-05 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039751+0000", 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061147674999999999 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.981 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039799+0000", 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.7651999999999997e-05 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039871+0000", 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2854000000000004e-05 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045242+0000", 2024-09-20T20:32:03.982 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0053709680000000003 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049282+0000", 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0040398839999999997 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049338+0000", 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5878000000000003e-05 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049383+0000", 2024-09-20T20:32:03.983 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.4456000000000003e-05 2024-09-20T20:32:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:03.984 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:03.984 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:03.985 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:03.986 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:03.980+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:03.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-20T20:32:04.085 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:04.080+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:04.119 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:04.119 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:32:04.120 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:32:04.120 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:04.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:04.153 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-20T20:32:04.153 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:32:04.153 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-20T20:32:04.153 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-20T20:32:04.153 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-20T20:32:04.154 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-20T20:32:04.227 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:04.222+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:04.286 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-20T20:32:04.287 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:04.284+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:04.315 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:04.315 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:32:04.315 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:32:04.315 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:32:04.315 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:04.334 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:04.351 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "" 2024-09-20T20:32:04.351 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:04.355 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2024-09-20T20:32:04.374 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-20T20:32:04.374 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T20:32:04.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-20T20:32:04.411 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:04.406+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:04.469 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:04.469 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:32:04.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:32:04.469 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:32:04.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.469 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.469 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:04.469 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.512145914000001, 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.474 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.511963099999999, 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:32:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.511887681000001, 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.480 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:32:04.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:32:04.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:32:04.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.511790153, 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:32:04.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.511720211, 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.491 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.496 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.511629540000001, 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:32:04.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:32:04.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.511242947, 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.502 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.507 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.510589194000001, 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:32:04.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:32:04.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:32:04.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.510487556000001, 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:32:04.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.518 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.510411408, 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:04.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:32:04.523 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.510140625999998, 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:32:04.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:32:04.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.505953773000002, 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:32:04.529 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:32:04.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:32:04.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:32:04.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.504103686000001, 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:32:04.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:32:04.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.503911032000001, 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.540 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:32:04.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.545 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.503628130999999, 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:32:04.550 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.500624430999999, 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:32:04.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:32:04.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.497531352999999, 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:32:04.556 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:32:04.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:32:04.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.497146643000001, 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:32:04.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:32:04.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.495173320999999, 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.567 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:04.572 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.495046623, 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:04.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:04.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.577 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:04.578 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:04.578 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:04.579 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:04.580 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:04.576+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:04.680 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:04.674+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:04.711 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:04.711 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:04.711 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:32:04.711 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2024-09-20T20:32:04.724 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:04.732 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2024-09-20T20:32:04.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:32:04.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-20T20:32:04.751 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:32:04.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[23821]: fuse finished with error 0 and tester_r 0 2024-09-20T20:32:04.781 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:04.776+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:04.866 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:04.866 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:04.866 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:32:04.867 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:32:04.867 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:04.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:04.924 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:04.920+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:04.982 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:04.978+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:05.047 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:05.047 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:32:05.047 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:32:05.047 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:32:05.047 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.047 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.091106988999996, 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.048 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:32:05.049 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:32:05.050 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.051 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:32:05.052 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.091060534999997, 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:32:05.053 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.054 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:32:05.055 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.056 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.057 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:32:05.058 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.091022334000002, 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.059 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:32:05.060 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.062 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.063 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.064 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.090990755, 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:05.065 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.066 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:32:05.067 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:32:05.068 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:32:05.069 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.090939261000003, 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.070 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:32:05.071 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:32:05.072 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.073 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.074 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.075 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.090904916, 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.076 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.077 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.078 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.079 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:32:05.080 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.090874018000001, 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.081 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.082 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.083 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.084 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:32:05.085 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.090824953999999, 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.086 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.087 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.088 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.089 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:32:05.090 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.091 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.090792188999998, 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:05.092 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.094 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:32:05.095 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:32:05.096 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.097 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.072026188999999, 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:05.098 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.099 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.100 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.101 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:32:05.102 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.071531038000003, 2024-09-20T20:32:05.103 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.104 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:32:05.105 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.106 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.107 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:32:05.108 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.070865402000003, 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.109 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.110 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:32:05.111 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:32:05.112 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.113 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.070270706999999, 2024-09-20T20:32:05.114 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.115 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:32:05.116 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:32:05.118 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.118 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.118 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.118 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:32:05.118 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:32:05.118 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.118 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.118 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.119 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.120 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.121 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.070144182999996, 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.122 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.123 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.124 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:32:05.125 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:32:05.126 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.070060898000001, 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.127 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:32:05.128 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:32:05.129 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.130 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:32:05.131 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.132 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.069080444999997, 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.133 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:05.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.135 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:05.135 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.136 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.136 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.136 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:32:05.136 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:32:05.136 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.136 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.136 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.137 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:32:05.137 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:32:05.137 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.137 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.137 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.138 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:32:05.138 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:32:05.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.138 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.138 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.138 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:32:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:32:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:32:05.139 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:32:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:32:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:32:05.140 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:32:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:32:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.141 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:32:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:32:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.142 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:32:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:32:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:32:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:32:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:32:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:32:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 33.068969463999998, 2024-09-20T20:32:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:32:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:32:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:32:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:32:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:32:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:32:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:32:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:32:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:32:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:32:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:32:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:32:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:32:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:32:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:32:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:05.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:32:05.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:32:05.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:32:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:32:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:05.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:32:05.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:32:05.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:32:05.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:32:05.157 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.157 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.157 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.158 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19324 4.36 4:6f6a1eb0:::1000000009d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:05.158 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:05.158 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.27944709499999998, 2024-09-20T20:32:05.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071661269, 2024-09-20T20:32:05.158 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.158 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.158 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:05.159 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.159 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.159 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:05.159 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.160 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.160 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:05.160 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.160 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762467+0000", 2024-09-20T20:32:05.161 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6400000000000003e-07 2024-09-20T20:32:05.161 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.161 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.162 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762469+0000", 2024-09-20T20:32:05.162 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0439999999999998e-06 2024-09-20T20:32:05.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.162 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.162 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.162 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762476+0000", 2024-09-20T20:32:05.162 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.182e-06 2024-09-20T20:32:05.163 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.163 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.163 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.163 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762482+0000", 2024-09-20T20:32:05.163 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6100000000000002e-06 2024-09-20T20:32:05.164 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.164 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.164 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.164 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.768980+0000", 2024-09-20T20:32:05.164 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064977519999999999 2024-09-20T20:32:05.164 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.165 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.165 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769112+0000", 2024-09-20T20:32:05.165 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131979 2024-09-20T20:32:05.165 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834127+0000", 2024-09-20T20:32:05.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065015238000000003 2024-09-20T20:32:05.166 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.166 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.166 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.166 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.167 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19361 4.36 4:6c9ae960:::100000000c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:05.167 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:05.167 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.27908786899999999, 2024-09-20T20:32:05.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071416802000000001, 2024-09-20T20:32:05.167 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.168 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.168 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:05.168 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:05.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.169 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.169 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:05.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.169 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.170 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.170 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762826+0000", 2024-09-20T20:32:05.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8599999999999998e-07 2024-09-20T20:32:05.170 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762834+0000", 2024-09-20T20:32:05.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4349999999999997e-06 2024-09-20T20:32:05.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762844+0000", 2024-09-20T20:32:05.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4329999999999993e-06 2024-09-20T20:32:05.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762851+0000", 2024-09-20T20:32:05.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1679999999999998e-06 2024-09-20T20:32:05.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.173 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.173 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769814+0000", 2024-09-20T20:32:05.173 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0069627739999999997 2024-09-20T20:32:05.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.174 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.174 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769938+0000", 2024-09-20T20:32:05.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012389500000000001 2024-09-20T20:32:05.174 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.174 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.175 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834242+0000", 2024-09-20T20:32:05.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064304610999999998 2024-09-20T20:32:05.175 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.175 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.175 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.176 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.176 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19366 4.36 4:6e30e37c:::100000000c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:05.176 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:05.176 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 0.27901741800000002, 2024-09-20T20:32:05.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.072017450999999996, 2024-09-20T20:32:05.176 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:05.177 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:05.177 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:05.177 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:05.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:05.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:05.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:05.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:05.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:05.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:05.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:05.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2900000000000004e-07 2024-09-20T20:32:05.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:05.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762899+0000", 2024-09-20T20:32:05.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.238e-06 2024-09-20T20:32:05.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:05.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762906+0000", 2024-09-20T20:32:05.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.746e-06 2024-09-20T20:32:05.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:05.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762912+0000", 2024-09-20T20:32:05.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1210000000000003e-06 2024-09-20T20:32:05.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:05.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.771140+0000", 2024-09-20T20:32:05.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0082274280000000002 2024-09-20T20:32:05.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:05.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.771291+0000", 2024-09-20T20:32:05.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000151636 2024-09-20T20:32:05.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:05.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:05.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:05.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834913+0000", 2024-09-20T20:32:05.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063621753000000003 2024-09-20T20:32:05.184 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.184 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.184 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.184 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:05.184 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:05.185 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:05.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:32:05.188 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:05.189 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:05.180+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:05.287 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:05.278+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:05.326 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:32:05.344 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:05.344 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:32:05.344 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:32:05.344 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:05.346 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:32:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:32:05.359 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:05.365 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:32:05.365 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:32:05.368 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:32:05.368 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:32:05.404 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:05.398+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:05.489 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:05.484+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:05.525 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:05.526 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:05.539 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:05.589 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:05.584+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:05.659 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:05.659 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:05.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:05.719 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:05.716+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:05.791 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:05.788+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:05.804 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:05.804 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:05.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:05.907 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:05.904+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:05.985 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:05.985 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:05.993 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:05.988+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:05.998 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:06.095 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:06.090+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:06.163 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:06.163 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:06.177 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:06.195 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:06.192+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:06.296 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:06.290+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:06.308 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:06.308 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:06.311 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:32:06.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:06.407 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:06.402+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:06.487 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:06.487 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:06.498 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:06.490+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:06.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:06.599 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:06.592+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:06.660 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:06.661 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:06.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:06.719 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:06.716+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:06.800 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:06.796+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:06.807 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:06.821 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:06.901 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:06.898+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:06.986 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:06.986 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:07.000 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:07.002 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:06.998+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:07.102 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:07.094+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:07.119 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:07.119 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:07.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:07.204 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:07.198+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:07.265 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:07.265 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:07.278 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:07.305 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:07.300+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:07.313 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:32:07.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-20T20:32:07.406 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:07.398+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:07.439 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:07.439 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:07.452 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:32:07.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:32:07.515 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:32:07.535 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:32:07.535 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:32:07.539 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:32:07.539 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:32:07.540 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:07.534+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:07.607 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:07.602+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:07.620 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:07.620 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:32:07.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.663391764, 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:32:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:32:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:32:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:32:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:32:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.663208950000001, 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:32:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.663133531, 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:32:07.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:32:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:32:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.663036002999998, 2024-09-20T20:32:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:32:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:32:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:32:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.662966060999999, 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:32:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:32:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.66287539, 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:32:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:32:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.662488797000002, 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:32:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:32:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.661835044, 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:32:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.661733406, 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:32:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.661657257999998, 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:32:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.661386476000001, 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:32:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:32:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.657199623, 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:32:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.655349535999999, 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:32:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:32:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.655156882, 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:32:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:32:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.654873981000001, 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:32:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:32:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:32:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.651870281000001, 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:32:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.648777203000002, 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:32:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.648392492999999, 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:32:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:32:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.646419171000002, 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:32:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.729 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.646292472999999, 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:07.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:32:07.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:07.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:07.735 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:07.737 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:07.737 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:07.732+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:07.838 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:07.834+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:07.867 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:07.867 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:32:07.867 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:07.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:07.939 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:07.934+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:08.003 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:08.004 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:08.004 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:32:08.004 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:32:08.004 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:08.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:08.063 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:08.060+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:08.138 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:08.138 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:32:08.138 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:32:08.139 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:32:08.139 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.139 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.139 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:08.139 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181639513, 2024-09-20T20:32:08.139 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:32:08.139 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.139 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.140 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.141 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:08.141 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.141 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.141 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.141 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:32:08.141 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:32:08.141 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.142 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.142 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.142 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:32:08.142 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:32:08.142 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.142 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.143 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.143 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:32:08.143 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:32:08.143 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.143 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.143 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.144 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:32:08.144 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:32:08.144 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.144 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.144 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.144 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:32:08.144 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:32:08.145 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.145 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.145 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.145 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:32:08.145 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:32:08.145 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.146 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.146 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.146 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:32:08.146 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:32:08.146 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.146 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.147 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.147 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:32:08.147 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:32:08.147 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.147 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.147 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.148 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:32:08.148 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:32:08.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.148 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.148 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.148 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:32:08.148 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:32:08.148 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181593059000001, 2024-09-20T20:32:08.149 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:08.150 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:32:08.151 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.152 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.153 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:32:08.154 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181554857999998, 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.155 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.156 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.157 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:32:08.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:32:08.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.159 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.159 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:32:08.159 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:32:08.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.160 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.160 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:32:08.160 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:32:08.160 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.160 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.160 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:32:08.161 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:32:08.161 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.161 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.161 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.161 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:32:08.161 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:32:08.162 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.162 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.162 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.162 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.162 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.162 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181523278999997, 2024-09-20T20:32:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:32:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.163 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.164 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:08.164 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.164 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.164 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.164 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.164 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:08.164 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.165 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.165 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.165 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:32:08.165 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:32:08.165 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.165 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:32:08.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:32:08.166 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.166 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.166 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.166 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:32:08.166 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:32:08.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.167 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:32:08.167 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:32:08.167 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.167 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.167 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.168 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:32:08.168 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:32:08.168 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.168 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.168 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:32:08.169 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:32:08.169 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.169 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.169 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.169 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:32:08.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:32:08.170 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.170 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.170 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.170 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:32:08.170 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:32:08.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.171 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.171 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:32:08.171 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:32:08.171 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.171 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:32:08.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:32:08.172 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.172 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.172 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.172 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:32:08.172 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:32:08.173 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.173 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.173 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.173 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.173 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.173 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.173 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:08.174 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181471784999999, 2024-09-20T20:32:08.174 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:32:08.174 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.174 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.174 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.174 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.175 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:08.175 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.175 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.175 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.175 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:08.176 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.176 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.176 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.176 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.176 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:32:08.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:32:08.177 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.177 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.177 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.177 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:32:08.177 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:08.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.178 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.178 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.178 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:32:08.178 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:32:08.178 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:32:08.179 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:32:08.180 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.181 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181437440000003, 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.182 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.183 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:32:08.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:32:08.185 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.186 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.187 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181406541999998, 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:08.188 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.189 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.189 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:08.189 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.189 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.189 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.190 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:32:08.190 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:32:08.190 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.190 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.190 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:32:08.191 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:32:08.191 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.191 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.191 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.191 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:32:08.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:32:08.192 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.192 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.192 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.192 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:32:08.192 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:32:08.193 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.193 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.193 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.193 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:32:08.193 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:32:08.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.194 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.194 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.194 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:32:08.194 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:32:08.194 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:32:08.195 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:32:08.195 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.195 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.195 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.195 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:32:08.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:32:08.196 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.196 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.196 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.196 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:32:08.196 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:32:08.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.197 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.197 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:32:08.197 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:32:08.197 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.197 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.198 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.198 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:32:08.198 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:32:08.198 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.198 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.198 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.198 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.199 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.199 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.199 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:08.199 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181357478000002, 2024-09-20T20:32:08.199 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:32:08.199 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.199 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.199 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.200 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.200 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:08.200 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.200 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.200 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.200 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:08.201 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.201 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.201 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.201 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.201 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:32:08.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:32:08.202 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.202 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.202 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.202 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:32:08.202 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:08.203 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.203 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.203 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.203 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:32:08.203 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:32:08.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.204 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.204 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:32:08.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:32:08.205 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.205 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.205 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.205 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:32:08.205 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:32:08.205 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.205 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:32:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:32:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.208 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:32:08.209 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:32:08.209 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.209 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.209 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.209 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.209 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.209 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.209 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:08.210 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.181324713000002, 2024-09-20T20:32:08.210 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:32:08.210 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.210 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.210 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.210 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.211 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.211 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:08.211 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.211 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.211 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.212 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:08.212 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.212 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.212 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.212 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.213 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:32:08.214 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.215 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.216 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.162558713000003, 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.217 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:32:08.218 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.219 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.220 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:32:08.221 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.222 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.162063562, 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.223 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:32:08.224 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:32:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.227 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:08.228 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.161397925999999, 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.229 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:32:08.230 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:32:08.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:32:08.232 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.233 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.160803231000003, 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.234 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.235 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.236 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.237 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:32:08.238 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.160676707, 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.240 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:32:08.241 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.242 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.243 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.160593421999998, 2024-09-20T20:32:08.244 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.245 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:32:08.246 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:32:08.247 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:32:08.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.159612969000001, 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:32:08.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:32:08.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:32:08.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:32:08.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 36.159501988000002, 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:32:08.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:32:08.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19324 4.36 4:6f6a1eb0:::1000000009d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 3.369979619, 2024-09-20T20:32:08.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071661269, 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762467+0000", 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6400000000000003e-07 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762469+0000", 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0439999999999998e-06 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762476+0000", 2024-09-20T20:32:08.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.182e-06 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762482+0000", 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6100000000000002e-06 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.768980+0000", 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064977519999999999 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769112+0000", 2024-09-20T20:32:08.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131979 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834127+0000", 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065015238000000003 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19361 4.36 4:6c9ae960:::100000000c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 3.3696203929999999, 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071416802000000001, 2024-09-20T20:32:08.264 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762826+0000", 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8599999999999998e-07 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762834+0000", 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4349999999999997e-06 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762844+0000", 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4329999999999993e-06 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762851+0000", 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1679999999999998e-06 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769814+0000", 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0069627739999999997 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769938+0000", 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012389500000000001 2024-09-20T20:32:08.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834242+0000", 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064304610999999998 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19366 4.36 4:6e30e37c:::100000000c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 3.3695499419999999, 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.072017450999999996, 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:08.268 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:08.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2900000000000004e-07 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762899+0000", 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.238e-06 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762906+0000", 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.746e-06 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762912+0000", 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1210000000000003e-06 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.771140+0000", 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0082274280000000002 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.771291+0000", 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000151636 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834913+0000", 2024-09-20T20:32:08.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063621753000000003 2024-09-20T20:32:08.272 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.272 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.272 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.272 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:08.272 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:08.272 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:08.273 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:08.274 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:08.268+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:08.375 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:08.368+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:08.407 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:08.407 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:32:08.408 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:32:08.408 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:08.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:08.475 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:08.472+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:08.543 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:32:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:32:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:32:08.543 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:08.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:08.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-09-20T20:32:08.577 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:08.572+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:08.677 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:08.670+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3161 3.2 3:42569fed:::200.00000011:head [write 1803383~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.727741408, 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13182289, 2024-09-20T20:32:08.685 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952068+0000", 2024-09-20T20:32:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952070+0000", 2024-09-20T20:32:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6440000000000001e-06 2024-09-20T20:32:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952086+0000", 2024-09-20T20:32:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5875999999999998e-05 2024-09-20T20:32:08.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952106+0000", 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.014e-05 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952122+0000", 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6215999999999999e-05 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072407+0000", 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12028514999999999 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072457+0000", 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9598999999999997e-05 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.072565+0000", 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010789300000000001 2024-09-20T20:32:08.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077644+0000", 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050791559999999996 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083631+0000", 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059869060000000002 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083791+0000", 2024-09-20T20:32:08.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016072600000000001 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083891+0000", 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9584000000000001e-05 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3162 3.2 3:42569fed:::200.00000011:head [write 1805292~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:08.692 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.727558594000001, 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13177725400000001, 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952251+0000", 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952253+0000", 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.716e-06 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952263+0000", 2024-09-20T20:32:08.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0634e-05 2024-09-20T20:32:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952286+0000", 2024-09-20T20:32:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2829000000000001e-05 2024-09-20T20:32:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952302+0000", 2024-09-20T20:32:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6439999999999998e-05 2024-09-20T20:32:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073021+0000", 2024-09-20T20:32:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120718082 2024-09-20T20:32:08.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073107+0000", 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6907e-05 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.073236+0000", 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012857400000000001 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077648+0000", 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044120369999999997 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083936+0000", 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062882190000000003 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083986+0000", 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9979999999999999e-05 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084028+0000", 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1835999999999997e-05 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.699 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3163 3.2 3:42569fed:::200.00000011:head [write 1807201~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.727483175, 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13476179399999999, 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952326+0000", 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952327+0000", 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1260000000000001e-06 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952344+0000", 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6393e-05 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952363+0000", 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9409999999999999e-05 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952377+0000", 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3353000000000001e-05 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074080+0000", 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121703265 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074140+0000", 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9973999999999999e-05 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.074274+0000", 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013437799999999999 2024-09-20T20:32:08.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079853+0000", 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055786439999999998 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086849+0000", 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069959810000000001 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086985+0000", 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013608899999999999 2024-09-20T20:32:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087088+0000", 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103181 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3164 3.2 3:42569fed:::200.00000011:head [write 1809110~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:08.705 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.727385646999998, 2024-09-20T20:32:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13478431399999999, 2024-09-20T20:32:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952424+0000", 2024-09-20T20:32:08.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952425+0000", 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.176e-06 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952437+0000", 2024-09-20T20:32:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1780000000000001e-05 2024-09-20T20:32:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952457+0000", 2024-09-20T20:32:08.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0302999999999999e-05 2024-09-20T20:32:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952472+0000", 2024-09-20T20:32:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.526e-05 2024-09-20T20:32:08.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076341+0000", 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12386873399999999 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076395+0000", 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3764000000000002e-05 2024-09-20T20:32:08.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076473+0000", 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8343000000000005e-05 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080318+0000", 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038452460000000001 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087135+0000", 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068170189999999997 2024-09-20T20:32:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087169+0000", 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3492999999999999e-05 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087208+0000", 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9196000000000002e-05 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3165 3.2 3:42569fed:::200.00000011:head [write 1811360~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.727315704999999, 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137624996, 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952494+0000", 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952495+0000", 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1629999999999999e-06 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952525+0000", 2024-09-20T20:32:08.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0355999999999999e-05 2024-09-20T20:32:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952545+0000", 2024-09-20T20:32:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0166999999999999e-05 2024-09-20T20:32:08.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952560+0000", 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.505e-05 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076871+0000", 2024-09-20T20:32:08.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12431087 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.076927+0000", 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6014999999999998e-05 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077006+0000", 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8869999999999995e-05 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081450+0000", 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044440840000000001 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089877+0000", 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084265420000000004 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090017+0000", 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013992599999999999 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090119+0000", 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101953 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3166 3.2 3:42569fed:::200.00000011:head [write 1812763~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.727225034, 2024-09-20T20:32:08.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.137891767, 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952584+0000", 2024-09-20T20:32:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952586+0000", 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1340000000000001e-06 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952593+0000", 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2629999999999997e-06 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952611+0000", 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8369999999999999e-05 2024-09-20T20:32:08.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952625+0000", 2024-09-20T20:32:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.36e-05 2024-09-20T20:32:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077665+0000", 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12504017000000001 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077713+0000", 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7963000000000001e-05 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.077816+0000", 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103119 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083536+0000", 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057204669999999999 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090242+0000", 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067055539999999999 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090385+0000", 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014296299999999999 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090476+0000", 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1163999999999997e-05 2024-09-20T20:32:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3167 3.2 3:42569fed:::200.00000011:head [write 1814162~3195 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.726838440999998, 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13765395899999999, 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952971+0000", 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952972+0000", 2024-09-20T20:32:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4470000000000001e-06 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.952984+0000", 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1953000000000001e-05 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953009+0000", 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4516999999999999e-05 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953024+0000", 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4779e-05 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078325+0000", 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12530082200000001 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078409+0000", 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4792999999999999e-05 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078540+0000", 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000130975 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083541+0000", 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050009959999999997 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090546+0000", 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070045050000000003 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090583+0000", 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7493999999999997e-05 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090625+0000", 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1678000000000003e-05 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3168 3.2 3:42569fed:::200.00000011:head [write 1817357~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.726184688, 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13714638000000001, 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953625+0000", 2024-09-20T20:32:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953627+0000", 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2259999999999999e-06 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953639+0000", 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.172e-05 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953664+0000", 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4963000000000001e-05 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953681+0000", 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7453e-05 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.078973+0000", 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12529174600000001 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079027+0000", 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3913999999999999e-05 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079133+0000", 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106648 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083546+0000", 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044123809999999999 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090666+0000", 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071205920000000002 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090733+0000", 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6322000000000006e-05 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090771+0000", 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8414999999999997e-05 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3169 3.2 3:42569fed:::200.00000011:head [write 1818770~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.72608305, 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13738288300000001, 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953726+0000", 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953728+0000", 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3230000000000001e-06 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953736+0000", 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7169999999999997e-06 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953757+0000", 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0635000000000001e-05 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953781+0000", 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3606999999999999e-05 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079867+0000", 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126086697 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079916+0000", 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8489999999999998e-05 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.079991+0000", 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4838000000000004e-05 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083549+0000", 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035580809999999998 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090894+0000", 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073448159999999997 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091019+0000", 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012562700000000001 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091109+0000", 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0051999999999998e-05 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3170 3.2 3:42569fed:::200.00000011:head [write 1820689~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.726006902000002, 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13797016400000001, 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.744 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953803+0000", 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953804+0000", 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.04e-06 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953818+0000", 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4426e-05 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953838+0000", 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0047e-05 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.953853+0000", 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4769999999999999e-05 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080355+0000", 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.126501854 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080405+0000", 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0172e-05 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080495+0000", 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0103000000000001e-05 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084039+0000", 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035440939999999998 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091715+0000", 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076755540000000002 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091748+0000", 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3337999999999998e-05 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091773+0000", 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4766e-05 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3171 3.2 3:42569fed:::200.00000011:head [write 1822606~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.749 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.725736120000001, 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13804460099999999, 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954073+0000", 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954075+0000", 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6899999999999999e-06 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954086+0000", 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567000000000001e-05 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954109+0000", 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3006e-05 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.954125+0000", 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6796e-05 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080856+0000", 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12673046399999999 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080907+0000", 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0929e-05 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.080991+0000", 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3864999999999997e-05 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084042+0000", 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030513839999999999 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091884+0000", 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078421270000000008 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092027+0000", 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014322900000000001 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.092118+0000", 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0544000000000006e-05 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.754 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3172 3.2 3:42569fed:::200.00000011:head [write 1824534~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.721549267, 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.135858229, 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958260+0000", 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958262+0000", 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0600000000000002e-06 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958274+0000", 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.183e-05 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958311+0000", 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6609000000000001e-05 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.958331+0000", 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0457000000000001e-05 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081532+0000", 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123200977 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.081737+0000", 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020519700000000001 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082019+0000", 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028149199999999999 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084045+0000", 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002026019 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094056+0000", 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010011066000000001 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094089+0000", 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3457999999999997e-05 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094118+0000", 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9064000000000002e-05 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3173 3.2 3:42569fed:::200.00000011:head [write 1825947~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.719699179999999, 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13415675399999999, 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960110+0000", 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960112+0000", 2024-09-20T20:32:08.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7600000000000001e-06 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960123+0000", 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1423000000000001e-05 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960165+0000", 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1959000000000003e-05 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960187+0000", 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1447e-05 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.082968+0000", 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122781661 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083023+0000", 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4073999999999998e-05 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.083100+0000", 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7019000000000002e-05 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086739+0000", 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036395400000000001 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094190+0000", 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0074513050000000001 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094225+0000", 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4857000000000002e-05 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094267+0000", 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1709000000000003e-05 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3174 3.2 3:42569fed:::200.00000011:head [write 1828711~4282 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.765 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.719506526, 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13603560000000001, 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960303+0000", 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960304+0000", 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5430000000000001e-06 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960322+0000", 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7805999999999999e-05 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960350+0000", 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7742999999999998e-05 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960367+0000", 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7243000000000001e-05 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084124+0000", 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.123756743 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084343+0000", 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021891900000000001 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.084638+0000", 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029532899999999999 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086742+0000", 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021042169999999998 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096271+0000", 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0095287830000000007 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096305+0000", 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3657e-05 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096338+0000", 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3617e-05 2024-09-20T20:32:08.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3175 3.2 3:42569fed:::200.00000011:head [write 1832993~3770 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.719223625000001, 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13585704900000001, 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960586+0000", 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960588+0000", 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.764e-06 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960599+0000", 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1656e-05 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960623+0000", 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4079000000000001e-05 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.960641+0000", 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7237000000000001e-05 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085726+0000", 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12508566099999999 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085776+0000", 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9601999999999997e-05 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.085852+0000", 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5836999999999999e-05 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087748+0000", 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018966479999999999 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096383+0000", 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0086347439999999998 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096416+0000", 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3470999999999999e-05 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.096443+0000", 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.635e-05 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3176 3.2 3:42569fed:::200.00000011:head [write 1836763~3261 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.716219925000001, 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13533832700000001, 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.776 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963589+0000", 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963591+0000", 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-06 2024-09-20T20:32:08.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963604+0000", 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2486e-05 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963631+0000", 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.743e-05 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.963650+0000", 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8726e-05 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086260+0000", 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.122609831 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086310+0000", 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0101e-05 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.086401+0000", 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1262999999999997e-05 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090635+0000", 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042336279999999997 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098867+0000", 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082321809999999999 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098901+0000", 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4343e-05 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098928+0000", 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407999999999999e-05 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3177 3.2 3:42569fed:::200.00000011:head [write 1840024~1908 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:08.781 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.713126847000002, 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.132348838, 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966683+0000", 2024-09-20T20:32:08.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966684+0000", 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6300000000000001e-06 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966694+0000", 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0017000000000001e-05 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966719+0000", 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5063e-05 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.966738+0000", 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8266000000000001e-05 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087236+0000", 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120498745 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087301+0000", 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4579999999999995e-05 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087411+0000", 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011043 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090638+0000", 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032264820000000001 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.098971+0000", 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083332860000000005 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099005+0000", 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3998999999999998e-05 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.099031+0000", 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6339999999999999e-05 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.786 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3178 3.2 3:42569fed:::200.00000011:head [write 1841932~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.712742136999999, 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13426843299999999, 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967067+0000", 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967069+0000", 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9470000000000002e-06 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967081+0000", 2024-09-20T20:32:08.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1439e-05 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967105+0000", 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4426999999999998e-05 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.967123+0000", 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7723e-05 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.087829+0000", 2024-09-20T20:32:08.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.120706021 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088021+0000", 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000191657 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.088311+0000", 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00029018300000000001 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090641+0000", 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023298870000000001 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101096+0000", 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010454961 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101238+0000", 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014230100000000001 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101336+0000", 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7887000000000007e-05 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3179 3.2 3:42569fed:::200.00000011:head [write 1844350~2753 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.710768815000002, 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13264646999999999, 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.792 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969041+0000", 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969043+0000", 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.917e-06 2024-09-20T20:32:08.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969072+0000", 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9166000000000002e-05 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969098+0000", 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6112999999999999e-05 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969116+0000", 2024-09-20T20:32:08.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.863e-05 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089353+0000", 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.12023614000000001 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089400+0000", 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7803999999999998e-05 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.089475+0000", 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4771000000000006e-05 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.090784+0000", 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013086090000000001 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101470+0000", 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010686641 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101597+0000", 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126618 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.101687+0000", 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0061000000000004e-05 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:3180 3.2 3:42569fed:::200.00000011:head [write 1847103~3264 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.710642116999999, 2024-09-20T20:32:08.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.13582351500000001, 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "continuous": false, 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969167+0000", 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-09-20T20:32:08.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969169+0000", 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969180+0000", 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.066e-05 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969221+0000", 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1140000000000003e-05 2024-09-20T20:32:08.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:46.969238+0000", 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7289e-05 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091167+0000", 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.121928866 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091216+0000", 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8766e-05 2024-09-20T20:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.091289+0000", 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3257999999999996e-05 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.094019+0000", 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027300380000000002 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104915+0000", 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010895482 2024-09-20T20:32:08.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104949+0000", 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4195e-05 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-09-20T20:31:47.104991+0000", 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2058000000000003e-05 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-20T20:32:08.802 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:08.804 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:08.798+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:08.804 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:08.905 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:08.898+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:08.934 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:08.934 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:08.934 INFO:teuthology.orchestra.run.smithi090.stdout: "num_ops": 0 2024-09-20T20:32:08.934 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:08.950 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:09.005 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:09.000+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:09.072 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:09.072 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [], 2024-09-20T20:32:09.072 INFO:teuthology.orchestra.run.smithi090.stdout: "complaint_time": 30, 2024-09-20T20:32:09.072 INFO:teuthology.orchestra.run.smithi090.stdout: "num_blocked_ops": 0 2024-09-20T20:32:09.072 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:09.086 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:09.106 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:09.102+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:09.207 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:09.204+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: "size": 20, 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 600, 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3010511~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291887361000001, 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073517261, 2024-09-20T20:32:09.248 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950806+0000", 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.249 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950807+0000", 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5000000000000002e-07 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950812+0000", 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1959999999999999e-06 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950834+0000", 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2146000000000001e-05 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.250 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950843+0000", 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7730000000000005e-06 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010190+0000", 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.059346960999999997 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010421+0000", 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023052599999999999 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.251 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.010726+0000", 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00030552500000000001 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015247+0000", 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0045210880000000004 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024046+0000", 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0087986929999999998 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024215+0000", 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016874500000000001 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024323+0000", 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00010885799999999999 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3011914~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.253 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291840907000001, 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.073785273999999998, 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.254 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950853+0000", 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.8700000000000005e-07 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950864+0000", 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0926e-05 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950875+0000", 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0142999999999999e-05 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950882+0000", 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.2230000000000001e-06 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015328+0000", 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064446478000000001 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.256 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015459+0000", 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013096700000000001 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.015732+0000", 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027287299999999997 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020544+0000", 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0048119039999999997 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.257 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024366+0000", 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038220369999999999 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024532+0000", 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000166078 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024638+0000", 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000105858 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.258 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3013317~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291802705999999, 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074004029999999998, 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:09.259 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950891+0000", 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950892+0000", 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8400000000000004e-07 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950895+0000", 2024-09-20T20:32:09.260 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6100000000000002e-06 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950907+0000", 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1866e-05 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950914+0000", 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9659999999999999e-06 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.261 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016779+0000", 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065864727999999997 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.016912+0000", 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013328 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.017100+0000", 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00018804800000000001 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.262 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021712+0000", 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0046123190000000001 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024658+0000", 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0029460950000000001 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024795+0000", 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013685600000000001 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.263 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024895+0000", 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.9578000000000001e-05 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3014717~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291771126999997, 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.074236828000000005, 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.264 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950922+0000", 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950923+0000", 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9299999999999997e-07 2024-09-20T20:32:09.265 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950933+0000", 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0073e-05 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950956+0000", 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3181999999999999e-05 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950964+0000", 2024-09-20T20:32:09.266 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6029999999999999e-06 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018233+0000", 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.067268729999999999 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018346+0000", 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000113754 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.018515+0000", 2024-09-20T20:32:09.267 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016815499999999999 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021773+0000", 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003258613 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.024921+0000", 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003147361 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025052+0000", 2024-09-20T20:32:09.268 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013135600000000001 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.025159+0000", 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000107308 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3016123~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291719633, 2024-09-20T20:32:09.269 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075524506000000005, 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950974+0000", 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.270 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950975+0000", 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6300000000000004e-07 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950979+0000", 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950991+0000", 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2176e-05 2024-09-20T20:32:09.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.950998+0000", 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9430000000000003e-06 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019117+0000", 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.068118933000000007 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019272+0000", 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00015520599999999999 2024-09-20T20:32:09.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.019503+0000", 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023074599999999999 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026371+0000", 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006868407 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026422+0000", 2024-09-20T20:32:09.273 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.1406000000000002e-05 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026458+0000", 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.5450000000000001e-05 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026498+0000", 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0499e-05 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3017526~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291685287999996, 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075668536999999994, 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951008+0000", 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951009+0000", 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9599999999999999e-07 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951013+0000", 2024-09-20T20:32:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6440000000000002e-06 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951024+0000", 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1292e-05 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951031+0000", 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.8929999999999999e-06 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.277 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020598+0000", 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.069567433999999997 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020681+0000", 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.2447000000000005e-05 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.020815+0000", 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00013425199999999999 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.278 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.279 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026377+0000", 2024-09-20T20:32:09.279 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0055620060000000004 2024-09-20T20:32:09.279 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.279 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.279 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026555+0000", 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000177963 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026622+0000", 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6878999999999994e-05 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026677+0000", 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5031000000000002e-05 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.280 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3018931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291654389999998, 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.075742174999999995, 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.281 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951039+0000", 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951040+0000", 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5700000000000002e-07 2024-09-20T20:32:09.282 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951049+0000", 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7530000000000007e-06 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951061+0000", 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2186e-05 2024-09-20T20:32:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951078+0000", 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7518999999999999e-05 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021293+0000", 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070214347999999996 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021345+0000", 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2638e-05 2024-09-20T20:32:09.284 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021420+0000", 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.5201e-05 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026381+0000", 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.004960496 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026728+0000", 2024-09-20T20:32:09.285 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000347518 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026759+0000", 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.0871999999999999e-05 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026781+0000", 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.1987000000000001e-05 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.286 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3020330~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291605326000003, 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076885060000000005, 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.287 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951088+0000", 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951089+0000", 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.37e-07 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951093+0000", 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.9770000000000002e-06 2024-09-20T20:32:09.288 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951106+0000", 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2582000000000001e-05 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951112+0000", 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.9330000000000004e-06 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.289 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021810+0000", 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.070697096000000001 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.021883+0000", 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.3711e-05 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022011+0000", 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000128028 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.290 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026385+0000", 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0043738659999999997 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027878+0000", 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001493295 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027933+0000", 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.4669999999999997e-05 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.291 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.027973+0000", 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0164999999999999e-05 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3021727~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.291572561000002, 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077288854000000004, 2024-09-20T20:32:09.292 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.293 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951121+0000", 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951122+0000", 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.5300000000000004e-07 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951132+0000", 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0487e-05 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.294 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951145+0000", 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2636000000000001e-05 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.951152+0000", 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1899999999999998e-06 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022372+0000", 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071219987999999998 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.295 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022622+0000", 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00024959400000000001 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.022972+0000", 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00035073 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.026390+0000", 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.003417214 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.296 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028133+0000", 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.001743042 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028290+0000", 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000157083 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.028410+0000", 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012023699999999999 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.297 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:191 3.1d 3:bec1251c:::200.00000007:head [write 3070117~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.272806561000003, 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077804482999999994, 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969887+0000", 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969889+0000", 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8199999999999999e-06 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.299 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969900+0000", 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.1456e-05 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969923+0000", 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.3129000000000002e-05 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.969942+0000", 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8882e-05 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.300 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030663+0000", 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060720226000000002 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030724+0000", 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1838e-05 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.030820+0000", 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.6034999999999998e-05 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.301 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038187+0000", 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0073667840000000004 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047568+0000", 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093806480000000001 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047627+0000", 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9562000000000003e-05 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.302 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047691+0000", 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4103000000000006e-05 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:192 3.1d 3:bec1251c:::200.00000007:head [write 3071526~1422 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.27231141, 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.077458403999999995, 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.303 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970382+0000", 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970384+0000", 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4360000000000001e-06 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970391+0000", 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6939999999999995e-06 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970408+0000", 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6589e-05 2024-09-20T20:32:09.305 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.970419+0000", 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0729e-05 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031204+0000", 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.060785126000000002 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031281+0000", 2024-09-20T20:32:09.306 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7206000000000006e-05 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.031373+0000", 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.2485000000000006e-05 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038465+0000", 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0070911489999999997 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.307 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047739+0000", 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0092739850000000002 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047794+0000", 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5563000000000003e-05 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047841+0000", 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6442e-05 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.308 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:193 3.1d 3:bec1251c:::200.00000007:head [write 3072948~1411 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.271645774, 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076936761000000006, 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:09.309 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971048+0000", 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971049+0000", 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.2100000000000001e-06 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.310 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971055+0000", 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.4860000000000002e-06 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971071+0000", 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5159e-05 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971080+0000", 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.0990000000000005e-06 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.311 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032337+0000", 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061257214999999997 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032393+0000", 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5894999999999999e-05 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032487+0000", 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4005999999999994e-05 2024-09-20T20:32:09.312 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039090+0000", 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0066029399999999999 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047892+0000", 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0088017010000000003 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047947+0000", 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.5037999999999997e-05 2024-09-20T20:32:09.313 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.047985+0000", 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8012000000000001e-05 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:194 3.1d 3:bec1251c:::200.00000007:head [write 3074359~1417 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.271051079000003, 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076481933000000002, 2024-09-20T20:32:09.314 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971642+0000", 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.315 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971644+0000", 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6640000000000001e-06 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971654+0000", 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4259999999999992e-06 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971676+0000", 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2645000000000001e-05 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.316 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971693+0000", 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.6276000000000001e-05 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.032901+0000", 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061208410999999997 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033002+0000", 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000100747 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.317 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033155+0000", 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000153065 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039097+0000", 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059420749999999998 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.318 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048032+0000", 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0089354050000000004 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048085+0000", 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.3273999999999998e-05 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048124+0000", 2024-09-20T20:32:09.319 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.8945000000000001e-05 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:195 3.1d 3:bec1251c:::200.00000007:head [write 3075776~1925 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.270924555000001, 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076749794999999996, 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.320 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971769+0000", 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971771+0000", 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5629999999999999e-06 2024-09-20T20:32:09.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971781+0000", 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0560000000000001e-05 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971812+0000", 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.1097999999999999e-05 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.322 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971830+0000", 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7339000000000001e-05 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033598+0000", 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.061768787999999998 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033649+0000", 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.0828000000000002e-05 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.323 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.033726+0000", 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.6663999999999996e-05 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040289+0000", 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.006563284 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048248+0000", 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0079586580000000004 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.324 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048418+0000", 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00016978100000000001 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048519+0000", 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000101232 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.325 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:196 3.1d 3:bec1251c:::200.00000007:head [write 3077701~4036 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.270841269999998, 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076855037000000001, 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.326 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971852+0000", 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971854+0000", 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4440000000000001e-06 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971871+0000", 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.7484999999999999e-05 2024-09-20T20:32:09.327 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971890+0000", 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.8442999999999999e-05 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.971919+0000", 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.8975e-05 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035105+0000", 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063186070999999996 2024-09-20T20:32:09.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035208+0000", 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000102885 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.035301+0000", 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.3420999999999999e-05 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.329 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.040294+0000", 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0049925919999999997 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048605+0000", 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0083115380000000003 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.330 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048664+0000", 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9311999999999997e-05 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048707+0000", 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.2870999999999997e-05 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:197 3.1d 3:bec1251c:::200.00000007:head [write 3081737~4746 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.331 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.269860817000001, 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076192115000000005, 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.332 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972833+0000", 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972835+0000", 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.2299999999999998e-06 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972872+0000", 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.6823999999999998e-05 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.333 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972902+0000", 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.9802999999999999e-05 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972917+0000", 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.5345e-05 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038493+0000", 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065575759999999997 2024-09-20T20:32:09.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038553+0000", 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.9830000000000001e-05 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.038702+0000", 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000149839 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.042959+0000", 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0042564059999999999 2024-09-20T20:32:09.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048807+0000", 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0058486600000000003 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.048937+0000", 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012981900000000001 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049025+0000", 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.7598999999999999e-05 2024-09-20T20:32:09.336 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:198 3.1d 3:bec1251c:::200.00000007:head [write 3086483~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 37.269749836000003, 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.076240024000000003, 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.337 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972944+0000", 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972945+0000", 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0300000000000001e-06 2024-09-20T20:32:09.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972959+0000", 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.4273e-05 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972972+0000", 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.3101999999999999e-05 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.339 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:31.972981+0000", 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4800000000000001e-06 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039134+0000", 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.066152915000000007 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039191+0000", 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.7636999999999997e-05 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.340 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for subops from 0", 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.039281+0000", 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.9992000000000002e-05 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "op_commit", 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.045224+0000", 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0059432479999999999 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049083+0000", 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0038584159999999999 2024-09-20T20:32:09.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049144+0000", 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.0878999999999998e-05 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:31:32.049184+0000", 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.0052000000000002e-05 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19324 4.36 4:6f6a1eb0:::1000000009d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 4.4802274669999997, 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071661269, 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762466+0000", 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762467+0000", 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.6400000000000003e-07 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.344 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762469+0000", 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.0439999999999998e-06 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762476+0000", 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.182e-06 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762482+0000", 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.6100000000000002e-06 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.345 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.768980+0000", 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064977519999999999 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769112+0000", 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131979 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834127+0000", 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.065015238000000003 2024-09-20T20:32:09.346 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19361 4.36 4:6c9ae960:::100000000c2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 4.4798682410000001, 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.071416802000000001, 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.347 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762825+0000", 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762826+0000", 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 4.8599999999999998e-07 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762834+0000", 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.4349999999999997e-06 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762844+0000", 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 9.4329999999999993e-06 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762851+0000", 2024-09-20T20:32:09.349 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.1679999999999998e-06 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769814+0000", 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0069627739999999997 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.769938+0000", 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012389500000000001 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.350 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834242+0000", 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.064304610999999998 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(mds.0.3:19366 4.36 4:6e30e37c:::100000000c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 4.4797977900000001, 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.072017450999999996, 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: "continuous": false, 2024-09-20T20:32:09.351 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "started", 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "events": [ 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "header_read", 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.352 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762896+0000", 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 5.2900000000000004e-07 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762899+0000", 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.238e-06 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762906+0000", 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.746e-06 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.353 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.762912+0000", 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 6.1210000000000003e-06 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "reached_pg", 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.771140+0000", 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0082274280000000002 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.771291+0000", 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000151636 2024-09-20T20:32:09.354 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2024-09-20T20:32:04.834913+0000", 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.063621753000000003 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-20T20:32:09.355 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-20T20:32:09.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:32:09.357 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:09.354+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:09.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:09.366 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-20T20:32:09.366 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-20T20:32:09.366 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-20T20:32:09.366 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:32:09.366 INFO:teuthology.orchestra.console.smithi079:Power on 2024-09-20T20:32:09.366 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-20T20:32:09.387 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2024-09-20T20:32:09.458 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:09.450+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:09.488 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:09.488 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:32:09.489 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-09-20T20:32:09.489 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:09.504 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:09.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-20T20:32:09.558 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:09.552+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:09.659 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:09.656+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:09.662 INFO:teuthology.orchestra.run.smithi070.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-20T20:32:09.665 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-20T20:32:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-09-20T20:32:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-09-20T20:32:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-09-20T20:32:09.666 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-20T20:32:09.680 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:09.683 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-20T20:32:09.684 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-20T20:32:09.703 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-20T20:32:09.704 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-20T20:32:09.707 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-20T20:32:09.707 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-20T20:32:09.728 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:32:09.759 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:09.756+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:09.808 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:09.808 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:09.822 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:09.867 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:09.864+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:09.957 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:09.957 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:09.961 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:09.956+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:09.972 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:10.062 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:10.056+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:10.135 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:10.135 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:10.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:10.163 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:10.158+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:10.264 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:10.258+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:10.314 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:10.314 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:10.328 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:10.375 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:10.370+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:10.465 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:10.460+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:10.477 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:10.565 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:10.558+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:10.646 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:10.646 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:10.660 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:10.669 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:10.660+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:10.767 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:10.764+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:10.828 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:10.828 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:10.842 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-20T20:32:10.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-09-20T20:32:10.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:32:10.853 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-20T20:32:10.868 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:10.862+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:10.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:32:10.925 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-20T20:32:10.931 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-20T20:32:10.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:32:10.932 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T20:32:10.969 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:10.964+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:10.975 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:10.975 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:10.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-20T20:32:10.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T20:32:10.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-20T20:32:11.079 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-09-20T20:32:11.076+0000 7f07f22ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22921) UID: 0 2024-09-20T20:32:11.153 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:11.153 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:11.167 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-20T20:32:11.171 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-09-20T20:32:11.166+0000 7fcfe7cc8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22993) UID: 0 2024-09-20T20:32:11.186 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-20T20:32:11.197 INFO:tasks.thrashosds:joining thrashosds 2024-09-20T20:32:11.327 INFO:teuthology.orchestra.run.smithi090.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:11.327 INFO:teuthology.orchestra.run.smithi090.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:11.341 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-20T20:32:11.475 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:11.475 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:11.489 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-20T20:32:11.611 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:11.611 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:11.625 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-20T20:32:11.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-20T20:32:11.749 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-09-20T20:32:11.749 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-20T20:32:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-20T20:32:12.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-20T20:32:13.389 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T20:32:13.500 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-09-20T20:32:13.738 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-20T20:32:14.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~18s 2024-09-20T20:32:17.500 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-20T20:32:17.611 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-09-20T20:32:17.611 INFO:teuthology.orchestra.console.smithi079:Power on completed 2024-09-20T20:32:17.712 DEBUG:teuthology.orchestra.console.smithi079:Waiting for login prompt 2024-09-20T20:32:17.713 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi079 2024-09-20T20:32:20.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-09-20T20:32:25.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-09-20T20:32:31.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-09-20T20:32:37.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-09-20T20:32:43.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~47s 2024-09-20T20:32:49.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2024-09-20T20:32:55.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2024-09-20T20:33:00.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-09-20T20:33:06.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-09-20T20:33:12.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-09-20T20:33:18.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~82s 2024-09-20T20:33:24.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~87s 2024-09-20T20:33:29.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2024-09-20T20:33:35.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-09-20T20:33:41.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-09-20T20:33:47.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2024-09-20T20:33:53.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~116s 2024-09-20T20:33:58.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2024-09-20T20:34:04.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~128s 2024-09-20T20:34:06.391 DEBUG:teuthology.orchestra.console.smithi079:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F CE 87 GUID: 00000000 0000 0000 0000 0CC47AD8A16A DHCP.-                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- CLIENT IP: 172.21.15.79 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:ce:87)... Configuring (net0 0c:c4:7a:8f:ce:87).... Configuring (net0 0c:c4:7a:8f:ce:87)..... Configuring (net0 0c:c4:7a:8f:ce:87)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-122-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-122-generic (buildd@lcy02-amd64-034) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 (Ubuntu 5.15.0-122.132-generic 5.15.163) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.732 MHz processor [ 0.000413] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000592] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001881] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.008392] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008407] Using GB pages for direct mapping [ 0.008531] RAMDISK: [mem 0x300c3000-0x34058fff] [ 0.008536] ACPI: Early table checksum verification disabled [ 0.008539] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008543] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.008548] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008553] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008556] ACPI: FACS 0x0000000079D49F80 000040 [ 0.008559] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008562] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008564] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008567] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008570] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008573] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008576] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008579] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008582] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008585] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008587] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008590] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008593] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008596] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008599] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008602] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008605] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008607] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.008609] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.008610] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.008611] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.008612] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.008613] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.008614] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.008615] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.008616] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.008617] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.008618] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.008619] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.008620] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.008621] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.008622] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.008623] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.008624] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.008625] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.008626] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.008627] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.008722] No NUMA configuration found [ 0.008723] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008731] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.009064] Zone ranges: [ 0.009065] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.009067] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.009069] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.009071] Device empty [ 0.009072] Movable zone start for each node [ 0.009075] Early memory node ranges [ 0.009075] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.009077] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.009078] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.009083] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009088] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009122] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.078368] On node 0, zone Normal: 28990 pages in unavailable ranges [ 0.078482] ACPI: PM-Timer IO Port: 0x408 [ 0.078490] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.078491] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.078492] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.078493] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.078494] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.078495] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.078496] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.078497] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.078506] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.078510] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.078513] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.078514] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.078518] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.078519] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.078523] TSC deadline timer available [ 0.078524] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.078534] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.078536] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.078537] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.078538] PM: hibernation: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.078539] PM: hibernation: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.078540] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.078541] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.078542] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.078543] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.078544] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.078545] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.078547] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.078548] Booting paravirtualized kernel on bare hardware [ 0.078550] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.078557] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.078770] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.078802] Built 1 zonelists, mobility grouping on. Total pages: 8228742 [ 0.078803] Policy zone: Normal [ 0.078805] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.078863] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic", will be passed to user space. [ 0.080999] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.082134] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.082223] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.166946] Memory: 32672640K/33438000K available (16392K kernel code, 4397K rwdata, 10964K rodata, 3368K init, 18700K bss, 765100K reserved, 0K cma-reserved) [ 0.167229] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.167244] Kernel/User page tables isolation: enabled [ 0.167275] ftrace: allocating 50768 entries in 199 pages [ 0.187415] ftrace: allocated 199 pages with 5 groups [ 0.187539] rcu: Hierarchical RCU implementation. [ 0.187541] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.187543] Rude variant of Tasks RCU enabled. [ 0.187543] Tracing variant of Tasks RCU enabled. [ 0.187544] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.187545] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.190985] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.191183] random: crng init done [ 0.196058] Console: colour VGA+ 80x25 [ 0.207265] printk: console [tty0] enabled [ 1.178638] printk: console [ttyS1] enabled [ 1.182896] ACPI: Core revision 20210730 [ 1.187054] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.196278] APIC: Switch to symmetric I/O mode setup [ 1.201316] DMAR: Host address width 46 [ 1.205227] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.210614] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.218704] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.226135] DMAR: ATSR flags: 0x0 [ 1.229519] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.235855] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.242275] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.248698] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.254166] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.254167] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.269344] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.274718] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.280990] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.304285] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327253f73fc, max_idle_ns: 440795252387 ns [ 1.314900] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.46 BogoMIPS (lpj=13998928) [ 1.318916] CPU0: Thermal monitoring enabled (TM1) [ 1.322951] process: using mwait in idle threads [ 1.326900] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.330898] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.334900] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.338899] Spectre V2 : Mitigation: Retpolines [ 1.342898] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.346898] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.350898] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.354899] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.358898] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.362899] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.366901] MDS: Mitigation: Clear CPU buffers [ 1.370898] TAA: Mitigation: Clear CPU buffers [ 1.374898] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.378903] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.382898] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.386898] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.390899] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.394898] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.416791] Freeing SMP alternatives memory: 44K [ 1.418899] pid_max: default: 32768 minimum: 301 [ 1.422919] LSM: Security Framework initializing [ 1.426906] landlock: Up and running. [ 1.430898] Yama: becoming mindful. [ 1.434915] AppArmor: AppArmor initialized [ 1.438958] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.442938] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.447253] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.450904] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.455008] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.458899] ... version: 3 [ 1.462898] ... bit width: 48 [ 1.466898] ... generic registers: 4 [ 1.470898] ... value mask: 0000ffffffffffff [ 1.474898] ... max period: 00007fffffffffff [ 1.478898] ... fixed-purpose events: 3 [ 1.482898] ... event mask: 000000070000000f [ 1.486959] signal: max sigframe size: 1776 [ 1.490913] rcu: Hierarchical SRCU implementation. [ 1.495615] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.498963] smp: Bringing up secondary CPUs ... [ 1.502980] x86: Booting SMP configuration: [ 1.506901] .... node #0, CPUs: #1 #2 #3 #4 [ 1.515042] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.522899] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.526898] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.530998] #5 #6 #7 [ 1.531546] smp: Brought up 1 node, 8 CPUs [ 1.538901] smpboot: Max logical packages: 1 [ 1.542899] smpboot: Total of 8 processors activated (55995.71 BogoMIPS) [ 1.551013] devtmpfs: initialized [ 1.554319] x86/mm: Memory block size: 128MB [ 1.556501] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.558974] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.562909] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.566944] pinctrl core: initialized pinctrl subsystem [ 1.570989] PM: RTC time: 20:33:41, date: 2024-09-20 [ 1.575005] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.579231] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.583197] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.587228] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.590908] audit: initializing netlink subsys (disabled) [ 1.594918] audit: type=2000 audit(1726864419.356:1): state=initialized audit_enabled=0 res=1 [ 1.595011] thermal_sys: Registered thermal governor 'fair_share' [ 1.598900] thermal_sys: Registered thermal governor 'bang_bang' [ 1.602899] thermal_sys: Registered thermal governor 'step_wise' [ 1.606898] thermal_sys: Registered thermal governor 'user_space' [ 1.610898] thermal_sys: Registered thermal governor 'power_allocator' [ 1.614905] EISA bus registered [ 1.622114] cpuidle: using governor ladder [ 1.622901] cpuidle: using governor menu [ 1.626914] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.630899] ACPI: bus type PCI registered [ 1.634900] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.638953] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.642900] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.646912] PCI: Using configuration type 1 for base access [ 1.651925] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.654915] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.658900] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.662973] ACPI: Added _OSI(Module Device) [ 1.666901] ACPI: Added _OSI(Processor Device) [ 1.670906] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.674899] ACPI: Added _OSI(Processor Aggregator Device) [ 1.678899] ACPI: Added _OSI(Linux-Dell-Video) [ 1.682899] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.686899] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.736001] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.742379] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.747044] ACPI: Dynamic OEM Table Load: [ 1.776557] ACPI: Interpreter enabled [ 1.778910] ACPI: PM: (supports S0 S4 S5) [ 1.782899] ACPI: Using IOAPIC for interrupt routing [ 1.786923] HEST: Enabling Firmware First mode for corrected errors. [ 1.790976] HEST: Table parsing has been initialized. [ 1.795045] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.798901] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.802898] PCI: Using E820 reservations for host bridge windows [ 1.807582] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.841380] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.846902] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.856864] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.867907] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.874899] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.882933] PCI host bridge to bus 0000:ff [ 1.886899] pci_bus 0000:ff: root bus resource [bus ff] [ 1.890908] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.898964] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.902953] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.910951] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.914952] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.922951] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.930953] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.934950] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.942955] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.946950] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.954951] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.958956] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.966952] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.970951] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.978950] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.982953] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.990954] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.994949] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 2.002950] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 2.006924] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 2.014962] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 2.019003] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 2.026963] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 2.034963] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 2.038966] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 2.046964] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 2.050962] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 2.058953] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.070954] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.078964] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.082963] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.090963] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.094964] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.102959] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.106953] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.114952] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.118954] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.126965] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.130963] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.138964] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.146968] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.150957] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.158952] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.162953] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.170956] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.174952] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.182952] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.186953] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.194958] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.198952] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.206951] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.210952] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.218925] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.222954] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.230952] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.242927] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.246901] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.255220] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.267344] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.274899] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.283188] PCI host bridge to bus 0000:00 [ 2.286900] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.290899] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.298899] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.306899] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.310899] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.318899] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.326899] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.335004] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.343110] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.346964] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.355065] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.358964] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.367062] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.370963] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.379057] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.386918] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.391091] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.398918] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.407094] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.410918] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.419091] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.422917] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.431090] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.438918] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.443093] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.450918] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.459090] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.462918] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.471090] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.478917] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.483043] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.491117] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.495046] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.503069] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.510914] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.515138] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.523189] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.526920] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.534910] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.538910] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.546910] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.550910] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.554910] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.562939] pci 0000:00:11.4: PME# supported from D3hot [ 2.567058] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.574925] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.582975] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.587046] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.594924] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.598976] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.607043] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.610924] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.618975] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.627056] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.630922] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.639004] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.643051] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.650988] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.659060] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.662990] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.671060] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.674990] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.683073] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.686921] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.695003] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.699055] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.707173] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.714918] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.718909] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.722909] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.730909] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.734909] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.742909] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.746933] pci 0000:00:1f.2: PME# supported from D3hot [ 2.755040] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.758925] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.766930] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.771110] acpiphp: Slot [1] registered [ 2.774915] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.783070] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.786919] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.794940] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.802901] pci 0000:02:00.0: enabling Extended Tags [ 2.807001] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.810900] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.819075] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.822920] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.830908] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.838921] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.842907] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.850940] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.858919] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.866899] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.874911] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.882899] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.895061] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.898920] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.906907] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.910921] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.918908] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.926939] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.930915] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.938899] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.950912] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.958899] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.967031] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.974900] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.978899] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.986900] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.994929] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.998964] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 3.006987] pci 0000:05:00.0: enabling Extended Tags [ 3.010971] pci 0000:05:00.0: supports D1 D2 [ 3.014899] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 3.022989] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.026901] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.034900] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.038946] pci_bus 0000:06: extended config space not accessible [ 3.046929] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 3.050931] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 3.058915] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 3.066916] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 3.070989] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 3.078941] pci 0000:06:00.0: supports D1 D2 [ 3.082900] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 3.099011] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.102906] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.106902] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.111002] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 3.114927] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 3.122927] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 3.126913] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.135036] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.138937] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.146899] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.158924] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.166899] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.175086] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.182926] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.186926] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.194914] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.199029] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.206936] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.214899] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.222924] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.230899] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.243057] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.246900] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.250900] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.258902] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.267832] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 3.274946] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 3.278945] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 3.286944] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 3.290945] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 3.298899] ACPI: PCI: Interrupt link LNKE disabled [ 3.302943] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 3.306899] ACPI: PCI: Interrupt link LNKF disabled [ 3.314944] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 3.318899] ACPI: PCI: Interrupt link LNKG disabled [ 3.322944] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 3.330899] ACPI: PCI: Interrupt link LNKH disabled [ 3.335102] iommu: Default domain type: Translated [ 3.338899] iommu: DMA domain TLB invalidation policy: lazy mode [ 3.347034] SCSI subsystem initialized [ 3.350916] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.354898] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.366899] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.370899] vgaarb: loaded [ 3.373678] ACPI: bus type USB registered [ 3.378907] usbcore: registered new interface driver usbfs [ 3.382903] usbcore: registered new interface driver hub [ 3.390903] usbcore: registered new device driver usb [ 3.394914] pps_core: LinuxPPS API ver. 1 registered [ 3.398898] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.406901] PTP clock support registered [ 3.410906] EDAC MC: Ver: 3.0.0 [ 3.415012] NetLabel: Initializing [ 3.418899] NetLabel: domain hash size = 128 [ 3.422898] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.430909] NetLabel: unlabeled traffic allowed by default [ 3.434908] PCI: Using ACPI for IRQ routing [ 3.444100] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.450899] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.460938] clocksource: Switched to clocksource tsc-early [ 3.473069] VFS: Disk quotas dquot_6.6.0 [ 3.477076] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.484119] AppArmor: AppArmor Filesystem Enabled [ 3.488920] pnp: PnP ACPI init [ 3.492482] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.498471] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.504459] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.510446] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.516436] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.522423] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.528406] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.535090] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.541770] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.548455] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.555138] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.561820] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.568503] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.575380] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.581364] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.587354] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.593343] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.599332] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.606254] pnp: PnP ACPI: found 5 devices [ 3.615800] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.624798] NET: Registered PF_INET protocol family [ 3.629912] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.639194] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.648021] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.656016] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.664423] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.671955] TCP: Hash tables configured (established 262144 bind 65536) [ 3.678754] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.686533] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.693548] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.701006] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.706736] NET: Registered PF_XDP protocol family [ 3.711610] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.723188] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.731101] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.736147] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.741180] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.748046] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.755700] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.763699] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.771440] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.779528] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.787182] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.795185] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.802929] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.811018] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.818669] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.826670] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.834409] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.842496] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.850150] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.858149] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.865888] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.873977] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.879004] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.885167] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.892023] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.899858] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.904906] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.909940] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.916105] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.922980] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.928272] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.934434] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.941300] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.949127] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.957042] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.964876] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.972799] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.977833] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.983995] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.990850] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.998686] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 4.004930] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 4.018830] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 4.025769] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 4.032710] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 4.039654] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 4.046596] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 4.052931] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 4.058573] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 4.064911] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 4.072219] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 4.077858] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 4.084196] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 4.089835] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 4.096167] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 4.101806] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 4.108135] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 4.115653] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.147865] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 24347 usecs [ 4.179860] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23916 usecs [ 4.187360] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.193911] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.193923] Trying to unpack rootfs image as initramfs... [ 4.200417] software IO TLB: mapped [mem 0x0000000074ec2000-0x0000000078ec2000] (64MB) [ 4.214383] Initialise system trusted keyrings [ 4.218905] Key type blacklist registered [ 4.223027] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.230492] zbud: loaded [ 4.233289] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.239324] fuse: init (API version 7.34) [ 4.243554] integrity: Platform Keyring initialized [ 4.256492] Key type asymmetric registered [ 4.260660] Asymmetric key parser 'x509' registered [ 4.265633] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 4.273164] io scheduler mq-deadline registered [ 4.278218] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.284257] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.290284] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.296255] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.302233] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.308189] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.314159] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.321071] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 4.326857] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.335316] ACPI: button: Power Button [PWRB] [ 4.339772] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.347288] ACPI: button: Power Button [PWRF] [ 4.353066] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.360639] pstore: Registered erst as persistent store backend [ 4.366758] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.393692] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.422586] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.432174] Linux agpgart interface v0.103 [ 4.437977] loop: module loaded [ 4.441413] tun: Universal TUN/TAP device driver, 1.6 [ 4.446559] PPP generic driver version 2.4.2 [ 4.450939] VFIO - User Level meta-driver version: 0.3 [ 4.456276] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.462878] ehci-pci: EHCI PCI platform driver [ 4.467544] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.472845] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.480335] ehci-pci 0000:00:1a.0: debug port 2 [ 4.488863] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.507761] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.513625] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.521978] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.529291] usb usb1: Product: EHCI Host Controller [ 4.534240] usb usb1: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.540756] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.541180] Freeing initrd memory: 65112K [ 4.545573] hub 1-0:1.0: USB hub found [ 4.553344] hub 1-0:1.0: 2 ports detected [ 4.557668] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.562968] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.570460] ehci-pci 0000:00:1d.0: debug port 2 [ 4.578948] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.599788] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.605639] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.613989] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.621293] usb usb2: Product: EHCI Host Controller [ 4.626235] usb usb2: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.632740] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.637519] hub 2-0:1.0: USB hub found [ 4.641337] hub 2-0:1.0: 2 ports detected [ 4.645537] ehci-platform: EHCI generic platform driver [ 4.650843] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.657088] ohci-pci: OHCI PCI platform driver [ 4.661617] ohci-platform: OHCI generic platform driver [ 4.666910] uhci_hcd: USB Universal Host Controller Interface driver [ 4.673378] i8042: PNP: No PS/2 controller found. [ 4.678213] mousedev: PS/2 mouse device common for all mice [ 4.683928] rtc_cmos 00:00: RTC can wake from S4 [ 4.688826] rtc_cmos 00:00: registered as rtc0 [ 4.693369] rtc_cmos 00:00: setting system clock to 2024-09-20T20:33:44 UTC (1726864424) [ 4.701570] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.708344] i2c_dev: i2c /dev entries driver [ 4.712843] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.725128] device-mapper: uevent: version 1.0.3 [ 4.729875] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.738420] platform eisa.0: Probing EISA bus 0 [ 4.743015] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.749866] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.756373] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.762882] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.769392] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.775903] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.782411] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.788921] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.795430] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.801940] platform eisa.0: EISA: Detected 0 cards [ 4.806933] intel_pstate: Intel P-state driver initializing [ 4.813546] ledtrig-cpu: registered to indicate activity on CPUs [ 4.819764] drop_monitor: Initializing network drop monitor service [ 4.826198] NET: Registered PF_INET6 protocol family [ 4.838405] Segment Routing with IPv6 [ 4.842157] In-situ OAM (IOAM) with IPv6 [ 4.846161] NET: Registered PF_PACKET protocol family [ 4.851361] Key type dns_resolver registered [ 4.856157] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.862137] microcode: Microcode Update Driver: v2.2. [ 4.862223] resctrl: L3 allocation detected [ 4.871585] resctrl: L3 monitoring detected [ 4.875838] IPI shorthand broadcast: enabled [ 4.880191] sched_clock: Marking stable (3832454586, 1047721302)->(5251451045, -371275157) [ 4.888780] registered taskstats version 1 [ 4.891764] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.899675] Loading compiled-in X.509 certificates [ 4.905109] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.915533] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.925772] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.935861] blacklist: Loading compiled-in revocation X.509 certificates [ 4.942643] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.952565] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.963095] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.973976] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.979780] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.984520] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.001919] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.012711] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.023503] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.035255] zswap: loaded using pool lzo/zbud [ 5.039965] Key type .fscrypt registered [ 5.043951] Key type fscrypt-provisioning registered [ 5.049035] pstore: Using crash dump compression: deflate [ 5.052183] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.057221] Key type encrypted registered [ 5.062789] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.066858] AppArmor: AppArmor sha1 policy hashing enabled [ 5.066880] ima: No TPM chip found, activating TPM-bypass! [ 5.074599] hub 1-1:1.0: USB hub found [ 5.079646] Loading compiled-in module X.509 certificates [ 5.080116] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 5.096947] hub 1-1:1.0: 6 ports detected [ 5.102240] ima: Allocated hash algorithm: sha1 [ 5.102262] ima: No architecture policies found [ 5.125604] evm: Initialising EVM extended attributes: [ 5.130808] evm: security.selinux [ 5.134186] evm: security.SMACK64 [ 5.137564] evm: security.SMACK64EXEC [ 5.141294] evm: security.SMACK64TRANSMUTE [ 5.145454] evm: security.SMACK64MMAP [ 5.149181] evm: security.apparmor [ 5.152647] evm: security.ima [ 5.155678] evm: security.capability [ 5.159322] evm: HMAC attrs: 0x1 [ 5.160068] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.162876] PM: Magic number: 8:673:599 [ 5.170900] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.175013] serial8250 serial8250: hash matches [ 5.187174] RAS: Correctable Errors collector initialized. [ 5.187246] hub 2-1:1.0: USB hub found [ 5.192751] clk: Disabling unused clocks [ 5.199956] hub 2-1:1.0: 8 ports detected [ 5.205622] Freeing unused decrypted memory: 2036K [ 5.210959] Freeing unused kernel image (initmem) memory: 3368K [ 5.217001] Write protecting the kernel read-only data: 30720k [ 5.223269] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 5.230186] Freeing unused kernel image (rodata/data gap) memory: 1324K [ 5.275764] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.282268] x86/mm: Checking user space page tables [ 5.287217] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 5.293469] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 5.334753] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.341275] clocksource: Switched to clocksource tsc [ 5.341279] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 5.499088] dca service started, version 1.12.1 [ 5.505209] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.510518] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.518365] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.520577] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 5.526554] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.536056] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.543691] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.548782] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.556022] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 5.562182] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.567897] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.583572] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.584283] scsi host0: ahci [ 5.591928] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.595052] scsi host1: ahci [ 5.602203] usb usb3: Product: xHCI Host Controller [ 5.605247] scsi host2: ahci [ 5.610077] usb usb3: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.613154] scsi host3: ahci [ 5.619537] usb usb3: SerialNumber: 0000:00:14.0 [ 5.619597] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.619710] hub 3-0:1.0: USB hub found [ 5.619742] hub 3-0:1.0: 15 ports detected [ 5.622519] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.623336] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.623339] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.623340] usb usb4: Product: xHCI Host Controller [ 5.623341] usb usb4: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.623342] usb usb4: SerialNumber: 0000:00:14.0 [ 5.623451] hub 4-0:1.0: USB hub found [ 5.623468] hub 4-0:1.0: 6 ports detected [ 5.627169] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.632627] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.679924] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.683696] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.687781] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.691201] igb 0000:07:00.0: added PHC on eth0 [ 5.691233] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.691234] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a1:6a [ 5.691313] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.691315] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.693418] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.725092] nvme nvme0: pci function 0000:02:00.0 [ 5.732150] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.741851] nvme nvme0: 8/0/0 default/read/poll queues [ 5.744351] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.746933] igb 0000:07:00.1: added PHC on eth1 [ 5.790007] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.796947] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a1:6b [ 5.804230] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.809432] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.816125] scsi host4: ahci [ 5.820238] scsi host5: ahci [ 5.823329] scsi host6: ahci [ 5.826402] scsi host7:hci [ 5.829505] scsi host8: ahci [ 5.832610] scsi host9: ahci [ 5.835597] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 5.843085] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 5.850583] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 5.851404] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.858067] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 5.858069] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 5.878086] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 5.959731] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 6.046821] ata4: SATA link down (SStatus 0 SControl 300) [ 6.052317] ata2: SATA link down (SStatus 0 SControl 300) [ 6.057802] ata3: SATA link down (SStatus 0 SControl 300) [ 6.063353] ata1: SATA link down (SStatus 0 SControl 300) [ 6.111970] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 6.120330] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.128045] hub 3-12:1.0: USB hub found [ 6.132038] hub 3-12:1.0: 4 ports detected [ 6.196913] ata7: SATA link down (SStatus 0 SControl 300) [ 6.202431] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.208699] ata10: SATA link down (SStatus 0 SControl 300) [ 6.214276] ata8: SATA link down (SStatus 0 SControl 300) [ 6.219773] ata9: SATA link down (SStatus 0 SControl 300) [ 6.225272] ata6: SATA link down (SStatus 0 SControl 300) [ 6.312494] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.319436] ata5.00: NCQ Send/Recv Log not supported [ 6.324474] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.333004] ata5.00: NCQ Send/Recv Log not supported [ 6.338041] ata5.00: configured for UDMA/133 [ 6.342631] scsi 4:0:ST1000NM0033-9ZM51137] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.351219] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.364288] sd 4:0:0:0: [sda] Write Protect is off [ 6.369162] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.390039] sda: sda1 [ 6.392572] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.399869] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.443778] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.580158] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.588703] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.605415] hid: raw HID events driver (C) Jiri Kosina [ 6.614063] usbcore: registered new interface driver usbhid [ 6.619706] usbhid: USB HID core driver [ 6.625216] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.695877] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.707950] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.719841] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.888527] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.898926] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.915478] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.921734] ixgbe 0000:03:00.0: 0c:c4:7a:8f:ce:86 [ 6.930131] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.100527] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.110929] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.119550] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.126673] ixgbe 0000:03:00.1: 0c:c4:7a:8f:ce:87 [ 7.135033] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.142978] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.180716] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 199166/61054976 files, 6581679/244190336 blocks done. [ 7.357505] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 8.197018] systemd[1]: Inserted module 'autofs4' [ 8.279996] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.327908] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 8.373989] systemd[1]: Hostname set to . [ 9.673539] systemd[1]: Queued start job for default target Graphical Interface. [ 9.682276] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 9.704517] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 9.728492] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.751930] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 9.771989] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.796201] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.823923] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.851881] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.879874] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.907872] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.935860] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.963875] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.991942] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 10.015901] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 10.035909] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 10.060012] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 10.084134] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 10.109943] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 10.132135] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 10.152092] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 10.175994] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 10.200317] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 10.220085] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 10.244135] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 10.264241] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 10.288158] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 10.308083] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.329554] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 10.349475] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.373267] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.397488] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 10.417623] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 10.432683] RPC: Registered named UNIX socket transport module. [ 10.438683] RPC: Registered udp transport module. [ 10.443462] RPC: Registered tcp transport module. [ 10.448235] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 10.455928] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.475871] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.486944] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 10.508694] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 10.536757] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.564701] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 10.589142] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 10.608764] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.628758] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 10.652508] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 10.672496] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 10.696659] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 10.720807] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 10.739823] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.749643] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.761493] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.780539] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.804869] systemd[1]: Starting Coldplug All udev Devices... Startin[ 10.811281] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. g Coldplug All udev Devices... [ 10.833710] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ 10.863830] lp: driver loaded but no devices found [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesyst[ 10.889144] Loading iSCSI transport class v2.0-870. em. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 11.172202] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 11.238226] systemd-journald[360]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished Load AppArmor profiles. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Started RPC bind portmap service. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting LVM event activation on device 259:0... [ OK ] Started Network Configuration. [ OK  Helper to synchronize boot up for ifupdown. [ OK ] Listening on Docker Socket for the API. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reac9mceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Started User Login Management. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [* ] (1 of 6) A start job is running for Accounts Service (7s / 1min 34s) M [** ] (1 of 6) A start job is running for Accounts Service (7s / 1min 34s) M [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr Starting NFS status monitor for NFSv2/3 locking.... ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.79 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. Starting Authorization Manager... [ OK ] Started Network Time Service. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... + '[' 172.21.15.79 '!=' '' ']' + set -e + '[' -n 172.21.15.79 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.79 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.79 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi079.front.sepia.ceph.com + '[' -n smithi079.front.sepia.ceph.com ']' + hostname smithi079.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi079 + echo smithi079 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.79 smithi079.front.sepia.ceph.com smithi079/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started (i)SCSI target daemon. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started The Apache HTTP Server. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi079.front.sepia.ceph.com ttyS1 2024-09-20T20:34:06.392 DEBUG:teuthology.orchestra.console.smithi079:expect after: smithi079 login: 2024-09-20T20:34:06.445 DEBUG:teuthology.orchestra.console.smithi079:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F CE 87 GUID: 00000000 0000 0000 0000 0CC47AD8A16A DHCP.-                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- CLIENT IP: 172.21.15.79 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:ce:87)... Configuring (net0 0c:c4:7a:8f:ce:87).... Configuring (net0 0c:c4:7a:8f:ce:87)..... Configuring (net0 0c:c4:7a:8f:ce:87)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-122-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-122-generic (buildd@lcy02-amd64-034) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 (Ubuntu 5.15.0-122.132-generic 5.15.163) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.732 MHz processor [ 0.000413] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000592] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001881] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.008392] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008407] Using GB pages for direct mapping [ 0.008531] RAMDISK: [mem 0x300c3000-0x34058fff] [ 0.008536] ACPI: Early table checksum verification disabled [ 0.008539] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008543] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.008548] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008553] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008556] ACPI: FACS 0x0000000079D49F80 000040 [ 0.008559] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008562] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008564] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008567] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008570] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008573] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008576] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008579] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008582] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008585] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008587] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008590] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008593] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008596] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008599] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008602] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008605] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008607] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.008609] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.008610] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.008611] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.008612] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.008613] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.008614] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.008615] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.008616] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.008617] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.008618] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.008619] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.008620] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.008621] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.008622] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.008623] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.008624] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.008625] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.008626] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.008627] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.008722] No NUMA configuration found [ 0.008723] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008731] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.009064] Zone ranges: [ 0.009065] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.009067] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.009069] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.009071] Device empty [ 0.009072] Movable zone start for each node [ 0.009075] Early memory node ranges [ 0.009075] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.009077] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.009078] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.009083] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009088] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009122] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.078368] On node 0, zone Normal: 28990 pages in unavailable ranges [ 0.078482] ACPI: PM-Timer IO Port: 0x408 [ 0.078490] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.078491] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.078492] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.078493] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.078494] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.078495] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.078496] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.078497] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.078506] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.078510] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.078513] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.078514] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.078518] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.078519] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.078523] TSC deadline timer available [ 0.078524] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.078534] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.078536] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.078537] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.078538] PM: hibernation: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.078539] PM: hibernation: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.078540] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.078541] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.078542] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.078543] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.078544] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.078545] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.078547] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.078548] Booting paravirtualized kernel on bare hardware [ 0.078550] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.078557] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.078770] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.078802] Built 1 zonelists, mobility grouping on. Total pages: 8228742 [ 0.078803] Policy zone: Normal [ 0.078805] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.078863] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic", will be passed to user space. [ 0.080999] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.082134] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.082223] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.166946] Memory: 32672640K/33438000K available (16392K kernel code, 4397K rwdata, 10964K rodata, 3368K init, 18700K bss, 765100K reserved, 0K cma-reserved) [ 0.167229] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.167244] Kernel/User page tables isolation: enabled [ 0.167275] ftrace: allocating 50768 entries in 199 pages [ 0.187415] ftrace: allocated 199 pages with 5 groups [ 0.187539] rcu: Hierarchical RCU implementation. [ 0.187541] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.187543] Rude variant of Tasks RCU enabled. [ 0.187543] Tracing variant of Tasks RCU enabled. [ 0.187544] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.187545] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.190985] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.191183] random: crng init done [ 0.196058] Console: colour VGA+ 80x25 [ 0.207265] printk: console [tty0] enabled [ 1.178638] printk: console [ttyS1] enabled [ 1.182896] ACPI: Core revision 20210730 [ 1.187054] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.196278] APIC: Switch to symmetric I/O mode setup [ 1.201316] DMAR: Host address width 46 [ 1.205227] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.210614] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.218704] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.226135] DMAR: ATSR flags: 0x0 [ 1.229519] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.235855] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.242275] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.248698] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.254166] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.254167] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.269344] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.274718] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.280990] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.304285] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327253f73fc, max_idle_ns: 440795252387 ns [ 1.314900] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.46 BogoMIPS (lpj=13998928) [ 1.318916] CPU0: Thermal monitoring enabled (TM1) [ 1.322951] process: using mwait in idle threads [ 1.326900] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.330898] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.334900] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.338899] Spectre V2 : Mitigation: Retpolines [ 1.342898] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.346898] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.350898] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.354899] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.358898] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.362899] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.366901] MDS: Mitigation: Clear CPU buffers [ 1.370898] TAA: Mitigation: Clear CPU buffers [ 1.374898] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.378903] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.382898] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.386898] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.390899] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.394898] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.416791] Freeing SMP alternatives memory: 44K [ 1.418899] pid_max: default: 32768 minimum: 301 [ 1.422919] LSM: Security Framework initializing [ 1.426906] landlock: Up and running. [ 1.430898] Yama: becoming mindful. [ 1.434915] AppArmor: AppArmor initialized [ 1.438958] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.442938] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.447253] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.450904] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.455008] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.458899] ... version: 3 [ 1.462898] ... bit width: 48 [ 1.466898] ... generic registers: 4 [ 1.470898] ... value mask: 0000ffffffffffff [ 1.474898] ... max period: 00007fffffffffff [ 1.478898] ... fixed-purpose events: 3 [ 1.482898] ... event mask: 000000070000000f [ 1.486959] signal: max sigframe size: 1776 [ 1.490913] rcu: Hierarchical SRCU implementation. [ 1.495615] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.498963] smp: Bringing up secondary CPUs ... [ 1.502980] x86: Booting SMP configuration: [ 1.506901] .... node #0, CPUs: #1 #2 #3 #4 [ 1.515042] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.522899] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.526898] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.530998] #5 #6 #7 [ 1.531546] smp: Brought up 1 node, 8 CPUs [ 1.538901] smpboot: Max logical packages: 1 [ 1.542899] smpboot: Total of 8 processors activated (55995.71 BogoMIPS) [ 1.551013] devtmpfs: initialized [ 1.554319] x86/mm: Memory block size: 128MB [ 1.556501] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.558974] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.562909] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.566944] pinctrl core: initialized pinctrl subsystem [ 1.570989] PM: RTC time: 20:33:41, date: 2024-09-20 [ 1.575005] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.579231] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.583197] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.587228] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.590908] audit: initializing netlink subsys (disabled) [ 1.594918] audit: type=2000 audit(1726864419.356:1): state=initialized audit_enabled=0 res=1 [ 1.595011] thermal_sys: Registered thermal governor 'fair_share' [ 1.598900] thermal_sys: Registered thermal governor 'bang_bang' [ 1.602899] thermal_sys: Registered thermal governor 'step_wise' [ 1.606898] thermal_sys: Registered thermal governor 'user_space' [ 1.610898] thermal_sys: Registered thermal governor 'power_allocator' [ 1.614905] EISA bus registered [ 1.622114] cpuidle: using governor ladder [ 1.622901] cpuidle: using governor menu [ 1.626914] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.630899] ACPI: bus type PCI registered [ 1.634900] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.638953] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.642900] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.646912] PCI: Using configuration type 1 for base access [ 1.651925] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.654915] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.658900] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.662973] ACPI: Added _OSI(Module Device) [ 1.666901] ACPI: Added _OSI(Processor Device) [ 1.670906] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.674899] ACPI: Added _OSI(Processor Aggregator Device) [ 1.678899] ACPI: Added _OSI(Linux-Dell-Video) [ 1.682899] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.686899] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.736001] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.742379] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.747044] ACPI: Dynamic OEM Table Load: [ 1.776557] ACPI: Interpreter enabled [ 1.778910] ACPI: PM: (supports S0 S4 S5) [ 1.782899] ACPI: Using IOAPIC for interrupt routing [ 1.786923] HEST: Enabling Firmware First mode for corrected errors. [ 1.790976] HEST: Table parsing has been initialized. [ 1.795045] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.798901] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.802898] PCI: Using E820 reservations for host bridge windows [ 1.807582] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.841380] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.846902] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.856864] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.867907] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.874899] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.882933] PCI host bridge to bus 0000:ff [ 1.886899] pci_bus 0000:ff: root bus resource [bus ff] [ 1.890908] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.898964] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.902953] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.910951] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.914952] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.922951] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.930953] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.934950] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.942955] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.946950] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.954951] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.958956] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.966952] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.970951] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.978950] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.982953] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.990954] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.994949] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 2.002950] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 2.006924] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 2.014962] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 2.019003] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 2.026963] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 2.034963] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 2.038966] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 2.046964] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 2.050962] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 2.058953] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.070954] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.078964] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.082963] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.090963] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.094964] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.102959] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.106953] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.114952] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.118954] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.126965] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.130963] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.138964] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.146968] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.150957] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.158952] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.162953] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.170956] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.174952] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.182952] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.186953] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.194958] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.198952] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.206951] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.210952] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.218925] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.222954] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.230952] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.242927] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.246901] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.255220] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.267344] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.274899] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.283188] PCI host bridge to bus 0000:00 [ 2.286900] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.290899] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.298899] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.306899] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.310899] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.318899] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.326899] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.335004] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.343110] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.346964] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.355065] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.358964] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.367062] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.370963] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.379057] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.386918] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.391091] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.398918] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.407094] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.410918] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.419091] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.422917] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.431090] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.438918] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.443093] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.450918] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.459090] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.462918] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.471090] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.478917] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.483043] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.491117] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.495046] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.503069] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.510914] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.515138] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.523189] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.526920] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.534910] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.538910] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.546910] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.550910] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.554910] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.562939] pci 0000:00:11.4: PME# supported from D3hot [ 2.567058] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.574925] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.582975] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.587046] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.594924] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.598976] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.607043] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.610924] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.618975] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.627056] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.630922] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.639004] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.643051] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.650988] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.659060] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.662990] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.671060] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.674990] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.683073] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.686921] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.695003] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.699055] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.707173] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.714918] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.718909] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.722909] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.730909] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.734909] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.742909] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.746933] pci 0000:00:1f.2: PME# supported from D3hot [ 2.755040] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.758925] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.766930] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.771110] acpiphp: Slot [1] registered [ 2.774915] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.783070] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.786919] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.794940] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.802901] pci 0000:02:00.0: enabling Extended Tags [ 2.807001] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.810900] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.819075] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.822920] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.830908] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.838921] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.842907] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.850940] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.858919] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.866899] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.874911] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.882899] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.895061] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.898920] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.906907] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.910921] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.918908] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.926939] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.930915] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.938899] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.950912] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.958899] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.967031] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.974900] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.978899] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.986900] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.994929] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.998964] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 3.006987] pci 0000:05:00.0: enabling Extended Tags [ 3.010971] pci 0000:05:00.0: supports D1 D2 [ 3.014899] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 3.022989] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.026901] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.034900] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.038946] pci_bus 0000:06: extended config space not accessible [ 3.046929] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 3.050931] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 3.058915] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 3.066916] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 3.070989] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 3.078941] pci 0000:06:00.0: supports D1 D2 [ 3.082900] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 3.099011] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.102906] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.106902] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.111002] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 3.114927] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 3.122927] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 3.126913] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.135036] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.138937] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.146899] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.158924] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.166899] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.175086] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.182926] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.186926] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.194914] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.199029] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.206936] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.214899] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.222924] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.230899] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.243057] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.246900] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.250900] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.258902] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.267832] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 3.274946] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 3.278945] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 3.286944] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 3.290945] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 3.298899] ACPI: PCI: Interrupt link LNKE disabled [ 3.302943] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 3.306899] ACPI: PCI: Interrupt link LNKF disabled [ 3.314944] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 3.318899] ACPI: PCI: Interrupt link LNKG disabled [ 3.322944] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 3.330899] ACPI: PCI: Interrupt link LNKH disabled [ 3.335102] iommu: Default domain type: Translated [ 3.338899] iommu: DMA domain TLB invalidation policy: lazy mode [ 3.347034] SCSI subsystem initialized [ 3.350916] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.354898] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.366899] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.370899] vgaarb: loaded [ 3.373678] ACPI: bus type USB registered [ 3.378907] usbcore: registered new interface driver usbfs [ 3.382903] usbcore: registered new interface driver hub [ 3.390903] usbcore: registered new device driver usb [ 3.394914] pps_core: LinuxPPS API ver. 1 registered [ 3.398898] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.406901] PTP clock support registered [ 3.410906] EDAC MC: Ver: 3.0.0 [ 3.415012] NetLabel: Initializing [ 3.418899] NetLabel: domain hash size = 128 [ 3.422898] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.430909] NetLabel: unlabeled traffic allowed by default [ 3.434908] PCI: Using ACPI for IRQ routing [ 3.444100] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.450899] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.460938] clocksource: Switched to clocksource tsc-early [ 3.473069] VFS: Disk quotas dquot_6.6.0 [ 3.477076] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.484119] AppArmor: AppArmor Filesystem Enabled [ 3.488920] pnp: PnP ACPI init [ 3.492482] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.498471] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.504459] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.510446] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.516436] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.522423] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.528406] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.535090] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.541770] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.548455] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.555138] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.561820] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.568503] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.575380] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.581364] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.587354] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.593343] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.599332] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.606254] pnp: PnP ACPI: found 5 devices [ 3.615800] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.624798] NET: Registered PF_INET protocol family [ 3.629912] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.639194] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.648021] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.656016] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.664423] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.671955] TCP: Hash tables configured (established 262144 bind 65536) [ 3.678754] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.686533] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.693548] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.701006] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.706736] NET: Registered PF_XDP protocol family [ 3.711610] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.723188] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.731101] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.736147] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.741180] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.748046] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.755700] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.763699] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.771440] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.779528] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.787182] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.795185] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.802929] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.811018] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.818669] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.826670] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.834409] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.842496] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.850150] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.858149] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.865888] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.873977] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.879004] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.885167] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.892023] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.899858] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.904906] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.909940] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.916105] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.922980] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.928272] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.934434] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.941300] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.949127] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.957042] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.964876] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.972799] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.977833] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.983995] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.990850] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.998686] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 4.004930] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 4.018830] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 4.025769] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 4.032710] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 4.039654] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 4.046596] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 4.052931] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 4.058573] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 4.064911] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 4.072219] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 4.077858] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 4.084196] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 4.089835] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 4.096167] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 4.101806] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 4.108135] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 4.115653] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.147865] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 24347 usecs [ 4.179860] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23916 usecs [ 4.187360] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.193911] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.193923] Trying to unpack rootfs image as initramfs... [ 4.200417] software IO TLB: mapped [mem 0x0000000074ec2000-0x0000000078ec2000] (64MB) [ 4.214383] Initialise system trusted keyrings [ 4.218905] Key type blacklist registered [ 4.223027] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.230492] zbud: loaded [ 4.233289] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.239324] fuse: init (API version 7.34) [ 4.243554] integrity: Platform Keyring initialized [ 4.256492] Key type asymmetric registered [ 4.260660] Asymmetric key parser 'x509' registered [ 4.265633] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 4.273164] io scheduler mq-deadline registered [ 4.278218] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.284257] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.290284] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.296255] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.302233] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.308189] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.314159] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.321071] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 4.326857] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.335316] ACPI: button: Power Button [PWRB] [ 4.339772] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.347288] ACPI: button: Power Button [PWRF] [ 4.353066] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.360639] pstore: Registered erst as persistent store backend [ 4.366758] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.393692] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.422586] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.432174] Linux agpgart interface v0.103 [ 4.437977] loop: module loaded [ 4.441413] tun: Universal TUN/TAP device driver, 1.6 [ 4.446559] PPP generic driver version 2.4.2 [ 4.450939] VFIO - User Level meta-driver version: 0.3 [ 4.456276] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.462878] ehci-pci: EHCI PCI platform driver [ 4.467544] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.472845] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.480335] ehci-pci 0000:00:1a.0: debug port 2 [ 4.488863] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.507761] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.513625] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.521978] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.529291] usb usb1: Product: EHCI Host Controller [ 4.534240] usb usb1: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.540756] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.541180] Freeing initrd memory: 65112K [ 4.545573] hub 1-0:1.0: USB hub found [ 4.553344] hub 1-0:1.0: 2 ports detected [ 4.557668] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.562968] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.570460] ehci-pci 0000:00:1d.0: debug port 2 [ 4.578948] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.599788] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.605639] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.613989] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.621293] usb usb2: Product: EHCI Host Controller [ 4.626235] usb usb2: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.632740] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.637519] hub 2-0:1.0: USB hub found [ 4.641337] hub 2-0:1.0: 2 ports detected [ 4.645537] ehci-platform: EHCI generic platform driver [ 4.650843] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.657088] ohci-pci: OHCI PCI platform driver [ 4.661617] ohci-platform: OHCI generic platform driver [ 4.666910] uhci_hcd: USB Universal Host Controller Interface driver [ 4.673378] i8042: PNP: No PS/2 controller found. [ 4.678213] mousedev: PS/2 mouse device common for all mice [ 4.683928] rtc_cmos 00:00: RTC can wake from S4 [ 4.688826] rtc_cmos 00:00: registered as rtc0 [ 4.693369] rtc_cmos 00:00: setting system clock to 2024-09-20T20:33:44 UTC (1726864424) [ 4.701570] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.708344] i2c_dev: i2c /dev entries driver [ 4.712843] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.725128] device-mapper: uevent: version 1.0.3 [ 4.729875] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.738420] platform eisa.0: Probing EISA bus 0 [ 4.743015] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.749866] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.756373] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.762882] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.769392] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.775903] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.782411] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.788921] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.795430] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.801940] platform eisa.0: EISA: Detected 0 cards [ 4.806933] intel_pstate: Intel P-state driver initializing [ 4.813546] ledtrig-cpu: registered to indicate activity on CPUs [ 4.819764] drop_monitor: Initializing network drop monitor service [ 4.826198] NET: Registered PF_INET6 protocol family [ 4.838405] Segment Routing with IPv6 [ 4.842157] In-situ OAM (IOAM) with IPv6 [ 4.846161] NET: Registered PF_PACKET protocol family [ 4.851361] Key type dns_resolver registered [ 4.856157] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.862137] microcode: Microcode Update Driver: v2.2. [ 4.862223] resctrl: L3 allocation detected [ 4.871585] resctrl: L3 monitoring detected [ 4.875838] IPI shorthand broadcast: enabled [ 4.880191] sched_clock: Marking stable (3832454586, 1047721302)->(5251451045, -371275157) [ 4.888780] registered taskstats version 1 [ 4.891764] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.899675] Loading compiled-in X.509 certificates [ 4.905109] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.915533] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.925772] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.935861] blacklist: Loading compiled-in revocation X.509 certificates [ 4.942643] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.952565] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.963095] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.973976] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.979780] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.984520] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.001919] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.012711] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.023503] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.035255] zswap: loaded using pool lzo/zbud [ 5.039965] Key type .fscrypt registered [ 5.043951] Key type fscrypt-provisioning registered [ 5.049035] pstore: Using crash dump compression: deflate [ 5.052183] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.057221] Key type encrypted registered [ 5.062789] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.066858] AppArmor: AppArmor sha1 policy hashing enabled [ 5.066880] ima: No TPM chip found, activating TPM-bypass! [ 5.074599] hub 1-1:1.0: USB hub found [ 5.079646] Loading compiled-in module X.509 certificates [ 5.080116] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 5.096947] hub 1-1:1.0: 6 ports detected [ 5.102240] ima: Allocated hash algorithm: sha1 [ 5.102262] ima: No architecture policies found [ 5.125604] evm: Initialising EVM extended attributes: [ 5.130808] evm: security.selinux [ 5.134186] evm: security.SMACK64 [ 5.137564] evm: security.SMACK64EXEC [ 5.141294] evm: security.SMACK64TRANSMUTE [ 5.145454] evm: security.SMACK64MMAP [ 5.149181] evm: security.apparmor [ 5.152647] evm: security.ima [ 5.155678] evm: security.capability [ 5.159322] evm: HMAC attrs: 0x1 [ 5.160068] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.162876] PM: Magic number: 8:673:599 [ 5.170900] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.175013] serial8250 serial8250: hash matches [ 5.187174] RAS: Correctable Errors collector initialized. [ 5.187246] hub 2-1:1.0: USB hub found [ 5.192751] clk: Disabling unused clocks [ 5.199956] hub 2-1:1.0: 8 ports detected [ 5.205622] Freeing unused decrypted memory: 2036K [ 5.210959] Freeing unused kernel image (initmem) memory: 3368K [ 5.217001] Write protecting the kernel read-only data: 30720k [ 5.223269] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 5.230186] Freeing unused kernel image (rodata/data gap) memory: 1324K [ 5.275764] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.282268] x86/mm: Checking user space page tables [ 5.287217] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 5.293469] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 5.334753] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.341275] clocksource: Switched to clocksource tsc [ 5.341279] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 5.499088] dca service started, version 1.12.1 [ 5.505209] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.510518] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.518365] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.520577] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 5.526554] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.536056] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.543691] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.548782] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.556022] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 5.562182] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.567897] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.583572] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.584283] scsi host0: ahci [ 5.591928] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.595052] scsi host1: ahci [ 5.602203] usb usb3: Product: xHCI Host Controller [ 5.605247] scsi host2: ahci [ 5.610077] usb usb3: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.613154] scsi host3: ahci [ 5.619537] usb usb3: SerialNumber: 0000:00:14.0 [ 5.619597] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.619710] hub 3-0:1.0: USB hub found [ 5.619742] hub 3-0:1.0: 15 ports detected [ 5.622519] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.623336] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.623339] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.623340] usb usb4: Product: xHCI Host Controller [ 5.623341] usb usb4: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.623342] usb usb4: SerialNumber: 0000:00:14.0 [ 5.623451] hub 4-0:1.0: USB hub found [ 5.623468] hub 4-0:1.0: 6 ports detected [ 5.627169] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.632627] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.679924] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.683696] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.687781] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.691201] igb 0000:07:00.0: added PHC on eth0 [ 5.691233] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.691234] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a1:6a [ 5.691313] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.691315] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.693418] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.725092] nvme nvme0: pci function 0000:02:00.0 [ 5.732150] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.741851] nvme nvme0: 8/0/0 default/read/poll queues [ 5.744351] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.746933] igb 0000:07:00.1: added PHC on eth1 [ 5.790007] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.796947] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a1:6b [ 5.804230] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.809432] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.816125] scsi host4: ahci [ 5.820238] scsi host5: ahci [ 5.823329] scsi host6: ahci [ 5.826402] scsi host7:hci [ 5.829505] scsi host8: ahci [ 5.832610] scsi host9: ahci [ 5.835597] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 5.843085] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 5.850583] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 5.851404] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.858067] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 5.858069] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 5.878086] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 5.959731] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 6.046821] ata4: SATA link down (SStatus 0 SControl 300) [ 6.052317] ata2: SATA link down (SStatus 0 SControl 300) [ 6.057802] ata3: SATA link down (SStatus 0 SControl 300) [ 6.063353] ata1: SATA link down (SStatus 0 SControl 300) [ 6.111970] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 6.120330] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.128045] hub 3-12:1.0: USB hub found [ 6.132038] hub 3-12:1.0: 4 ports detected [ 6.196913] ata7: SATA link down (SStatus 0 SControl 300) [ 6.202431] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.208699] ata10: SATA link down (SStatus 0 SControl 300) [ 6.214276] ata8: SATA link down (SStatus 0 SControl 300) [ 6.219773] ata9: SATA link down (SStatus 0 SControl 300) [ 6.225272] ata6: SATA link down (SStatus 0 SControl 300) [ 6.312494] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.319436] ata5.00: NCQ Send/Recv Log not supported [ 6.324474] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.333004] ata5.00: NCQ Send/Recv Log not supported [ 6.338041] ata5.00: configured for UDMA/133 [ 6.342631] scsi 4:0:ST1000NM0033-9ZM51137] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.351219] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.364288] sd 4:0:0:0: [sda] Write Protect is off [ 6.369162] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.390039] sda: sda1 [ 6.392572] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.399869] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.443778] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.580158] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.588703] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.605415] hid: raw HID events driver (C) Jiri Kosina [ 6.614063] usbcore: registered new interface driver usbhid [ 6.619706] usbhid: USB HID core driver [ 6.625216] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.695877] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.707950] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.719841] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.888527] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.898926] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.915478] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.921734] ixgbe 0000:03:00.0: 0c:c4:7a:8f:ce:86 [ 6.930131] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.100527] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.110929] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.119550] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.126673] ixgbe 0000:03:00.1: 0c:c4:7a:8f:ce:87 [ 7.135033] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.142978] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.180716] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 199166/61054976 files, 6581679/244190336 blocks done. [ 7.357505] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 8.197018] systemd[1]: Inserted module 'autofs4' [ 8.279996] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.327908] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 8.373989] systemd[1]: Hostname set to . [ 9.673539] systemd[1]: Queued start job for default target Graphical Interface. [ 9.682276] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 9.704517] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 9.728492] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.751930] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 9.771989] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.796201] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.823923] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.851881] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.879874] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.907872] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.935860] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.963875] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.991942] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 10.015901] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 10.035909] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 10.060012] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 10.084134] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 10.109943] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 10.132135] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 10.152092] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 10.175994] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 10.200317] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 10.220085] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 10.244135] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 10.264241] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 10.288158] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 10.308083] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.329554] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 10.349475] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.373267] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.397488] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 10.417623] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 10.432683] RPC: Registered named UNIX socket transport module. [ 10.438683] RPC: Registered udp transport module. [ 10.443462] RPC: Registered tcp transport module. [ 10.448235] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 10.455928] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.475871] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.486944] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 10.508694] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 10.536757] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.564701] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 10.589142] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 10.608764] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.628758] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 10.652508] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 10.672496] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 10.696659] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 10.720807] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 10.739823] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.749643] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.761493] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.780539] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.804869] systemd[1]: Starting Coldplug All udev Devices... Startin[ 10.811281] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. g Coldplug All udev Devices... [ 10.833710] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ 10.863830] lp: driver loaded but no devices found [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesyst[ 10.889144] Loading iSCSI transport class v2.0-870. em. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 11.172202] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 11.238226] systemd-journald[360]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished Load AppArmor profiles. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Started RPC bind portmap service. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting LVM event activation on device 259:0... [ OK ] Started Network Configuration. [ OK  Helper to synchronize boot up for ifupdown. [ OK ] Listening on Docker Socket for the API. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reac9mceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Started RPC Remote Quota Server. [ OK ] Started System Logging Service. [ OK ] Started User Login Management. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [* ] (1 of 6) A start job is running for Accounts Service (7s / 1min 34s) M [** ] (1 of 6) A start job is running for Accounts Service (7s / 1min 34s) M [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr Starting NFS status monitor for NFSv2/3 locking.... ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.79 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. Starting Authorization Manager... [ OK ] Started Network Time Service. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... + '[' 172.21.15.79 '!=' '' ']' + set -e + '[' -n 172.21.15.79 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.79 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.79 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi079.front.sepia.ceph.com + '[' -n smithi079.front.sepia.ceph.com ']' + hostname smithi079.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi079 + echo smithi079 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.79 smithi079.front.sepia.ceph.com smithi079/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started (i)SCSI target daemon. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started The Apache HTTP Server. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi079.front.sepia.ceph.com ttyS1 smithi079 login: [disconnect] 2024-09-20T20:34:06.547 INFO:teuthology.misc:Re-opening connections... 2024-09-20T20:34:06.547 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:34:06.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:34:06.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T20:34:06.764 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-20T20:34:07.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-20T20:34:07.269 DEBUG:teuthology.misc:waited 0.7211437225341797 2024-09-20T20:34:08.269 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:34:08.270 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi079.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-09-20T20:34:08.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-20T20:34:08.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-09-20T20:34:08.395 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-20T20:34:08.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-20T20:34:08.437 INFO:tasks.ceph.osd.0:Started 2024-09-20T20:34:08.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:34:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-20T20:34:08.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T20:34:08.553 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-20T20:34:10.153 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:34:10.115+0000 7f5ae90827c0 -1 Falling back to public interface 2024-09-20T20:34:10.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-20T20:34:13.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:34:13.686 INFO:teuthology.orchestra.run.smithi079.stderr:no valid command found; 10 closest matches: 2024-09-20T20:34:13.686 INFO:teuthology.orchestra.run.smithi079.stderr:0 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:1 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:2 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:abort 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:assert 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs debug_inject_read_zeros 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs files list 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs stats 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator dump block 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator fragmentation block 2024-09-20T20:34:13.687 INFO:teuthology.orchestra.run.smithi079.stderr:admin_socket: invalid command 2024-09-20T20:34:13.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-20T20:34:13.690 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-20T20:34:14.977 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:34:14.939+0000 7f5ae90827c0 -1 osd.0 57 log_to_monitors true 2024-09-20T20:34:15.820 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-20T20:34:15.783+0000 7f5adce60640 -1 osd.0 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T20:34:18.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-20T20:34:18.823 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-20T20:34:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-20T20:34:18.824 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-20T20:34:18.824 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-20T20:34:23.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-20T20:34:23.987 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2024-09-20T20:34:23.987 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T20:34:23.996 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2024-09-20T20:34:23.996 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T20:34:24.006 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2024-09-20T20:34:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-20T20:34:24.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-20T20:34:24.650 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-20T20:34:24.672 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-20T20:34:25.658 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-20T20:34:25.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-20T20:34:26.677 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-20T20:34:26.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-20T20:34:27.642 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-20T20:34:27.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-20T20:34:28.652 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-20T20:34:28.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-20T20:34:29.654 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-20T20:34:29.676 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-20T20:34:29.677 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-20T20:34:29.677 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-20T20:34:29.677 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-20T20:34:29.677 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-20T20:34:29.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:34:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:29.966 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":82,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:34:29.645114+0000","last_up_change":"2024-09-20T20:34:16.788033+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":57,"up_from":69,"up_thru":81,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6801","nonce":575774322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6803","nonce":575774322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6807","nonce":575774322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6805","nonce":575774322}]},"public_addr":"172.21.15.79:6801/575774322","cluster_addr":"172.21.15.79:6803/575774322","heartbeat_back_addr":"172.21.15.79:6807/575774322","heartbeat_front_addr":"172.21.15.79:6805/575774322","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":57},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.2d","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.0","osds":[2]},{"pgid":"4.2","osds":[1]},{"pgid":"4.5","osds":[1]},{"pgid":"4.a","osds":[2]},{"pgid":"4.d","osds":[1]},{"pgid":"4.16","osds":[2]},{"pgid":"4.17","osds":[2]},{"pgid":"4.18","osds":[2]},{"pgid":"4.1a","osds":[2]},{"pgid":"4.1b","osds":[2]},{"pgid":"4.1d","osds":[1]},{"pgid":"4.1e","osds":[2]},{"pgid":"4.1f","osds":[1]},{"pgid":"4.20","osds":[2]},{"pgid":"4.22","osds":[1]},{"pgid":"4.25","osds":[1]},{"pgid":"4.26","osds":[2]},{"pgid":"4.27","osds":[1]},{"pgid":"4.29","osds":[2]},{"pgid":"4.2a","osds":[1]},{"pgid":"4.30","osds":[2]},{"pgid":"4.32","osds":[1]},{"pgid":"4.38","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:34:29.985 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-20T20:34:29.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:34:30.276 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:30.276 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":82,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:34:29.645114+0000","last_up_change":"2024-09-20T20:34:16.788033+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":57,"up_from":69,"up_thru":81,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6801","nonce":575774322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6803","nonce":575774322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6807","nonce":575774322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6805","nonce":575774322}]},"public_addr":"172.21.15.79:6801/575774322","cluster_addr":"172.21.15.79:6803/575774322","heartbeat_back_addr":"172.21.15.79:6807/575774322","heartbeat_front_addr":"172.21.15.79:6805/575774322","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":57},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.2d","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.0","osds":[2]},{"pgid":"4.2","osds":[1]},{"pgid":"4.5","osds":[1]},{"pgid":"4.a","osds":[2]},{"pgid":"4.d","osds":[1]},{"pgid":"4.16","osds":[2]},{"pgid":"4.17","osds":[2]},{"pgid":"4.18","osds":[2]},{"pgid":"4.1a","osds":[2]},{"pgid":"4.1b","osds":[2]},{"pgid":"4.1d","osds":[1]},{"pgid":"4.1e","osds":[2]},{"pgid":"4.1f","osds":[1]},{"pgid":"4.20","osds":[2]},{"pgid":"4.22","osds":[1]},{"pgid":"4.25","osds":[1]},{"pgid":"4.26","osds":[2]},{"pgid":"4.27","osds":[1]},{"pgid":"4.29","osds":[2]},{"pgid":"4.2a","osds":[1]},{"pgid":"4.30","osds":[2]},{"pgid":"4.32","osds":[1]},{"pgid":"4.38","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:34:30.294 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-20T20:34:30.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-20T20:34:30.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-20T20:34:30.451 INFO:teuthology.orchestra.run.smithi070.stdout:34359738429 2024-09-20T20:34:30.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T20:34:30.461 INFO:teuthology.orchestra.run.smithi070.stdout:34359738430 2024-09-20T20:34:30.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T20:34:30.463 INFO:teuthology.orchestra.run.smithi070.stdout:296352743428 2024-09-20T20:34:30.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T20:34:30.791 INFO:teuthology.orchestra.run.smithi070.stdout:34359738428 2024-09-20T20:34:30.796 INFO:teuthology.orchestra.run.smithi070.stdout:34359738429 2024-09-20T20:34:30.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.2 2024-09-20T20:34:30.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738430 got 34359738429 for osd.1 2024-09-20T20:34:30.859 INFO:teuthology.orchestra.run.smithi070.stdout:296352743427 2024-09-20T20:34:30.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 296352743428 got 296352743427 for osd.0 2024-09-20T20:34:31.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T20:34:31.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T20:34:31.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T20:34:32.143 INFO:teuthology.orchestra.run.smithi070.stdout:34359738429 2024-09-20T20:34:32.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738430 got 34359738429 for osd.1 2024-09-20T20:34:32.168 INFO:teuthology.orchestra.run.smithi070.stdout:34359738428 2024-09-20T20:34:32.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.2 2024-09-20T20:34:32.242 INFO:teuthology.orchestra.run.smithi070.stdout:296352743427 2024-09-20T20:34:32.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 296352743428 got 296352743427 for osd.0 2024-09-20T20:34:33.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-20T20:34:33.193 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-20T20:34:33.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-20T20:34:33.470 INFO:teuthology.orchestra.run.smithi070.stdout:34359738430 2024-09-20T20:34:33.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738430 got 34359738430 for osd.1 2024-09-20T20:34:33.488 DEBUG:teuthology.parallel:result is None 2024-09-20T20:34:33.512 INFO:teuthology.orchestra.run.smithi070.stdout:34359738429 2024-09-20T20:34:33.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.2 2024-09-20T20:34:33.530 DEBUG:teuthology.parallel:result is None 2024-09-20T20:34:33.544 INFO:teuthology.orchestra.run.smithi070.stdout:296352743429 2024-09-20T20:34:33.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 296352743428 got 296352743429 for osd.0 2024-09-20T20:34:33.561 DEBUG:teuthology.parallel:result is None 2024-09-20T20:34:33.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-20T20:34:33.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:33.883 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:33.885 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:33.899 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-09-20T20:34:33.720076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3332,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":285392,"kb_used_data":100620,"kb_used_omap":168,"kb_used_meta":184535,"kb_avail":282830128,"statfs":{"total":289910292480,"available":289618051072,"internally_reserved":0,"allocated":103034880,"data_stored":283205939,"data_compressed":40223628,"data_compressed_allocated":51974144,"data_compressed_original":241894540,"omap_allocated":172984,"internal_metadata":188963912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1458,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001193"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653616+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:32.653616+0000","last_peered":"2024-09-20T20:34:32.653616+0000","last_clean":"2024-09-20T20:34:32.653616+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:32.653616+0000","last_undegraded":"2024-09-20T20:34:32.653616+0000","last_fullsized":"2024-09-20T20:34:32.653616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":649,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652690+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:32.652690+0000","last_peered":"2024-09-20T20:34:32.652690+0000","last_clean":"2024-09-20T20:34:32.652690+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:32.652690+0000","last_undegraded":"2024-09-20T20:34:32.652690+0000","last_fullsized":"2024-09-20T20:34:32.652690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":571,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623343+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:30.623343+0000","last_peered":"2024-09-20T20:34:30.623343+0000","last_clean":"2024-09-20T20:34:30.623343+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:30.623343+0000","last_undegraded":"2024-09-20T20:34:30.623343+0000","last_fullsized":"2024-09-20T20:34:30.623343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":539,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622660+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:30.622660+0000","last_peered":"2024-09-20T20:34:30.622660+0000","last_clean":"2024-09-20T20:34:30.622660+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:30.622660+0000","last_undegraded":"2024-09-20T20:34:30.622660+0000","last_fullsized":"2024-09-20T20:34:30.622660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":499,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652954+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:32.652954+0000","last_peered":"2024-09-20T20:34:32.652954+0000","last_clean":"2024-09-20T20:34:32.652954+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:32.652954+0000","last_undegraded":"2024-09-20T20:34:32.652954+0000","last_fullsized":"2024-09-20T20:34:32.652954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.633458+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:30.633458+0000","last_peered":"2024-09-20T20:34:30.633458+0000","last_clean":"2024-09-20T20:34:30.633458+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:30.633458+0000","last_undegraded":"2024-09-20T20:34:30.633458+0000","last_fullsized":"2024-09-20T20:34:30.633458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":602,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622285+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:30.622285+0000","last_peered":"2024-09-20T20:34:30.622285+0000","last_clean":"2024-09-20T20:34:30.622285+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:30.622285+0000","last_undegraded":"2024-09-20T20:34:30.622285+0000","last_fullsized":"2024-09-20T20:34:30.622285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":606,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646917+0000","last_change":"2024-09-20T20:34:18.940543+0000","last_active":"2024-09-20T20:34:32.646917+0000","last_peered":"2024-09-20T20:34:32.646917+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:34:18.934342+0000","last_became_peered":"2024-09-20T20:34:18.934342+0000","last_unstale":"2024-09-20T20:34:32.646917+0000","last_undegraded":"2024-09-20T20:34:18.666832+0000","last_fullsized":"2024-09-20T20:34:18.649718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":139,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650009+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:32.650009+0000","last_peered":"2024-09-20T20:34:32.650009+0000","last_clean":"2024-09-20T20:34:32.650009+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:32.650009+0000","last_undegraded":"2024-09-20T20:34:32.650009+0000","last_fullsized":"2024-09-20T20:34:32.650009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":552,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.654179+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:32.654179+0000","last_peered":"2024-09-20T20:34:32.654179+0000","last_clean":"2024-09-20T20:34:32.654179+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:32.654179+0000","last_undegraded":"2024-09-20T20:34:32.654179+0000","last_fullsized":"2024-09-20T20:34:32.654179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":529,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623213+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:30.623213+0000","last_peered":"2024-09-20T20:34:30.623213+0000","last_clean":"2024-09-20T20:34:30.623213+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:30.623213+0000","last_undegraded":"2024-09-20T20:34:30.623213+0000","last_fullsized":"2024-09-20T20:34:30.623213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":797,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652592+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:32.652592+0000","last_peered":"2024-09-20T20:34:32.652592+0000","last_clean":"2024-09-20T20:34:32.652592+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:32.652592+0000","last_undegraded":"2024-09-20T20:34:32.652592+0000","last_fullsized":"2024-09-20T20:34:32.652592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":519,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652176+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:32.652176+0000","last_peered":"2024-09-20T20:34:32.652176+0000","last_clean":"2024-09-20T20:34:32.652176+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:32.652176+0000","last_undegraded":"2024-09-20T20:34:32.652176+0000","last_fullsized":"2024-09-20T20:34:32.652176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":573,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-20T20:34:30.623733+0000","last_change":"2024-09-20T20:34:30.623733+0000","last_active":"2024-09-20T20:34:17.650415+0000","last_peered":"2024-09-20T20:34:15.792455+0000","last_clean":"2024-09-20T20:31:51.163089+0000","last_became_active":"2024-09-20T20:31:52.244509+0000","last_became_peered":"2024-09-20T20:31:52.244509+0000","last_unstale":"2024-09-20T20:34:30.623733+0000","last_undegraded":"2024-09-20T20:34:30.623733+0000","last_fullsized":"2024-09-20T20:34:30.623733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":674,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622209+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:30.622209+0000","last_peered":"2024-09-20T20:34:30.622209+0000","last_clean":"2024-09-20T20:34:30.622209+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:30.622209+0000","last_undegraded":"2024-09-20T20:34:30.622209+0000","last_fullsized":"2024-09-20T20:34:30.622209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":631,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646923+0000","last_change":"2024-09-20T20:34:18.939734+0000","last_active":"2024-09-20T20:34:32.646923+0000","last_peered":"2024-09-20T20:34:32.646923+0000","last_clean":"2024-09-20T20:31:51.161495+0000","last_became_active":"2024-09-20T20:34:18.920486+0000","last_became_peered":"2024-09-20T20:34:18.920486+0000","last_unstale":"2024-09-20T20:34:32.646923+0000","last_undegraded":"2024-09-20T20:34:18.665789+0000","last_fullsized":"2024-09-20T20:34:18.649684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651003+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:32.651003+0000","last_peered":"2024-09-20T20:34:32.651003+0000","last_clean":"2024-09-20T20:34:32.651003+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:32.651003+0000","last_undegraded":"2024-09-20T20:34:32.651003+0000","last_fullsized":"2024-09-20T20:34:32.651003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":612,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653017+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:32.653017+0000","last_peered":"2024-09-20T20:34:32.653017+0000","last_clean":"2024-09-20T20:34:32.653017+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:32.653017+0000","last_undegraded":"2024-09-20T20:34:32.653017+0000","last_fullsized":"2024-09-20T20:34:32.653017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652676+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:32.652676+0000","last_peered":"2024-09-20T20:34:32.652676+0000","last_clean":"2024-09-20T20:34:32.652676+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:32.652676+0000","last_undegraded":"2024-09-20T20:34:32.652676+0000","last_fullsized":"2024-09-20T20:34:32.652676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":591,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623259+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:30.623259+0000","last_peered":"2024-09-20T20:34:30.623259+0000","last_clean":"2024-09-20T20:34:30.623259+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:30.623259+0000","last_undegraded":"2024-09-20T20:34:30.623259+0000","last_fullsized":"2024-09-20T20:34:30.623259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624421+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:30.624421+0000","last_peered":"2024-09-20T20:34:30.624421+0000","last_clean":"2024-09-20T20:34:30.624421+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:30.624421+0000","last_undegraded":"2024-09-20T20:34:30.624421+0000","last_fullsized":"2024-09-20T20:34:30.624421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":603,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.651981+0000","last_change":"2024-09-20T20:34:26.701111+0000","last_active":"2024-09-20T20:34:32.651981+0000","last_peered":"2024-09-20T20:34:32.651981+0000","last_clean":"2024-09-20T20:31:51.184225+0000","last_became_active":"2024-09-20T20:34:26.683873+0000","last_became_peered":"2024-09-20T20:34:26.683873+0000","last_unstale":"2024-09-20T20:34:32.651981+0000","last_undegraded":"2024-09-20T20:34:26.677758+0000","last_fullsized":"2024-09-20T20:34:26.677143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":661,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647212+0000","last_change":"2024-09-20T20:34:18.936170+0000","last_active":"2024-09-20T20:34:32.647212+0000","last_peered":"2024-09-20T20:34:32.647212+0000","last_clean":"2024-09-20T20:31:51.202971+0000","last_became_active":"2024-09-20T20:34:18.927334+0000","last_became_peered":"2024-09-20T20:34:18.927334+0000","last_unstale":"2024-09-20T20:34:32.647212+0000","last_undegraded":"2024-09-20T20:34:18.663132+0000","last_fullsized":"2024-09-20T20:34:18.649746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":674,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651417+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:32.651417+0000","last_peered":"2024-09-20T20:34:32.651417+0000","last_clean":"2024-09-20T20:34:32.651417+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:32.651417+0000","last_undegraded":"2024-09-20T20:34:32.651417+0000","last_fullsized":"2024-09-20T20:34:32.651417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":550,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.653886+0000","last_change":"2024-09-20T20:34:26.691471+0000","last_active":"2024-09-20T20:34:32.653886+0000","last_peered":"2024-09-20T20:34:32.653886+0000","last_clean":"2024-09-20T20:31:51.129241+0000","last_became_active":"2024-09-20T20:34:26.682699+0000","last_became_peered":"2024-09-20T20:34:26.682699+0000","last_unstale":"2024-09-20T20:34:32.653886+0000","last_undegraded":"2024-09-20T20:34:26.676325+0000","last_fullsized":"2024-09-20T20:34:26.675708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1059,"reported_epoch":84,"state":"peering","last_fresh":"2024-09-20T20:34:32.432085+0000","last_change":"2024-09-20T20:34:32.651505+0000","last_active":"2024-09-20T20:34:32.651505+0000","last_peered":"2024-09-20T20:34:32.432085+0000","last_clean":"2024-09-20T20:31:51.173602+0000","last_became_active":"2024-09-20T20:34:18.918961+0000","last_became_peered":"2024-09-20T20:34:18.918961+0000","last_unstale":"2024-09-20T20:34:32.432085+0000","last_undegraded":"2024-09-20T20:34:32.432085+0000","last_fullsized":"2024-09-20T20:34:18.655037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":808,"reported_epoch":85,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-20T20:34:32.733076+0000","last_change":"2024-09-20T20:34:32.436931+0000","last_active":"2024-09-20T20:34:32.733076+0000","last_peered":"2024-09-20T20:34:32.733076+0000","last_clean":"2024-09-20T20:31:51.134626+0000","last_became_active":"2024-09-20T20:34:18.923834+0000","last_became_peered":"2024-09-20T20:34:18.923834+0000","last_unstale":"2024-09-20T20:34:32.733076+0000","last_undegraded":"2024-09-20T20:34:32.733076+0000","last_fullsized":"2024-09-20T20:34:18.679822+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":915,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653232+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:32.653232+0000","last_peered":"2024-09-20T20:34:32.653232+0000","last_clean":"2024-09-20T20:34:32.653232+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:32.653232+0000","last_undegraded":"2024-09-20T20:34:32.653232+0000","last_fullsized":"2024-09-20T20:34:32.653232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648467+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:32.648467+0000","last_peered":"2024-09-20T20:34:32.648467+0000","last_clean":"2024-09-20T20:34:32.648467+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:32.648467+0000","last_undegraded":"2024-09-20T20:34:32.648467+0000","last_fullsized":"2024-09-20T20:34:32.648467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":614,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.653425+0000","last_change":"2024-09-20T20:34:26.704756+0000","last_active":"2024-09-20T20:34:32.653425+0000","last_peered":"2024-09-20T20:34:32.653425+0000","last_clean":"2024-09-20T20:31:51.179186+0000","last_became_active":"2024-09-20T20:34:26.700667+0000","last_became_peered":"2024-09-20T20:34:26.700667+0000","last_unstale":"2024-09-20T20:34:32.653425+0000","last_undegraded":"2024-09-20T20:34:26.682148+0000","last_fullsized":"2024-09-20T20:34:26.679653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647339+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:32.647339+0000","last_peered":"2024-09-20T20:34:32.647339+0000","last_clean":"2024-09-20T20:34:32.647339+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:32.647339+0000","last_undegraded":"2024-09-20T20:34:32.647339+0000","last_fullsized":"2024-09-20T20:34:32.647339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":591,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647580+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:32.647580+0000","last_peered":"2024-09-20T20:34:32.647580+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:32.647580+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":477,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653227+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:32.653227+0000","last_peered":"2024-09-20T20:34:32.653227+0000","last_clean":"2024-09-20T20:34:32.653227+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:32.653227+0000","last_undegraded":"2024-09-20T20:34:32.653227+0000","last_fullsized":"2024-09-20T20:34:32.653227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622445+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:30.622445+0000","last_peered":"2024-09-20T20:34:30.622445+0000","last_clean":"2024-09-20T20:34:30.622445+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:30.622445+0000","last_undegraded":"2024-09-20T20:34:30.622445+0000","last_fullsized":"2024-09-20T20:34:30.622445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.654666+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:32.654666+0000","last_peered":"2024-09-20T20:34:32.654666+0000","last_clean":"2024-09-20T20:34:32.654666+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:32.654666+0000","last_undegraded":"2024-09-20T20:34:32.654666+0000","last_fullsized":"2024-09-20T20:34:32.654666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648311+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:32.648311+0000","last_peered":"2024-09-20T20:34:32.648311+0000","last_clean":"2024-09-20T20:34:32.648311+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:32.648311+0000","last_undegraded":"2024-09-20T20:34:32.648311+0000","last_fullsized":"2024-09-20T20:34:32.648311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":633,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.651455+0000","last_change":"2024-09-20T20:34:18.937745+0000","last_active":"2024-09-20T20:34:32.651455+0000","last_peered":"2024-09-20T20:34:32.651455+0000","last_clean":"2024-09-20T20:31:51.202663+0000","last_became_active":"2024-09-20T20:34:18.931378+0000","last_became_peered":"2024-09-20T20:34:18.931378+0000","last_unstale":"2024-09-20T20:34:32.651455+0000","last_undegraded":"2024-09-20T20:34:18.686815+0000","last_fullsized":"2024-09-20T20:34:18.675123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651869+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:32.651869+0000","last_peered":"2024-09-20T20:34:32.651869+0000","last_clean":"2024-09-20T20:34:32.651869+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:32.651869+0000","last_undegraded":"2024-09-20T20:34:32.651869+0000","last_fullsized":"2024-09-20T20:34:32.651869+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":622,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.650323+0000","last_change":"2024-09-20T20:34:19.225616+0000","last_active":"2024-09-20T20:34:32.650323+0000","last_peered":"2024-09-20T20:34:32.650323+0000","last_clean":"2024-09-20T20:31:51.195638+0000","last_became_active":"2024-09-20T20:34:18.889264+0000","last_became_peered":"2024-09-20T20:34:18.889264+0000","last_unstale":"2024-09-20T20:34:32.650323+0000","last_undegraded":"2024-09-20T20:34:19.225278+0000","last_fullsized":"2024-09-20T20:34:18.651936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621287+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:30.621287+0000","last_peered":"2024-09-20T20:34:30.621287+0000","last_clean":"2024-09-20T20:34:30.621287+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:30.621287+0000","last_undegraded":"2024-09-20T20:34:30.621287+0000","last_fullsized":"2024-09-20T20:34:30.621287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624058+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:30.624058+0000","last_peered":"2024-09-20T20:34:30.624058+0000","last_clean":"2024-09-20T20:34:30.624058+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:30.624058+0000","last_undegraded":"2024-09-20T20:34:30.624058+0000","last_fullsized":"2024-09-20T20:34:30.624058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":888,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651443+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:32.651443+0000","last_peered":"2024-09-20T20:34:32.651443+0000","last_clean":"2024-09-20T20:34:32.651443+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:32.651443+0000","last_undegraded":"2024-09-20T20:34:32.651443+0000","last_fullsized":"2024-09-20T20:34:32.651443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":419,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653780+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:32.653780+0000","last_peered":"2024-09-20T20:34:32.653780+0000","last_clean":"2024-09-20T20:34:32.653780+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:32.653780+0000","last_undegraded":"2024-09-20T20:34:32.653780+0000","last_fullsized":"2024-09-20T20:34:32.653780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651591+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:32.651591+0000","last_peered":"2024-09-20T20:34:32.651591+0000","last_clean":"2024-09-20T20:34:32.651591+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:32.651591+0000","last_undegraded":"2024-09-20T20:34:32.651591+0000","last_fullsized":"2024-09-20T20:34:32.651591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622852+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:30.622852+0000","last_peered":"2024-09-20T20:34:30.622852+0000","last_clean":"2024-09-20T20:34:30.622852+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:30.622852+0000","last_undegraded":"2024-09-20T20:34:30.622852+0000","last_fullsized":"2024-09-20T20:34:30.622852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":632,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:29.654101+0000","last_change":"2024-09-20T20:34:18.933836+0000","last_active":"2024-09-20T20:34:29.654101+0000","last_peered":"2024-09-20T20:34:29.654101+0000","last_clean":"2024-09-20T20:31:51.151645+0000","last_became_active":"2024-09-20T20:34:18.918599+0000","last_became_peered":"2024-09-20T20:34:18.918599+0000","last_unstale":"2024-09-20T20:34:29.654101+0000","last_undegraded":"2024-09-20T20:34:18.683120+0000","last_fullsized":"2024-09-20T20:34:18.671352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622815+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:30.622815+0000","last_peered":"2024-09-20T20:34:30.622815+0000","last_clean":"2024-09-20T20:34:30.622815+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:30.622815+0000","last_undegraded":"2024-09-20T20:34:30.622815+0000","last_fullsized":"2024-09-20T20:34:30.622815+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1054,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648760+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:32.648760+0000","last_peered":"2024-09-20T20:34:32.648760+0000","last_clean":"2024-09-20T20:34:32.648760+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:32.648760+0000","last_undegraded":"2024-09-20T20:34:32.648760+0000","last_fullsized":"2024-09-20T20:34:32.648760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":357,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649212+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:32.649212+0000","last_peered":"2024-09-20T20:34:32.649212+0000","last_clean":"2024-09-20T20:34:32.649212+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:32.649212+0000","last_undegraded":"2024-09-20T20:34:32.649212+0000","last_fullsized":"2024-09-20T20:34:32.649212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":583,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623708+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:30.623708+0000","last_peered":"2024-09-20T20:34:30.623708+0000","last_clean":"2024-09-20T20:34:30.623708+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:30.623708+0000","last_undegraded":"2024-09-20T20:34:30.623708+0000","last_fullsized":"2024-09-20T20:34:30.623708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623773+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:30.623773+0000","last_peered":"2024-09-20T20:34:30.623773+0000","last_clean":"2024-09-20T20:34:30.623773+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:30.623773+0000","last_undegraded":"2024-09-20T20:34:30.623773+0000","last_fullsized":"2024-09-20T20:34:30.623773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":587,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.655019+0000","last_change":"2024-09-20T20:34:18.935349+0000","last_active":"2024-09-20T20:34:32.655019+0000","last_peered":"2024-09-20T20:34:32.655019+0000","last_clean":"2024-09-20T20:31:51.164211+0000","last_became_active":"2024-09-20T20:34:18.928354+0000","last_became_peered":"2024-09-20T20:34:18.928354+0000","last_unstale":"2024-09-20T20:34:32.655019+0000","last_undegraded":"2024-09-20T20:34:18.680220+0000","last_fullsized":"2024-09-20T20:34:18.677289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651971+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:32.651971+0000","last_peered":"2024-09-20T20:34:32.651971+0000","last_clean":"2024-09-20T20:34:32.651971+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:32.651971+0000","last_undegraded":"2024-09-20T20:34:32.651971+0000","last_fullsized":"2024-09-20T20:34:32.651971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624092+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:30.624092+0000","last_peered":"2024-09-20T20:34:30.624092+0000","last_clean":"2024-09-20T20:34:30.624092+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:30.624092+0000","last_undegraded":"2024-09-20T20:34:30.624092+0000","last_fullsized":"2024-09-20T20:34:30.624092+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651712+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:32.651712+0000","last_peered":"2024-09-20T20:34:32.651712+0000","last_clean":"2024-09-20T20:34:32.651712+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:32.651712+0000","last_undegraded":"2024-09-20T20:34:32.651712+0000","last_fullsized":"2024-09-20T20:34:32.651712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650402+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:32.650402+0000","last_peered":"2024-09-20T20:34:32.650402+0000","last_clean":"2024-09-20T20:34:32.650402+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:32.650402+0000","last_undegraded":"2024-09-20T20:34:32.650402+0000","last_fullsized":"2024-09-20T20:34:32.650402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":329,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621007+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:30.621007+0000","last_peered":"2024-09-20T20:34:30.621007+0000","last_clean":"2024-09-20T20:34:30.621007+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:30.621007+0000","last_undegraded":"2024-09-20T20:34:30.621007+0000","last_fullsized":"2024-09-20T20:34:30.621007+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621847+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:30.621847+0000","last_peered":"2024-09-20T20:34:30.621847+0000","last_clean":"2024-09-20T20:34:30.621847+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:30.621847+0000","last_undegraded":"2024-09-20T20:34:30.621847+0000","last_fullsized":"2024-09-20T20:34:30.621847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":708,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649138+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:32.649138+0000","last_peered":"2024-09-20T20:34:32.649138+0000","last_clean":"2024-09-20T20:34:32.649138+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:32.649138+0000","last_undegraded":"2024-09-20T20:34:32.649138+0000","last_fullsized":"2024-09-20T20:34:32.649138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":595,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:29.658769+0000","last_change":"2024-09-20T20:34:18.934849+0000","last_active":"2024-09-20T20:34:29.658769+0000","last_peered":"2024-09-20T20:34:29.658769+0000","last_clean":"2024-09-20T20:31:51.170388+0000","last_became_active":"2024-09-20T20:34:18.917137+0000","last_became_peered":"2024-09-20T20:34:18.917137+0000","last_unstale":"2024-09-20T20:34:29.658769+0000","last_undegraded":"2024-09-20T20:34:18.675416+0000","last_fullsized":"2024-09-20T20:34:18.656310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621813+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:30.621813+0000","last_peered":"2024-09-20T20:34:30.621813+0000","last_clean":"2024-09-20T20:34:30.621813+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:30.621813+0000","last_undegraded":"2024-09-20T20:34:30.621813+0000","last_fullsized":"2024-09-20T20:34:30.621813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":352,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648304+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:32.648304+0000","last_peered":"2024-09-20T20:34:32.648304+0000","last_clean":"2024-09-20T20:34:32.648304+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:32.648304+0000","last_undegraded":"2024-09-20T20:34:32.648304+0000","last_fullsized":"2024-09-20T20:34:32.648304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653475+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:32.653475+0000","last_peered":"2024-09-20T20:34:32.653475+0000","last_clean":"2024-09-20T20:34:32.653475+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:32.653475+0000","last_undegraded":"2024-09-20T20:34:32.653475+0000","last_fullsized":"2024-09-20T20:34:32.653475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648607+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:32.648607+0000","last_peered":"2024-09-20T20:34:32.648607+0000","last_clean":"2024-09-20T20:34:32.648607+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:32.648607+0000","last_undegraded":"2024-09-20T20:34:32.648607+0000","last_fullsized":"2024-09-20T20:34:32.648607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":385,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651757+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:32.651757+0000","last_peered":"2024-09-20T20:34:32.651757+0000","last_clean":"2024-09-20T20:34:32.651757+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:32.651757+0000","last_undegraded":"2024-09-20T20:34:32.651757+0000","last_fullsized":"2024-09-20T20:34:32.651757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650691+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:32.650691+0000","last_peered":"2024-09-20T20:34:32.650691+0000","last_clean":"2024-09-20T20:34:32.650691+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:32.650691+0000","last_undegraded":"2024-09-20T20:34:32.650691+0000","last_fullsized":"2024-09-20T20:34:32.650691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621515+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:30.621515+0000","last_peered":"2024-09-20T20:34:30.621515+0000","last_clean":"2024-09-20T20:34:30.621515+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:30.621515+0000","last_undegraded":"2024-09-20T20:34:30.621515+0000","last_fullsized":"2024-09-20T20:34:30.621515+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622125+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:30.622125+0000","last_peered":"2024-09-20T20:34:30.622125+0000","last_clean":"2024-09-20T20:34:30.622125+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:30.622125+0000","last_undegraded":"2024-09-20T20:34:30.622125+0000","last_fullsized":"2024-09-20T20:34:30.622125+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":587,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649271+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:32.649271+0000","last_peered":"2024-09-20T20:34:32.649271+0000","last_clean":"2024-09-20T20:34:32.649271+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:32.649271+0000","last_undegraded":"2024-09-20T20:34:32.649271+0000","last_fullsized":"2024-09-20T20:34:32.649271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622332+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:30.622332+0000","last_peered":"2024-09-20T20:34:30.622332+0000","last_clean":"2024-09-20T20:34:30.622332+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:30.622332+0000","last_undegraded":"2024-09-20T20:34:30.622332+0000","last_fullsized":"2024-09-20T20:34:30.622332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649730+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:32.649730+0000","last_peered":"2024-09-20T20:34:32.649730+0000","last_clean":"2024-09-20T20:34:32.649730+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:32.649730+0000","last_undegraded":"2024-09-20T20:34:32.649730+0000","last_fullsized":"2024-09-20T20:34:32.649730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":822,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.665825+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:32.665825+0000","last_peered":"2024-09-20T20:34:32.665825+0000","last_clean":"2024-09-20T20:34:32.665825+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:32.665825+0000","last_undegraded":"2024-09-20T20:34:32.665825+0000","last_fullsized":"2024-09-20T20:34:32.665825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":204,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649283+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:32.649283+0000","last_peered":"2024-09-20T20:34:32.649283+0000","last_clean":"2024-09-20T20:34:32.649283+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:32.649283+0000","last_undegraded":"2024-09-20T20:34:32.649283+0000","last_fullsized":"2024-09-20T20:34:32.649283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655611+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:32.655611+0000","last_peered":"2024-09-20T20:34:32.655611+0000","last_clean":"2024-09-20T20:34:32.655611+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:32.655611+0000","last_undegraded":"2024-09-20T20:34:32.655611+0000","last_fullsized":"2024-09-20T20:34:32.655611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":878,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652665+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:32.652665+0000","last_peered":"2024-09-20T20:34:32.652665+0000","last_clean":"2024-09-20T20:34:32.652665+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:32.652665+0000","last_undegraded":"2024-09-20T20:34:32.652665+0000","last_fullsized":"2024-09-20T20:34:32.652665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651127+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:32.651127+0000","last_peered":"2024-09-20T20:34:32.651127+0000","last_clean":"2024-09-20T20:34:32.651127+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:32.651127+0000","last_undegraded":"2024-09-20T20:34:32.651127+0000","last_fullsized":"2024-09-20T20:34:32.651127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651965+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:32.651965+0000","last_peered":"2024-09-20T20:34:32.651965+0000","last_clean":"2024-09-20T20:34:32.651965+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:32.651965+0000","last_undegraded":"2024-09-20T20:34:32.651965+0000","last_fullsized":"2024-09-20T20:34:32.651965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":696,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.648533+0000","last_change":"2024-09-20T20:34:18.940279+0000","last_active":"2024-09-20T20:34:32.648533+0000","last_peered":"2024-09-20T20:34:32.648533+0000","last_clean":"2024-09-20T20:31:51.202703+0000","last_became_active":"2024-09-20T20:34:18.934354+0000","last_became_peered":"2024-09-20T20:34:18.934354+0000","last_unstale":"2024-09-20T20:34:32.648533+0000","last_undegraded":"2024-09-20T20:34:18.689916+0000","last_fullsized":"2024-09-20T20:34:18.683789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651809+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:32.651809+0000","last_peered":"2024-09-20T20:34:32.651809+0000","last_clean":"2024-09-20T20:34:32.651809+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:32.651809+0000","last_undegraded":"2024-09-20T20:34:32.651809+0000","last_fullsized":"2024-09-20T20:34:32.651809+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623459+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:30.623459+0000","last_peered":"2024-09-20T20:34:30.623459+0000","last_clean":"2024-09-20T20:34:30.623459+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:30.623459+0000","last_undegraded":"2024-09-20T20:34:30.623459+0000","last_fullsized":"2024-09-20T20:34:30.623459+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":916,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651638+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:32.651638+0000","last_peered":"2024-09-20T20:34:32.651638+0000","last_clean":"2024-09-20T20:34:32.651638+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:32.651638+0000","last_undegraded":"2024-09-20T20:34:32.651638+0000","last_fullsized":"2024-09-20T20:34:32.651638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624128+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:30.624128+0000","last_peered":"2024-09-20T20:34:30.624128+0000","last_clean":"2024-09-20T20:34:30.624128+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:30.624128+0000","last_undegraded":"2024-09-20T20:34:30.624128+0000","last_fullsized":"2024-09-20T20:34:30.624128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622111+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:30.622111+0000","last_peered":"2024-09-20T20:34:30.622111+0000","last_clean":"2024-09-20T20:34:30.622111+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:30.622111+0000","last_undegraded":"2024-09-20T20:34:30.622111+0000","last_fullsized":"2024-09-20T20:34:30.622111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":570,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647711+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:32.647711+0000","last_peered":"2024-09-20T20:34:32.647711+0000","last_clean":"2024-09-20T20:34:32.647711+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:32.647711+0000","last_undegraded":"2024-09-20T20:34:32.647711+0000","last_fullsized":"2024-09-20T20:34:32.647711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655189+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:32.655189+0000","last_peered":"2024-09-20T20:34:32.655189+0000","last_clean":"2024-09-20T20:34:32.655189+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:32.655189+0000","last_undegraded":"2024-09-20T20:34:32.655189+0000","last_fullsized":"2024-09-20T20:34:32.655189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":248,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623583+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:30.623583+0000","last_peered":"2024-09-20T20:34:30.623583+0000","last_clean":"2024-09-20T20:34:30.623583+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:30.623583+0000","last_undegraded":"2024-09-20T20:34:30.623583+0000","last_fullsized":"2024-09-20T20:34:30.623583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1067,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647760+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:32.647760+0000","last_peered":"2024-09-20T20:34:32.647760+0000","last_clean":"2024-09-20T20:34:32.647760+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:32.647760+0000","last_undegraded":"2024-09-20T20:34:32.647760+0000","last_fullsized":"2024-09-20T20:34:32.647760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":213,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650973+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:32.650973+0000","last_peered":"2024-09-20T20:34:32.650973+0000","last_clean":"2024-09-20T20:34:32.650973+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:32.650973+0000","last_undegraded":"2024-09-20T20:34:32.650973+0000","last_fullsized":"2024-09-20T20:34:32.650973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649013+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:32.649013+0000","last_peered":"2024-09-20T20:34:32.649013+0000","last_clean":"2024-09-20T20:34:32.649013+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:32.649013+0000","last_undegraded":"2024-09-20T20:34:32.649013+0000","last_fullsized":"2024-09-20T20:34:32.649013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":531,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.654243+0000","last_change":"2024-09-20T20:34:19.277789+0000","last_active":"2024-09-20T20:34:32.654243+0000","last_peered":"2024-09-20T20:34:32.654243+0000","last_clean":"2024-09-20T20:31:51.167971+0000","last_became_active":"2024-09-20T20:34:18.890488+0000","last_became_peered":"2024-09-20T20:34:18.890488+0000","last_unstale":"2024-09-20T20:34:32.654243+0000","last_undegraded":"2024-09-20T20:34:19.277313+0000","last_fullsized":"2024-09-20T20:34:18.667466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":144,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":846,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649914+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:32.649914+0000","last_peered":"2024-09-20T20:34:32.649914+0000","last_clean":"2024-09-20T20:34:32.649914+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:32.649914+0000","last_undegraded":"2024-09-20T20:34:32.649914+0000","last_fullsized":"2024-09-20T20:34:32.649914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":588,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.650360+0000","last_change":"2024-09-20T20:34:18.935766+0000","last_active":"2024-09-20T20:34:32.650360+0000","last_peered":"2024-09-20T20:34:32.650360+0000","last_clean":"2024-09-20T20:31:51.200271+0000","last_became_active":"2024-09-20T20:34:18.921689+0000","last_became_peered":"2024-09-20T20:34:18.921689+0000","last_unstale":"2024-09-20T20:34:32.650360+0000","last_undegraded":"2024-09-20T20:34:18.680964+0000","last_fullsized":"2024-09-20T20:34:18.663912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":344,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648117+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:32.648117+0000","last_peered":"2024-09-20T20:34:32.648117+0000","last_clean":"2024-09-20T20:34:32.648117+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:32.648117+0000","last_undegraded":"2024-09-20T20:34:32.648117+0000","last_fullsized":"2024-09-20T20:34:32.648117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":642,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.654307+0000","last_change":"2024-09-20T20:34:18.935605+0000","last_active":"2024-09-20T20:34:32.654307+0000","last_peered":"2024-09-20T20:34:32.654307+0000","last_clean":"2024-09-20T20:31:51.202419+0000","last_became_active":"2024-09-20T20:34:18.931023+0000","last_became_peered":"2024-09-20T20:34:18.931023+0000","last_unstale":"2024-09-20T20:34:32.654307+0000","last_undegraded":"2024-09-20T20:34:18.676532+0000","last_fullsized":"2024-09-20T20:34:18.670396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":148,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":306,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653591+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:32.653591+0000","last_peered":"2024-09-20T20:34:32.653591+0000","last_clean":"2024-09-20T20:34:32.653591+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:32.653591+0000","last_undegraded":"2024-09-20T20:34:32.653591+0000","last_fullsized":"2024-09-20T20:34:32.653591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652907+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:32.652907+0000","last_peered":"2024-09-20T20:34:32.652907+0000","last_clean":"2024-09-20T20:34:32.652907+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:32.652907+0000","last_undegraded":"2024-09-20T20:34:32.652907+0000","last_fullsized":"2024-09-20T20:34:32.652907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653048+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:32.653048+0000","last_peered":"2024-09-20T20:34:32.653048+0000","last_clean":"2024-09-20T20:34:32.653048+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:32.653048+0000","last_undegraded":"2024-09-20T20:34:32.653048+0000","last_fullsized":"2024-09-20T20:34:32.653048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":532,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-20T20:34:30.623753+0000","last_change":"2024-09-20T20:34:30.623753+0000","last_active":"2024-09-20T20:34:17.643461+0000","last_peered":"2024-09-20T20:34:15.792678+0000","last_clean":"2024-09-20T20:31:51.144496+0000","last_became_active":"2024-09-20T20:31:52.253537+0000","last_became_peered":"2024-09-20T20:31:52.253537+0000","last_unstale":"2024-09-20T20:34:30.623753+0000","last_undegraded":"2024-09-20T20:34:30.623753+0000","last_fullsized":"2024-09-20T20:34:30.623753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622487+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:30.622487+0000","last_peered":"2024-09-20T20:34:30.622487+0000","last_clean":"2024-09-20T20:34:30.622487+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:30.622487+0000","last_undegraded":"2024-09-20T20:34:30.622487+0000","last_fullsized":"2024-09-20T20:34:30.622487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":590,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647865+0000","last_change":"2024-09-20T20:34:18.937123+0000","last_active":"2024-09-20T20:34:32.647865+0000","last_peered":"2024-09-20T20:34:32.647865+0000","last_clean":"2024-09-20T20:31:51.151591+0000","last_became_active":"2024-09-20T20:34:18.931120+0000","last_became_peered":"2024-09-20T20:34:18.931120+0000","last_unstale":"2024-09-20T20:34:32.647865+0000","last_undegraded":"2024-09-20T20:34:18.677324+0000","last_fullsized":"2024-09-20T20:34:18.663778+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":155,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":432,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655000+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:32.655000+0000","last_peered":"2024-09-20T20:34:32.655000+0000","last_clean":"2024-09-20T20:34:32.655000+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:32.655000+0000","last_undegraded":"2024-09-20T20:34:32.655000+0000","last_fullsized":"2024-09-20T20:34:32.655000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652162+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:32.652162+0000","last_peered":"2024-09-20T20:34:32.652162+0000","last_clean":"2024-09-20T20:34:32.652162+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:32.652162+0000","last_undegraded":"2024-09-20T20:34:32.652162+0000","last_fullsized":"2024-09-20T20:34:32.652162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":213,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651169+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:32.651169+0000","last_peered":"2024-09-20T20:34:32.651169+0000","last_clean":"2024-09-20T20:34:32.651169+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:32.651169+0000","last_undegraded":"2024-09-20T20:34:32.651169+0000","last_fullsized":"2024-09-20T20:34:32.651169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":604,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647417+0000","last_change":"2024-09-20T20:34:18.940010+0000","last_active":"2024-09-20T20:34:32.647417+0000","last_peered":"2024-09-20T20:34:32.647417+0000","last_clean":"2024-09-20T20:31:51.180364+0000","last_became_active":"2024-09-20T20:34:18.923020+0000","last_became_peered":"2024-09-20T20:34:18.923020+0000","last_unstale":"2024-09-20T20:34:32.647417+0000","last_undegraded":"2024-09-20T20:34:18.682966+0000","last_fullsized":"2024-09-20T20:34:18.666887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650690+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:32.650690+0000","last_peered":"2024-09-20T20:34:32.650690+0000","last_clean":"2024-09-20T20:34:32.650690+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:32.650690+0000","last_undegraded":"2024-09-20T20:34:32.650690+0000","last_fullsized":"2024-09-20T20:34:32.650690+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3318,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19582976,"data_stored":24909753,"data_compressed":2491357,"data_compressed_allocated":3584000,"data_compressed_original":16704652,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":109,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99212,"kb_used_data":27828,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272628,"statfs":{"total":96636764160,"available":96535171072,"internally_reserved":0,"allocated":28495872,"data_stored":81516174,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104244,"kb_used_data":28696,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267596,"statfs":{"total":96636764160,"available":96530018304,"internally_reserved":0,"allocated":29384704,"data_stored":85060401,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81936,"kb_used_data":44096,"kb_used_omap":165,"kb_used_meta":37658,"kb_avail":94289904,"statfs":{"total":96636764160,"available":96552861696,"internally_reserved":0,"allocated":45154304,"data_stored":116629364,"data_compressed":16500653,"data_compressed_allocated":20680704,"data_compressed_original":101057676,"omap_allocated":169794,"internal_metadata":38561982},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19582976,"data_stored":24909753,"data_compressed":2491357,"data_compressed_allocated":3584000,"data_compressed_original":16704652,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:33.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:34.214 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:34.216 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:34.231 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-09-20T20:34:33.720076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3332,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":285392,"kb_used_data":100620,"kb_used_omap":168,"kb_used_meta":184535,"kb_avail":282830128,"statfs":{"total":289910292480,"available":289618051072,"internally_reserved":0,"allocated":103034880,"data_stored":283205939,"data_compressed":40223628,"data_compressed_allocated":51974144,"data_compressed_original":241894540,"omap_allocated":172984,"internal_metadata":188963912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1458,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001193"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653616+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:32.653616+0000","last_peered":"2024-09-20T20:34:32.653616+0000","last_clean":"2024-09-20T20:34:32.653616+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:32.653616+0000","last_undegraded":"2024-09-20T20:34:32.653616+0000","last_fullsized":"2024-09-20T20:34:32.653616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":649,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652690+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:32.652690+0000","last_peered":"2024-09-20T20:34:32.652690+0000","last_clean":"2024-09-20T20:34:32.652690+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:32.652690+0000","last_undegraded":"2024-09-20T20:34:32.652690+0000","last_fullsized":"2024-09-20T20:34:32.652690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":571,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623343+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:30.623343+0000","last_peered":"2024-09-20T20:34:30.623343+0000","last_clean":"2024-09-20T20:34:30.623343+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:30.623343+0000","last_undegraded":"2024-09-20T20:34:30.623343+0000","last_fullsized":"2024-09-20T20:34:30.623343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":539,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622660+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:30.622660+0000","last_peered":"2024-09-20T20:34:30.622660+0000","last_clean":"2024-09-20T20:34:30.622660+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:30.622660+0000","last_undegraded":"2024-09-20T20:34:30.622660+0000","last_fullsized":"2024-09-20T20:34:30.622660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":499,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652954+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:32.652954+0000","last_peered":"2024-09-20T20:34:32.652954+0000","last_clean":"2024-09-20T20:34:32.652954+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:32.652954+0000","last_undegraded":"2024-09-20T20:34:32.652954+0000","last_fullsized":"2024-09-20T20:34:32.652954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.633458+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:30.633458+0000","last_peered":"2024-09-20T20:34:30.633458+0000","last_clean":"2024-09-20T20:34:30.633458+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:30.633458+0000","last_undegraded":"2024-09-20T20:34:30.633458+0000","last_fullsized":"2024-09-20T20:34:30.633458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":602,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622285+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:30.622285+0000","last_peered":"2024-09-20T20:34:30.622285+0000","last_clean":"2024-09-20T20:34:30.622285+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:30.622285+0000","last_undegraded":"2024-09-20T20:34:30.622285+0000","last_fullsized":"2024-09-20T20:34:30.622285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":606,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646917+0000","last_change":"2024-09-20T20:34:18.940543+0000","last_active":"2024-09-20T20:34:32.646917+0000","last_peered":"2024-09-20T20:34:32.646917+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:34:18.934342+0000","last_became_peered":"2024-09-20T20:34:18.934342+0000","last_unstale":"2024-09-20T20:34:32.646917+0000","last_undegraded":"2024-09-20T20:34:18.666832+0000","last_fullsized":"2024-09-20T20:34:18.649718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":139,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650009+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:32.650009+0000","last_peered":"2024-09-20T20:34:32.650009+0000","last_clean":"2024-09-20T20:34:32.650009+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:32.650009+0000","last_undegraded":"2024-09-20T20:34:32.650009+0000","last_fullsized":"2024-09-20T20:34:32.650009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":552,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.654179+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:32.654179+0000","last_peered":"2024-09-20T20:34:32.654179+0000","last_clean":"2024-09-20T20:34:32.654179+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:32.654179+0000","last_undegraded":"2024-09-20T20:34:32.654179+0000","last_fullsized":"2024-09-20T20:34:32.654179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":529,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623213+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:30.623213+0000","last_peered":"2024-09-20T20:34:30.623213+0000","last_clean":"2024-09-20T20:34:30.623213+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:30.623213+0000","last_undegraded":"2024-09-20T20:34:30.623213+0000","last_fullsized":"2024-09-20T20:34:30.623213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":797,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652592+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:32.652592+0000","last_peered":"2024-09-20T20:34:32.652592+0000","last_clean":"2024-09-20T20:34:32.652592+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:32.652592+0000","last_undegraded":"2024-09-20T20:34:32.652592+0000","last_fullsized":"2024-09-20T20:34:32.652592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":519,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652176+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:32.652176+0000","last_peered":"2024-09-20T20:34:32.652176+0000","last_clean":"2024-09-20T20:34:32.652176+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:32.652176+0000","last_undegraded":"2024-09-20T20:34:32.652176+0000","last_fullsized":"2024-09-20T20:34:32.652176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":573,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-20T20:34:30.623733+0000","last_change":"2024-09-20T20:34:30.623733+0000","last_active":"2024-09-20T20:34:17.650415+0000","last_peered":"2024-09-20T20:34:15.792455+0000","last_clean":"2024-09-20T20:31:51.163089+0000","last_became_active":"2024-09-20T20:31:52.244509+0000","last_became_peered":"2024-09-20T20:31:52.244509+0000","last_unstale":"2024-09-20T20:34:30.623733+0000","last_undegraded":"2024-09-20T20:34:30.623733+0000","last_fullsized":"2024-09-20T20:34:30.623733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":674,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622209+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:30.622209+0000","last_peered":"2024-09-20T20:34:30.622209+0000","last_clean":"2024-09-20T20:34:30.622209+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:30.622209+0000","last_undegraded":"2024-09-20T20:34:30.622209+0000","last_fullsized":"2024-09-20T20:34:30.622209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":631,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646923+0000","last_change":"2024-09-20T20:34:18.939734+0000","last_active":"2024-09-20T20:34:32.646923+0000","last_peered":"2024-09-20T20:34:32.646923+0000","last_clean":"2024-09-20T20:31:51.161495+0000","last_became_active":"2024-09-20T20:34:18.920486+0000","last_became_peered":"2024-09-20T20:34:18.920486+0000","last_unstale":"2024-09-20T20:34:32.646923+0000","last_undegraded":"2024-09-20T20:34:18.665789+0000","last_fullsized":"2024-09-20T20:34:18.649684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651003+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:32.651003+0000","last_peered":"2024-09-20T20:34:32.651003+0000","last_clean":"2024-09-20T20:34:32.651003+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:32.651003+0000","last_undegraded":"2024-09-20T20:34:32.651003+0000","last_fullsized":"2024-09-20T20:34:32.651003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":612,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653017+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:32.653017+0000","last_peered":"2024-09-20T20:34:32.653017+0000","last_clean":"2024-09-20T20:34:32.653017+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:32.653017+0000","last_undegraded":"2024-09-20T20:34:32.653017+0000","last_fullsized":"2024-09-20T20:34:32.653017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652676+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:32.652676+0000","last_peered":"2024-09-20T20:34:32.652676+0000","last_clean":"2024-09-20T20:34:32.652676+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:32.652676+0000","last_undegraded":"2024-09-20T20:34:32.652676+0000","last_fullsized":"2024-09-20T20:34:32.652676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":591,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623259+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:30.623259+0000","last_peered":"2024-09-20T20:34:30.623259+0000","last_clean":"2024-09-20T20:34:30.623259+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:30.623259+0000","last_undegraded":"2024-09-20T20:34:30.623259+0000","last_fullsized":"2024-09-20T20:34:30.623259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624421+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:30.624421+0000","last_peered":"2024-09-20T20:34:30.624421+0000","last_clean":"2024-09-20T20:34:30.624421+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:30.624421+0000","last_undegraded":"2024-09-20T20:34:30.624421+0000","last_fullsized":"2024-09-20T20:34:30.624421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":603,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.651981+0000","last_change":"2024-09-20T20:34:26.701111+0000","last_active":"2024-09-20T20:34:32.651981+0000","last_peered":"2024-09-20T20:34:32.651981+0000","last_clean":"2024-09-20T20:31:51.184225+0000","last_became_active":"2024-09-20T20:34:26.683873+0000","last_became_peered":"2024-09-20T20:34:26.683873+0000","last_unstale":"2024-09-20T20:34:32.651981+0000","last_undegraded":"2024-09-20T20:34:26.677758+0000","last_fullsized":"2024-09-20T20:34:26.677143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":661,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647212+0000","last_change":"2024-09-20T20:34:18.936170+0000","last_active":"2024-09-20T20:34:32.647212+0000","last_peered":"2024-09-20T20:34:32.647212+0000","last_clean":"2024-09-20T20:31:51.202971+0000","last_became_active":"2024-09-20T20:34:18.927334+0000","last_became_peered":"2024-09-20T20:34:18.927334+0000","last_unstale":"2024-09-20T20:34:32.647212+0000","last_undegraded":"2024-09-20T20:34:18.663132+0000","last_fullsized":"2024-09-20T20:34:18.649746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":674,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651417+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:32.651417+0000","last_peered":"2024-09-20T20:34:32.651417+0000","last_clean":"2024-09-20T20:34:32.651417+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:32.651417+0000","last_undegraded":"2024-09-20T20:34:32.651417+0000","last_fullsized":"2024-09-20T20:34:32.651417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":550,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.653886+0000","last_change":"2024-09-20T20:34:26.691471+0000","last_active":"2024-09-20T20:34:32.653886+0000","last_peered":"2024-09-20T20:34:32.653886+0000","last_clean":"2024-09-20T20:31:51.129241+0000","last_became_active":"2024-09-20T20:34:26.682699+0000","last_became_peered":"2024-09-20T20:34:26.682699+0000","last_unstale":"2024-09-20T20:34:32.653886+0000","last_undegraded":"2024-09-20T20:34:26.676325+0000","last_fullsized":"2024-09-20T20:34:26.675708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1059,"reported_epoch":84,"state":"peering","last_fresh":"2024-09-20T20:34:32.432085+0000","last_change":"2024-09-20T20:34:32.651505+0000","last_active":"2024-09-20T20:34:32.651505+0000","last_peered":"2024-09-20T20:34:32.432085+0000","last_clean":"2024-09-20T20:31:51.173602+0000","last_became_active":"2024-09-20T20:34:18.918961+0000","last_became_peered":"2024-09-20T20:34:18.918961+0000","last_unstale":"2024-09-20T20:34:32.432085+0000","last_undegraded":"2024-09-20T20:34:32.432085+0000","last_fullsized":"2024-09-20T20:34:18.655037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":808,"reported_epoch":85,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-20T20:34:32.733076+0000","last_change":"2024-09-20T20:34:32.436931+0000","last_active":"2024-09-20T20:34:32.733076+0000","last_peered":"2024-09-20T20:34:32.733076+0000","last_clean":"2024-09-20T20:31:51.134626+0000","last_became_active":"2024-09-20T20:34:18.923834+0000","last_became_peered":"2024-09-20T20:34:18.923834+0000","last_unstale":"2024-09-20T20:34:32.733076+0000","last_undegraded":"2024-09-20T20:34:32.733076+0000","last_fullsized":"2024-09-20T20:34:18.679822+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":915,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653232+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:32.653232+0000","last_peered":"2024-09-20T20:34:32.653232+0000","last_clean":"2024-09-20T20:34:32.653232+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:32.653232+0000","last_undegraded":"2024-09-20T20:34:32.653232+0000","last_fullsized":"2024-09-20T20:34:32.653232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648467+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:32.648467+0000","last_peered":"2024-09-20T20:34:32.648467+0000","last_clean":"2024-09-20T20:34:32.648467+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:32.648467+0000","last_undegraded":"2024-09-20T20:34:32.648467+0000","last_fullsized":"2024-09-20T20:34:32.648467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":614,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.653425+0000","last_change":"2024-09-20T20:34:26.704756+0000","last_active":"2024-09-20T20:34:32.653425+0000","last_peered":"2024-09-20T20:34:32.653425+0000","last_clean":"2024-09-20T20:31:51.179186+0000","last_became_active":"2024-09-20T20:34:26.700667+0000","last_became_peered":"2024-09-20T20:34:26.700667+0000","last_unstale":"2024-09-20T20:34:32.653425+0000","last_undegraded":"2024-09-20T20:34:26.682148+0000","last_fullsized":"2024-09-20T20:34:26.679653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647339+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:32.647339+0000","last_peered":"2024-09-20T20:34:32.647339+0000","last_clean":"2024-09-20T20:34:32.647339+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:32.647339+0000","last_undegraded":"2024-09-20T20:34:32.647339+0000","last_fullsized":"2024-09-20T20:34:32.647339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":591,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647580+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:32.647580+0000","last_peered":"2024-09-20T20:34:32.647580+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:32.647580+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":477,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653227+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:32.653227+0000","last_peered":"2024-09-20T20:34:32.653227+0000","last_clean":"2024-09-20T20:34:32.653227+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:32.653227+0000","last_undegraded":"2024-09-20T20:34:32.653227+0000","last_fullsized":"2024-09-20T20:34:32.653227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622445+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:30.622445+0000","last_peered":"2024-09-20T20:34:30.622445+0000","last_clean":"2024-09-20T20:34:30.622445+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:30.622445+0000","last_undegraded":"2024-09-20T20:34:30.622445+0000","last_fullsized":"2024-09-20T20:34:30.622445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.654666+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:32.654666+0000","last_peered":"2024-09-20T20:34:32.654666+0000","last_clean":"2024-09-20T20:34:32.654666+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:32.654666+0000","last_undegraded":"2024-09-20T20:34:32.654666+0000","last_fullsized":"2024-09-20T20:34:32.654666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648311+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:32.648311+0000","last_peered":"2024-09-20T20:34:32.648311+0000","last_clean":"2024-09-20T20:34:32.648311+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:32.648311+0000","last_undegraded":"2024-09-20T20:34:32.648311+0000","last_fullsized":"2024-09-20T20:34:32.648311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":633,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.651455+0000","last_change":"2024-09-20T20:34:18.937745+0000","last_active":"2024-09-20T20:34:32.651455+0000","last_peered":"2024-09-20T20:34:32.651455+0000","last_clean":"2024-09-20T20:31:51.202663+0000","last_became_active":"2024-09-20T20:34:18.931378+0000","last_became_peered":"2024-09-20T20:34:18.931378+0000","last_unstale":"2024-09-20T20:34:32.651455+0000","last_undegraded":"2024-09-20T20:34:18.686815+0000","last_fullsized":"2024-09-20T20:34:18.675123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651869+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:32.651869+0000","last_peered":"2024-09-20T20:34:32.651869+0000","last_clean":"2024-09-20T20:34:32.651869+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:32.651869+0000","last_undegraded":"2024-09-20T20:34:32.651869+0000","last_fullsized":"2024-09-20T20:34:32.651869+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":622,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.650323+0000","last_change":"2024-09-20T20:34:19.225616+0000","last_active":"2024-09-20T20:34:32.650323+0000","last_peered":"2024-09-20T20:34:32.650323+0000","last_clean":"2024-09-20T20:31:51.195638+0000","last_became_active":"2024-09-20T20:34:18.889264+0000","last_became_peered":"2024-09-20T20:34:18.889264+0000","last_unstale":"2024-09-20T20:34:32.650323+0000","last_undegraded":"2024-09-20T20:34:19.225278+0000","last_fullsized":"2024-09-20T20:34:18.651936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621287+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:30.621287+0000","last_peered":"2024-09-20T20:34:30.621287+0000","last_clean":"2024-09-20T20:34:30.621287+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:30.621287+0000","last_undegraded":"2024-09-20T20:34:30.621287+0000","last_fullsized":"2024-09-20T20:34:30.621287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624058+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:30.624058+0000","last_peered":"2024-09-20T20:34:30.624058+0000","last_clean":"2024-09-20T20:34:30.624058+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:30.624058+0000","last_undegraded":"2024-09-20T20:34:30.624058+0000","last_fullsized":"2024-09-20T20:34:30.624058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":888,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651443+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:32.651443+0000","last_peered":"2024-09-20T20:34:32.651443+0000","last_clean":"2024-09-20T20:34:32.651443+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:32.651443+0000","last_undegraded":"2024-09-20T20:34:32.651443+0000","last_fullsized":"2024-09-20T20:34:32.651443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":419,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653780+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:32.653780+0000","last_peered":"2024-09-20T20:34:32.653780+0000","last_clean":"2024-09-20T20:34:32.653780+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:32.653780+0000","last_undegraded":"2024-09-20T20:34:32.653780+0000","last_fullsized":"2024-09-20T20:34:32.653780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651591+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:32.651591+0000","last_peered":"2024-09-20T20:34:32.651591+0000","last_clean":"2024-09-20T20:34:32.651591+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:32.651591+0000","last_undegraded":"2024-09-20T20:34:32.651591+0000","last_fullsized":"2024-09-20T20:34:32.651591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622852+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:30.622852+0000","last_peered":"2024-09-20T20:34:30.622852+0000","last_clean":"2024-09-20T20:34:30.622852+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:30.622852+0000","last_undegraded":"2024-09-20T20:34:30.622852+0000","last_fullsized":"2024-09-20T20:34:30.622852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":632,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:29.654101+0000","last_change":"2024-09-20T20:34:18.933836+0000","last_active":"2024-09-20T20:34:29.654101+0000","last_peered":"2024-09-20T20:34:29.654101+0000","last_clean":"2024-09-20T20:31:51.151645+0000","last_became_active":"2024-09-20T20:34:18.918599+0000","last_became_peered":"2024-09-20T20:34:18.918599+0000","last_unstale":"2024-09-20T20:34:29.654101+0000","last_undegraded":"2024-09-20T20:34:18.683120+0000","last_fullsized":"2024-09-20T20:34:18.671352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622815+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:30.622815+0000","last_peered":"2024-09-20T20:34:30.622815+0000","last_clean":"2024-09-20T20:34:30.622815+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:30.622815+0000","last_undegraded":"2024-09-20T20:34:30.622815+0000","last_fullsized":"2024-09-20T20:34:30.622815+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1054,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648760+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:32.648760+0000","last_peered":"2024-09-20T20:34:32.648760+0000","last_clean":"2024-09-20T20:34:32.648760+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:32.648760+0000","last_undegraded":"2024-09-20T20:34:32.648760+0000","last_fullsized":"2024-09-20T20:34:32.648760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":357,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649212+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:32.649212+0000","last_peered":"2024-09-20T20:34:32.649212+0000","last_clean":"2024-09-20T20:34:32.649212+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:32.649212+0000","last_undegraded":"2024-09-20T20:34:32.649212+0000","last_fullsized":"2024-09-20T20:34:32.649212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":583,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623708+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:30.623708+0000","last_peered":"2024-09-20T20:34:30.623708+0000","last_clean":"2024-09-20T20:34:30.623708+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:30.623708+0000","last_undegraded":"2024-09-20T20:34:30.623708+0000","last_fullsized":"2024-09-20T20:34:30.623708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623773+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:30.623773+0000","last_peered":"2024-09-20T20:34:30.623773+0000","last_clean":"2024-09-20T20:34:30.623773+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:30.623773+0000","last_undegraded":"2024-09-20T20:34:30.623773+0000","last_fullsized":"2024-09-20T20:34:30.623773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":587,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.655019+0000","last_change":"2024-09-20T20:34:18.935349+0000","last_active":"2024-09-20T20:34:32.655019+0000","last_peered":"2024-09-20T20:34:32.655019+0000","last_clean":"2024-09-20T20:31:51.164211+0000","last_became_active":"2024-09-20T20:34:18.928354+0000","last_became_peered":"2024-09-20T20:34:18.928354+0000","last_unstale":"2024-09-20T20:34:32.655019+0000","last_undegraded":"2024-09-20T20:34:18.680220+0000","last_fullsized":"2024-09-20T20:34:18.677289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651971+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:32.651971+0000","last_peered":"2024-09-20T20:34:32.651971+0000","last_clean":"2024-09-20T20:34:32.651971+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:32.651971+0000","last_undegraded":"2024-09-20T20:34:32.651971+0000","last_fullsized":"2024-09-20T20:34:32.651971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624092+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:30.624092+0000","last_peered":"2024-09-20T20:34:30.624092+0000","last_clean":"2024-09-20T20:34:30.624092+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:30.624092+0000","last_undegraded":"2024-09-20T20:34:30.624092+0000","last_fullsized":"2024-09-20T20:34:30.624092+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651712+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:32.651712+0000","last_peered":"2024-09-20T20:34:32.651712+0000","last_clean":"2024-09-20T20:34:32.651712+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:32.651712+0000","last_undegraded":"2024-09-20T20:34:32.651712+0000","last_fullsized":"2024-09-20T20:34:32.651712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650402+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:32.650402+0000","last_peered":"2024-09-20T20:34:32.650402+0000","last_clean":"2024-09-20T20:34:32.650402+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:32.650402+0000","last_undegraded":"2024-09-20T20:34:32.650402+0000","last_fullsized":"2024-09-20T20:34:32.650402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":329,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621007+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:30.621007+0000","last_peered":"2024-09-20T20:34:30.621007+0000","last_clean":"2024-09-20T20:34:30.621007+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:30.621007+0000","last_undegraded":"2024-09-20T20:34:30.621007+0000","last_fullsized":"2024-09-20T20:34:30.621007+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621847+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:30.621847+0000","last_peered":"2024-09-20T20:34:30.621847+0000","last_clean":"2024-09-20T20:34:30.621847+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:30.621847+0000","last_undegraded":"2024-09-20T20:34:30.621847+0000","last_fullsized":"2024-09-20T20:34:30.621847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":708,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649138+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:32.649138+0000","last_peered":"2024-09-20T20:34:32.649138+0000","last_clean":"2024-09-20T20:34:32.649138+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:32.649138+0000","last_undegraded":"2024-09-20T20:34:32.649138+0000","last_fullsized":"2024-09-20T20:34:32.649138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":595,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:29.658769+0000","last_change":"2024-09-20T20:34:18.934849+0000","last_active":"2024-09-20T20:34:29.658769+0000","last_peered":"2024-09-20T20:34:29.658769+0000","last_clean":"2024-09-20T20:31:51.170388+0000","last_became_active":"2024-09-20T20:34:18.917137+0000","last_became_peered":"2024-09-20T20:34:18.917137+0000","last_unstale":"2024-09-20T20:34:29.658769+0000","last_undegraded":"2024-09-20T20:34:18.675416+0000","last_fullsized":"2024-09-20T20:34:18.656310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621813+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:30.621813+0000","last_peered":"2024-09-20T20:34:30.621813+0000","last_clean":"2024-09-20T20:34:30.621813+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:30.621813+0000","last_undegraded":"2024-09-20T20:34:30.621813+0000","last_fullsized":"2024-09-20T20:34:30.621813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":352,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648304+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:32.648304+0000","last_peered":"2024-09-20T20:34:32.648304+0000","last_clean":"2024-09-20T20:34:32.648304+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:32.648304+0000","last_undegraded":"2024-09-20T20:34:32.648304+0000","last_fullsized":"2024-09-20T20:34:32.648304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653475+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:32.653475+0000","last_peered":"2024-09-20T20:34:32.653475+0000","last_clean":"2024-09-20T20:34:32.653475+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:32.653475+0000","last_undegraded":"2024-09-20T20:34:32.653475+0000","last_fullsized":"2024-09-20T20:34:32.653475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648607+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:32.648607+0000","last_peered":"2024-09-20T20:34:32.648607+0000","last_clean":"2024-09-20T20:34:32.648607+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:32.648607+0000","last_undegraded":"2024-09-20T20:34:32.648607+0000","last_fullsized":"2024-09-20T20:34:32.648607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":385,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651757+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:32.651757+0000","last_peered":"2024-09-20T20:34:32.651757+0000","last_clean":"2024-09-20T20:34:32.651757+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:32.651757+0000","last_undegraded":"2024-09-20T20:34:32.651757+0000","last_fullsized":"2024-09-20T20:34:32.651757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650691+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:32.650691+0000","last_peered":"2024-09-20T20:34:32.650691+0000","last_clean":"2024-09-20T20:34:32.650691+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:32.650691+0000","last_undegraded":"2024-09-20T20:34:32.650691+0000","last_fullsized":"2024-09-20T20:34:32.650691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621515+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:30.621515+0000","last_peered":"2024-09-20T20:34:30.621515+0000","last_clean":"2024-09-20T20:34:30.621515+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:30.621515+0000","last_undegraded":"2024-09-20T20:34:30.621515+0000","last_fullsized":"2024-09-20T20:34:30.621515+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622125+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:30.622125+0000","last_peered":"2024-09-20T20:34:30.622125+0000","last_clean":"2024-09-20T20:34:30.622125+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:30.622125+0000","last_undegraded":"2024-09-20T20:34:30.622125+0000","last_fullsized":"2024-09-20T20:34:30.622125+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":587,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649271+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:32.649271+0000","last_peered":"2024-09-20T20:34:32.649271+0000","last_clean":"2024-09-20T20:34:32.649271+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:32.649271+0000","last_undegraded":"2024-09-20T20:34:32.649271+0000","last_fullsized":"2024-09-20T20:34:32.649271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622332+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:30.622332+0000","last_peered":"2024-09-20T20:34:30.622332+0000","last_clean":"2024-09-20T20:34:30.622332+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:30.622332+0000","last_undegraded":"2024-09-20T20:34:30.622332+0000","last_fullsized":"2024-09-20T20:34:30.622332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649730+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:32.649730+0000","last_peered":"2024-09-20T20:34:32.649730+0000","last_clean":"2024-09-20T20:34:32.649730+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:32.649730+0000","last_undegraded":"2024-09-20T20:34:32.649730+0000","last_fullsized":"2024-09-20T20:34:32.649730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":822,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.665825+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:32.665825+0000","last_peered":"2024-09-20T20:34:32.665825+0000","last_clean":"2024-09-20T20:34:32.665825+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:32.665825+0000","last_undegraded":"2024-09-20T20:34:32.665825+0000","last_fullsized":"2024-09-20T20:34:32.665825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":204,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649283+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:32.649283+0000","last_peered":"2024-09-20T20:34:32.649283+0000","last_clean":"2024-09-20T20:34:32.649283+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:32.649283+0000","last_undegraded":"2024-09-20T20:34:32.649283+0000","last_fullsized":"2024-09-20T20:34:32.649283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655611+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:32.655611+0000","last_peered":"2024-09-20T20:34:32.655611+0000","last_clean":"2024-09-20T20:34:32.655611+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:32.655611+0000","last_undegraded":"2024-09-20T20:34:32.655611+0000","last_fullsized":"2024-09-20T20:34:32.655611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":878,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652665+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:32.652665+0000","last_peered":"2024-09-20T20:34:32.652665+0000","last_clean":"2024-09-20T20:34:32.652665+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:32.652665+0000","last_undegraded":"2024-09-20T20:34:32.652665+0000","last_fullsized":"2024-09-20T20:34:32.652665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651127+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:32.651127+0000","last_peered":"2024-09-20T20:34:32.651127+0000","last_clean":"2024-09-20T20:34:32.651127+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:32.651127+0000","last_undegraded":"2024-09-20T20:34:32.651127+0000","last_fullsized":"2024-09-20T20:34:32.651127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651965+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:32.651965+0000","last_peered":"2024-09-20T20:34:32.651965+0000","last_clean":"2024-09-20T20:34:32.651965+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:32.651965+0000","last_undegraded":"2024-09-20T20:34:32.651965+0000","last_fullsized":"2024-09-20T20:34:32.651965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":696,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.648533+0000","last_change":"2024-09-20T20:34:18.940279+0000","last_active":"2024-09-20T20:34:32.648533+0000","last_peered":"2024-09-20T20:34:32.648533+0000","last_clean":"2024-09-20T20:31:51.202703+0000","last_became_active":"2024-09-20T20:34:18.934354+0000","last_became_peered":"2024-09-20T20:34:18.934354+0000","last_unstale":"2024-09-20T20:34:32.648533+0000","last_undegraded":"2024-09-20T20:34:18.689916+0000","last_fullsized":"2024-09-20T20:34:18.683789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651809+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:32.651809+0000","last_peered":"2024-09-20T20:34:32.651809+0000","last_clean":"2024-09-20T20:34:32.651809+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:32.651809+0000","last_undegraded":"2024-09-20T20:34:32.651809+0000","last_fullsized":"2024-09-20T20:34:32.651809+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623459+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:30.623459+0000","last_peered":"2024-09-20T20:34:30.623459+0000","last_clean":"2024-09-20T20:34:30.623459+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:30.623459+0000","last_undegraded":"2024-09-20T20:34:30.623459+0000","last_fullsized":"2024-09-20T20:34:30.623459+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":916,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651638+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:32.651638+0000","last_peered":"2024-09-20T20:34:32.651638+0000","last_clean":"2024-09-20T20:34:32.651638+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:32.651638+0000","last_undegraded":"2024-09-20T20:34:32.651638+0000","last_fullsized":"2024-09-20T20:34:32.651638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624128+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:30.624128+0000","last_peered":"2024-09-20T20:34:30.624128+0000","last_clean":"2024-09-20T20:34:30.624128+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:30.624128+0000","last_undegraded":"2024-09-20T20:34:30.624128+0000","last_fullsized":"2024-09-20T20:34:30.624128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622111+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:30.622111+0000","last_peered":"2024-09-20T20:34:30.622111+0000","last_clean":"2024-09-20T20:34:30.622111+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:30.622111+0000","last_undegraded":"2024-09-20T20:34:30.622111+0000","last_fullsized":"2024-09-20T20:34:30.622111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":570,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647711+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:32.647711+0000","last_peered":"2024-09-20T20:34:32.647711+0000","last_clean":"2024-09-20T20:34:32.647711+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:32.647711+0000","last_undegraded":"2024-09-20T20:34:32.647711+0000","last_fullsized":"2024-09-20T20:34:32.647711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655189+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:32.655189+0000","last_peered":"2024-09-20T20:34:32.655189+0000","last_clean":"2024-09-20T20:34:32.655189+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:32.655189+0000","last_undegraded":"2024-09-20T20:34:32.655189+0000","last_fullsized":"2024-09-20T20:34:32.655189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":248,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623583+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:30.623583+0000","last_peered":"2024-09-20T20:34:30.623583+0000","last_clean":"2024-09-20T20:34:30.623583+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:30.623583+0000","last_undegraded":"2024-09-20T20:34:30.623583+0000","last_fullsized":"2024-09-20T20:34:30.623583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1067,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647760+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:32.647760+0000","last_peered":"2024-09-20T20:34:32.647760+0000","last_clean":"2024-09-20T20:34:32.647760+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:32.647760+0000","last_undegraded":"2024-09-20T20:34:32.647760+0000","last_fullsized":"2024-09-20T20:34:32.647760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":213,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650973+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:32.650973+0000","last_peered":"2024-09-20T20:34:32.650973+0000","last_clean":"2024-09-20T20:34:32.650973+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:32.650973+0000","last_undegraded":"2024-09-20T20:34:32.650973+0000","last_fullsized":"2024-09-20T20:34:32.650973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649013+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:32.649013+0000","last_peered":"2024-09-20T20:34:32.649013+0000","last_clean":"2024-09-20T20:34:32.649013+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:32.649013+0000","last_undegraded":"2024-09-20T20:34:32.649013+0000","last_fullsized":"2024-09-20T20:34:32.649013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":531,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.654243+0000","last_change":"2024-09-20T20:34:19.277789+0000","last_active":"2024-09-20T20:34:32.654243+0000","last_peered":"2024-09-20T20:34:32.654243+0000","last_clean":"2024-09-20T20:31:51.167971+0000","last_became_active":"2024-09-20T20:34:18.890488+0000","last_became_peered":"2024-09-20T20:34:18.890488+0000","last_unstale":"2024-09-20T20:34:32.654243+0000","last_undegraded":"2024-09-20T20:34:19.277313+0000","last_fullsized":"2024-09-20T20:34:18.667466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":144,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":846,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649914+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:32.649914+0000","last_peered":"2024-09-20T20:34:32.649914+0000","last_clean":"2024-09-20T20:34:32.649914+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:32.649914+0000","last_undegraded":"2024-09-20T20:34:32.649914+0000","last_fullsized":"2024-09-20T20:34:32.649914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":588,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.650360+0000","last_change":"2024-09-20T20:34:18.935766+0000","last_active":"2024-09-20T20:34:32.650360+0000","last_peered":"2024-09-20T20:34:32.650360+0000","last_clean":"2024-09-20T20:31:51.200271+0000","last_became_active":"2024-09-20T20:34:18.921689+0000","last_became_peered":"2024-09-20T20:34:18.921689+0000","last_unstale":"2024-09-20T20:34:32.650360+0000","last_undegraded":"2024-09-20T20:34:18.680964+0000","last_fullsized":"2024-09-20T20:34:18.663912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":344,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648117+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:32.648117+0000","last_peered":"2024-09-20T20:34:32.648117+0000","last_clean":"2024-09-20T20:34:32.648117+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:32.648117+0000","last_undegraded":"2024-09-20T20:34:32.648117+0000","last_fullsized":"2024-09-20T20:34:32.648117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":642,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.654307+0000","last_change":"2024-09-20T20:34:18.935605+0000","last_active":"2024-09-20T20:34:32.654307+0000","last_peered":"2024-09-20T20:34:32.654307+0000","last_clean":"2024-09-20T20:31:51.202419+0000","last_became_active":"2024-09-20T20:34:18.931023+0000","last_became_peered":"2024-09-20T20:34:18.931023+0000","last_unstale":"2024-09-20T20:34:32.654307+0000","last_undegraded":"2024-09-20T20:34:18.676532+0000","last_fullsized":"2024-09-20T20:34:18.670396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":148,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":306,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653591+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:32.653591+0000","last_peered":"2024-09-20T20:34:32.653591+0000","last_clean":"2024-09-20T20:34:32.653591+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:32.653591+0000","last_undegraded":"2024-09-20T20:34:32.653591+0000","last_fullsized":"2024-09-20T20:34:32.653591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652907+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:32.652907+0000","last_peered":"2024-09-20T20:34:32.652907+0000","last_clean":"2024-09-20T20:34:32.652907+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:32.652907+0000","last_undegraded":"2024-09-20T20:34:32.652907+0000","last_fullsized":"2024-09-20T20:34:32.652907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653048+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:32.653048+0000","last_peered":"2024-09-20T20:34:32.653048+0000","last_clean":"2024-09-20T20:34:32.653048+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:32.653048+0000","last_undegraded":"2024-09-20T20:34:32.653048+0000","last_fullsized":"2024-09-20T20:34:32.653048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":532,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-20T20:34:30.623753+0000","last_change":"2024-09-20T20:34:30.623753+0000","last_active":"2024-09-20T20:34:17.643461+0000","last_peered":"2024-09-20T20:34:15.792678+0000","last_clean":"2024-09-20T20:31:51.144496+0000","last_became_active":"2024-09-20T20:31:52.253537+0000","last_became_peered":"2024-09-20T20:31:52.253537+0000","last_unstale":"2024-09-20T20:34:30.623753+0000","last_undegraded":"2024-09-20T20:34:30.623753+0000","last_fullsized":"2024-09-20T20:34:30.623753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622487+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:30.622487+0000","last_peered":"2024-09-20T20:34:30.622487+0000","last_clean":"2024-09-20T20:34:30.622487+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:30.622487+0000","last_undegraded":"2024-09-20T20:34:30.622487+0000","last_fullsized":"2024-09-20T20:34:30.622487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":590,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647865+0000","last_change":"2024-09-20T20:34:18.937123+0000","last_active":"2024-09-20T20:34:32.647865+0000","last_peered":"2024-09-20T20:34:32.647865+0000","last_clean":"2024-09-20T20:31:51.151591+0000","last_became_active":"2024-09-20T20:34:18.931120+0000","last_became_peered":"2024-09-20T20:34:18.931120+0000","last_unstale":"2024-09-20T20:34:32.647865+0000","last_undegraded":"2024-09-20T20:34:18.677324+0000","last_fullsized":"2024-09-20T20:34:18.663778+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":155,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":432,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655000+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:32.655000+0000","last_peered":"2024-09-20T20:34:32.655000+0000","last_clean":"2024-09-20T20:34:32.655000+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:32.655000+0000","last_undegraded":"2024-09-20T20:34:32.655000+0000","last_fullsized":"2024-09-20T20:34:32.655000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652162+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:32.652162+0000","last_peered":"2024-09-20T20:34:32.652162+0000","last_clean":"2024-09-20T20:34:32.652162+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:32.652162+0000","last_undegraded":"2024-09-20T20:34:32.652162+0000","last_fullsized":"2024-09-20T20:34:32.652162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":213,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651169+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:32.651169+0000","last_peered":"2024-09-20T20:34:32.651169+0000","last_clean":"2024-09-20T20:34:32.651169+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:32.651169+0000","last_undegraded":"2024-09-20T20:34:32.651169+0000","last_fullsized":"2024-09-20T20:34:32.651169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":604,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647417+0000","last_change":"2024-09-20T20:34:18.940010+0000","last_active":"2024-09-20T20:34:32.647417+0000","last_peered":"2024-09-20T20:34:32.647417+0000","last_clean":"2024-09-20T20:31:51.180364+0000","last_became_active":"2024-09-20T20:34:18.923020+0000","last_became_peered":"2024-09-20T20:34:18.923020+0000","last_unstale":"2024-09-20T20:34:32.647417+0000","last_undegraded":"2024-09-20T20:34:18.682966+0000","last_fullsized":"2024-09-20T20:34:18.666887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650690+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:32.650690+0000","last_peered":"2024-09-20T20:34:32.650690+0000","last_clean":"2024-09-20T20:34:32.650690+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:32.650690+0000","last_undegraded":"2024-09-20T20:34:32.650690+0000","last_fullsized":"2024-09-20T20:34:32.650690+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3318,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19582976,"data_stored":24909753,"data_compressed":2491357,"data_compressed_allocated":3584000,"data_compressed_original":16704652,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":109,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99212,"kb_used_data":27828,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272628,"statfs":{"total":96636764160,"available":96535171072,"internally_reserved":0,"allocated":28495872,"data_stored":81516174,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104244,"kb_used_data":28696,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267596,"statfs":{"total":96636764160,"available":96530018304,"internally_reserved":0,"allocated":29384704,"data_stored":85060401,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81936,"kb_used_data":44096,"kb_used_omap":165,"kb_used_meta":37658,"kb_avail":94289904,"statfs":{"total":96636764160,"available":96552861696,"internally_reserved":0,"allocated":45154304,"data_stored":116629364,"data_compressed":16500653,"data_compressed_allocated":20680704,"data_compressed_original":101057676,"omap_allocated":169794,"internal_metadata":38561982},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19582976,"data_stored":24909753,"data_compressed":2491357,"data_compressed_allocated":3584000,"data_compressed_original":16704652,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:34.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-20T20:34:34.616 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:34.617 INFO:teuthology.orchestra.run.smithi070.stdout:{"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3319/114 objects degraded (2911.404%), 20 pgs degraded","count":20},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":301,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":86,"num_osds":3,"num_up_osds":3,"osd_up_since":1726864456,"num_in_osds":3,"osd_in_since":1726864173,"num_remapped_pgs":15},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":82},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":20},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128120423,"bytes_used":292188160,"bytes_avail":289618104320,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":3319,"degraded_total":114,"degraded_ratio":29.114035087719298,"recovering_objects_per_sec":493,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1976,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-20T20:31:03.624405+0000","services":{}},"progress_events":{}} 2024-09-20T20:34:34.635 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-20T20:34:34.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:34.952 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:34.970 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-09-20T20:34:34.647436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3332,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":285392,"kb_used_data":100620,"kb_used_omap":168,"kb_used_meta":184535,"kb_avail":282830128,"statfs":{"total":289910292480,"available":289618051072,"internally_reserved":0,"allocated":103034880,"data_stored":283205939,"data_compressed":40223628,"data_compressed_allocated":51974144,"data_compressed_original":241894540,"omap_allocated":172984,"internal_metadata":188963912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-348,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.998090"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653616+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:32.653616+0000","last_peered":"2024-09-20T20:34:32.653616+0000","last_clean":"2024-09-20T20:34:32.653616+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:32.653616+0000","last_undegraded":"2024-09-20T20:34:32.653616+0000","last_fullsized":"2024-09-20T20:34:32.653616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":649,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652690+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:32.652690+0000","last_peered":"2024-09-20T20:34:32.652690+0000","last_clean":"2024-09-20T20:34:32.652690+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:32.652690+0000","last_undegraded":"2024-09-20T20:34:32.652690+0000","last_fullsized":"2024-09-20T20:34:32.652690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":571,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623343+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:30.623343+0000","last_peered":"2024-09-20T20:34:30.623343+0000","last_clean":"2024-09-20T20:34:30.623343+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:30.623343+0000","last_undegraded":"2024-09-20T20:34:30.623343+0000","last_fullsized":"2024-09-20T20:34:30.623343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":539,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622660+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:30.622660+0000","last_peered":"2024-09-20T20:34:30.622660+0000","last_clean":"2024-09-20T20:34:30.622660+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:30.622660+0000","last_undegraded":"2024-09-20T20:34:30.622660+0000","last_fullsized":"2024-09-20T20:34:30.622660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":499,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652954+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:32.652954+0000","last_peered":"2024-09-20T20:34:32.652954+0000","last_clean":"2024-09-20T20:34:32.652954+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:32.652954+0000","last_undegraded":"2024-09-20T20:34:32.652954+0000","last_fullsized":"2024-09-20T20:34:32.652954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":557,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.633458+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:30.633458+0000","last_peered":"2024-09-20T20:34:30.633458+0000","last_clean":"2024-09-20T20:34:30.633458+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:30.633458+0000","last_undegraded":"2024-09-20T20:34:30.633458+0000","last_fullsized":"2024-09-20T20:34:30.633458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":602,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622285+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:30.622285+0000","last_peered":"2024-09-20T20:34:30.622285+0000","last_clean":"2024-09-20T20:34:30.622285+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:30.622285+0000","last_undegraded":"2024-09-20T20:34:30.622285+0000","last_fullsized":"2024-09-20T20:34:30.622285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":606,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646917+0000","last_change":"2024-09-20T20:34:18.940543+0000","last_active":"2024-09-20T20:34:32.646917+0000","last_peered":"2024-09-20T20:34:32.646917+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:34:18.934342+0000","last_became_peered":"2024-09-20T20:34:18.934342+0000","last_unstale":"2024-09-20T20:34:32.646917+0000","last_undegraded":"2024-09-20T20:34:18.666832+0000","last_fullsized":"2024-09-20T20:34:18.649718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":139,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650009+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:32.650009+0000","last_peered":"2024-09-20T20:34:32.650009+0000","last_clean":"2024-09-20T20:34:32.650009+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:32.650009+0000","last_undegraded":"2024-09-20T20:34:32.650009+0000","last_fullsized":"2024-09-20T20:34:32.650009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":552,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.654179+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:32.654179+0000","last_peered":"2024-09-20T20:34:32.654179+0000","last_clean":"2024-09-20T20:34:32.654179+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:32.654179+0000","last_undegraded":"2024-09-20T20:34:32.654179+0000","last_fullsized":"2024-09-20T20:34:32.654179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":529,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623213+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:30.623213+0000","last_peered":"2024-09-20T20:34:30.623213+0000","last_clean":"2024-09-20T20:34:30.623213+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:30.623213+0000","last_undegraded":"2024-09-20T20:34:30.623213+0000","last_fullsized":"2024-09-20T20:34:30.623213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":797,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652592+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:32.652592+0000","last_peered":"2024-09-20T20:34:32.652592+0000","last_clean":"2024-09-20T20:34:32.652592+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:32.652592+0000","last_undegraded":"2024-09-20T20:34:32.652592+0000","last_fullsized":"2024-09-20T20:34:32.652592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":519,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652176+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:32.652176+0000","last_peered":"2024-09-20T20:34:32.652176+0000","last_clean":"2024-09-20T20:34:32.652176+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:32.652176+0000","last_undegraded":"2024-09-20T20:34:32.652176+0000","last_fullsized":"2024-09-20T20:34:32.652176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":573,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-20T20:34:30.623733+0000","last_change":"2024-09-20T20:34:30.623733+0000","last_active":"2024-09-20T20:34:17.650415+0000","last_peered":"2024-09-20T20:34:15.792455+0000","last_clean":"2024-09-20T20:31:51.163089+0000","last_became_active":"2024-09-20T20:31:52.244509+0000","last_became_peered":"2024-09-20T20:31:52.244509+0000","last_unstale":"2024-09-20T20:34:30.623733+0000","last_undegraded":"2024-09-20T20:34:30.623733+0000","last_fullsized":"2024-09-20T20:34:30.623733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":674,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622209+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:30.622209+0000","last_peered":"2024-09-20T20:34:30.622209+0000","last_clean":"2024-09-20T20:34:30.622209+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:30.622209+0000","last_undegraded":"2024-09-20T20:34:30.622209+0000","last_fullsized":"2024-09-20T20:34:30.622209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":631,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646923+0000","last_change":"2024-09-20T20:34:18.939734+0000","last_active":"2024-09-20T20:34:32.646923+0000","last_peered":"2024-09-20T20:34:32.646923+0000","last_clean":"2024-09-20T20:31:51.161495+0000","last_became_active":"2024-09-20T20:34:18.920486+0000","last_became_peered":"2024-09-20T20:34:18.920486+0000","last_unstale":"2024-09-20T20:34:32.646923+0000","last_undegraded":"2024-09-20T20:34:18.665789+0000","last_fullsized":"2024-09-20T20:34:18.649684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651003+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:32.651003+0000","last_peered":"2024-09-20T20:34:32.651003+0000","last_clean":"2024-09-20T20:34:32.651003+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:32.651003+0000","last_undegraded":"2024-09-20T20:34:32.651003+0000","last_fullsized":"2024-09-20T20:34:32.651003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":612,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653017+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:32.653017+0000","last_peered":"2024-09-20T20:34:32.653017+0000","last_clean":"2024-09-20T20:34:32.653017+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:32.653017+0000","last_undegraded":"2024-09-20T20:34:32.653017+0000","last_fullsized":"2024-09-20T20:34:32.653017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652676+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:32.652676+0000","last_peered":"2024-09-20T20:34:32.652676+0000","last_clean":"2024-09-20T20:34:32.652676+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:32.652676+0000","last_undegraded":"2024-09-20T20:34:32.652676+0000","last_fullsized":"2024-09-20T20:34:32.652676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":591,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623259+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:30.623259+0000","last_peered":"2024-09-20T20:34:30.623259+0000","last_clean":"2024-09-20T20:34:30.623259+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:30.623259+0000","last_undegraded":"2024-09-20T20:34:30.623259+0000","last_fullsized":"2024-09-20T20:34:30.623259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624421+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:30.624421+0000","last_peered":"2024-09-20T20:34:30.624421+0000","last_clean":"2024-09-20T20:34:30.624421+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:30.624421+0000","last_undegraded":"2024-09-20T20:34:30.624421+0000","last_fullsized":"2024-09-20T20:34:30.624421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":603,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.651981+0000","last_change":"2024-09-20T20:34:26.701111+0000","last_active":"2024-09-20T20:34:32.651981+0000","last_peered":"2024-09-20T20:34:32.651981+0000","last_clean":"2024-09-20T20:31:51.184225+0000","last_became_active":"2024-09-20T20:34:26.683873+0000","last_became_peered":"2024-09-20T20:34:26.683873+0000","last_unstale":"2024-09-20T20:34:32.651981+0000","last_undegraded":"2024-09-20T20:34:26.677758+0000","last_fullsized":"2024-09-20T20:34:26.677143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":661,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647212+0000","last_change":"2024-09-20T20:34:18.936170+0000","last_active":"2024-09-20T20:34:32.647212+0000","last_peered":"2024-09-20T20:34:32.647212+0000","last_clean":"2024-09-20T20:31:51.202971+0000","last_became_active":"2024-09-20T20:34:18.927334+0000","last_became_peered":"2024-09-20T20:34:18.927334+0000","last_unstale":"2024-09-20T20:34:32.647212+0000","last_undegraded":"2024-09-20T20:34:18.663132+0000","last_fullsized":"2024-09-20T20:34:18.649746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":674,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651417+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:32.651417+0000","last_peered":"2024-09-20T20:34:32.651417+0000","last_clean":"2024-09-20T20:34:32.651417+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:32.651417+0000","last_undegraded":"2024-09-20T20:34:32.651417+0000","last_fullsized":"2024-09-20T20:34:32.651417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":550,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.653886+0000","last_change":"2024-09-20T20:34:26.691471+0000","last_active":"2024-09-20T20:34:32.653886+0000","last_peered":"2024-09-20T20:34:32.653886+0000","last_clean":"2024-09-20T20:31:51.129241+0000","last_became_active":"2024-09-20T20:34:26.682699+0000","last_became_peered":"2024-09-20T20:34:26.682699+0000","last_unstale":"2024-09-20T20:34:32.653886+0000","last_undegraded":"2024-09-20T20:34:26.676325+0000","last_fullsized":"2024-09-20T20:34:26.675708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1059,"reported_epoch":84,"state":"peering","last_fresh":"2024-09-20T20:34:32.432085+0000","last_change":"2024-09-20T20:34:32.651505+0000","last_active":"2024-09-20T20:34:32.651505+0000","last_peered":"2024-09-20T20:34:32.432085+0000","last_clean":"2024-09-20T20:31:51.173602+0000","last_became_active":"2024-09-20T20:34:18.918961+0000","last_became_peered":"2024-09-20T20:34:18.918961+0000","last_unstale":"2024-09-20T20:34:32.432085+0000","last_undegraded":"2024-09-20T20:34:32.432085+0000","last_fullsized":"2024-09-20T20:34:18.655037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":808,"reported_epoch":85,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-20T20:34:32.733076+0000","last_change":"2024-09-20T20:34:32.436931+0000","last_active":"2024-09-20T20:34:32.733076+0000","last_peered":"2024-09-20T20:34:32.733076+0000","last_clean":"2024-09-20T20:31:51.134626+0000","last_became_active":"2024-09-20T20:34:18.923834+0000","last_became_peered":"2024-09-20T20:34:18.923834+0000","last_unstale":"2024-09-20T20:34:32.733076+0000","last_undegraded":"2024-09-20T20:34:32.733076+0000","last_fullsized":"2024-09-20T20:34:18.679822+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":915,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653232+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:32.653232+0000","last_peered":"2024-09-20T20:34:32.653232+0000","last_clean":"2024-09-20T20:34:32.653232+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:32.653232+0000","last_undegraded":"2024-09-20T20:34:32.653232+0000","last_fullsized":"2024-09-20T20:34:32.653232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648467+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:32.648467+0000","last_peered":"2024-09-20T20:34:32.648467+0000","last_clean":"2024-09-20T20:34:32.648467+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:32.648467+0000","last_undegraded":"2024-09-20T20:34:32.648467+0000","last_fullsized":"2024-09-20T20:34:32.648467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":614,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.653425+0000","last_change":"2024-09-20T20:34:26.704756+0000","last_active":"2024-09-20T20:34:32.653425+0000","last_peered":"2024-09-20T20:34:32.653425+0000","last_clean":"2024-09-20T20:31:51.179186+0000","last_became_active":"2024-09-20T20:34:26.700667+0000","last_became_peered":"2024-09-20T20:34:26.700667+0000","last_unstale":"2024-09-20T20:34:32.653425+0000","last_undegraded":"2024-09-20T20:34:26.682148+0000","last_fullsized":"2024-09-20T20:34:26.679653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647339+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:32.647339+0000","last_peered":"2024-09-20T20:34:32.647339+0000","last_clean":"2024-09-20T20:34:32.647339+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:32.647339+0000","last_undegraded":"2024-09-20T20:34:32.647339+0000","last_fullsized":"2024-09-20T20:34:32.647339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":591,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647580+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:32.647580+0000","last_peered":"2024-09-20T20:34:32.647580+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:32.647580+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":477,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653227+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:32.653227+0000","last_peered":"2024-09-20T20:34:32.653227+0000","last_clean":"2024-09-20T20:34:32.653227+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:32.653227+0000","last_undegraded":"2024-09-20T20:34:32.653227+0000","last_fullsized":"2024-09-20T20:34:32.653227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":543,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622445+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:30.622445+0000","last_peered":"2024-09-20T20:34:30.622445+0000","last_clean":"2024-09-20T20:34:30.622445+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:30.622445+0000","last_undegraded":"2024-09-20T20:34:30.622445+0000","last_fullsized":"2024-09-20T20:34:30.622445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.654666+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:32.654666+0000","last_peered":"2024-09-20T20:34:32.654666+0000","last_clean":"2024-09-20T20:34:32.654666+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:32.654666+0000","last_undegraded":"2024-09-20T20:34:32.654666+0000","last_fullsized":"2024-09-20T20:34:32.654666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648311+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:32.648311+0000","last_peered":"2024-09-20T20:34:32.648311+0000","last_clean":"2024-09-20T20:34:32.648311+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:32.648311+0000","last_undegraded":"2024-09-20T20:34:32.648311+0000","last_fullsized":"2024-09-20T20:34:32.648311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":633,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.651455+0000","last_change":"2024-09-20T20:34:18.937745+0000","last_active":"2024-09-20T20:34:32.651455+0000","last_peered":"2024-09-20T20:34:32.651455+0000","last_clean":"2024-09-20T20:31:51.202663+0000","last_became_active":"2024-09-20T20:34:18.931378+0000","last_became_peered":"2024-09-20T20:34:18.931378+0000","last_unstale":"2024-09-20T20:34:32.651455+0000","last_undegraded":"2024-09-20T20:34:18.686815+0000","last_fullsized":"2024-09-20T20:34:18.675123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651869+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:32.651869+0000","last_peered":"2024-09-20T20:34:32.651869+0000","last_clean":"2024-09-20T20:34:32.651869+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:32.651869+0000","last_undegraded":"2024-09-20T20:34:32.651869+0000","last_fullsized":"2024-09-20T20:34:32.651869+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":622,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.650323+0000","last_change":"2024-09-20T20:34:19.225616+0000","last_active":"2024-09-20T20:34:32.650323+0000","last_peered":"2024-09-20T20:34:32.650323+0000","last_clean":"2024-09-20T20:31:51.195638+0000","last_became_active":"2024-09-20T20:34:18.889264+0000","last_became_peered":"2024-09-20T20:34:18.889264+0000","last_unstale":"2024-09-20T20:34:32.650323+0000","last_undegraded":"2024-09-20T20:34:19.225278+0000","last_fullsized":"2024-09-20T20:34:18.651936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621287+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:30.621287+0000","last_peered":"2024-09-20T20:34:30.621287+0000","last_clean":"2024-09-20T20:34:30.621287+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:30.621287+0000","last_undegraded":"2024-09-20T20:34:30.621287+0000","last_fullsized":"2024-09-20T20:34:30.621287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624058+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:30.624058+0000","last_peered":"2024-09-20T20:34:30.624058+0000","last_clean":"2024-09-20T20:34:30.624058+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:30.624058+0000","last_undegraded":"2024-09-20T20:34:30.624058+0000","last_fullsized":"2024-09-20T20:34:30.624058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":888,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651443+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:32.651443+0000","last_peered":"2024-09-20T20:34:32.651443+0000","last_clean":"2024-09-20T20:34:32.651443+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:32.651443+0000","last_undegraded":"2024-09-20T20:34:32.651443+0000","last_fullsized":"2024-09-20T20:34:32.651443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":419,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653780+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:32.653780+0000","last_peered":"2024-09-20T20:34:32.653780+0000","last_clean":"2024-09-20T20:34:32.653780+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:32.653780+0000","last_undegraded":"2024-09-20T20:34:32.653780+0000","last_fullsized":"2024-09-20T20:34:32.653780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651591+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:32.651591+0000","last_peered":"2024-09-20T20:34:32.651591+0000","last_clean":"2024-09-20T20:34:32.651591+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:32.651591+0000","last_undegraded":"2024-09-20T20:34:32.651591+0000","last_fullsized":"2024-09-20T20:34:32.651591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622852+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:30.622852+0000","last_peered":"2024-09-20T20:34:30.622852+0000","last_clean":"2024-09-20T20:34:30.622852+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:30.622852+0000","last_undegraded":"2024-09-20T20:34:30.622852+0000","last_fullsized":"2024-09-20T20:34:30.622852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":632,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:29.654101+0000","last_change":"2024-09-20T20:34:18.933836+0000","last_active":"2024-09-20T20:34:29.654101+0000","last_peered":"2024-09-20T20:34:29.654101+0000","last_clean":"2024-09-20T20:31:51.151645+0000","last_became_active":"2024-09-20T20:34:18.918599+0000","last_became_peered":"2024-09-20T20:34:18.918599+0000","last_unstale":"2024-09-20T20:34:29.654101+0000","last_undegraded":"2024-09-20T20:34:18.683120+0000","last_fullsized":"2024-09-20T20:34:18.671352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622815+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:30.622815+0000","last_peered":"2024-09-20T20:34:30.622815+0000","last_clean":"2024-09-20T20:34:30.622815+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:30.622815+0000","last_undegraded":"2024-09-20T20:34:30.622815+0000","last_fullsized":"2024-09-20T20:34:30.622815+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1054,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648760+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:32.648760+0000","last_peered":"2024-09-20T20:34:32.648760+0000","last_clean":"2024-09-20T20:34:32.648760+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:32.648760+0000","last_undegraded":"2024-09-20T20:34:32.648760+0000","last_fullsized":"2024-09-20T20:34:32.648760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":357,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649212+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:32.649212+0000","last_peered":"2024-09-20T20:34:32.649212+0000","last_clean":"2024-09-20T20:34:32.649212+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:32.649212+0000","last_undegraded":"2024-09-20T20:34:32.649212+0000","last_fullsized":"2024-09-20T20:34:32.649212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":583,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623708+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:30.623708+0000","last_peered":"2024-09-20T20:34:30.623708+0000","last_clean":"2024-09-20T20:34:30.623708+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:30.623708+0000","last_undegraded":"2024-09-20T20:34:30.623708+0000","last_fullsized":"2024-09-20T20:34:30.623708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623773+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:30.623773+0000","last_peered":"2024-09-20T20:34:30.623773+0000","last_clean":"2024-09-20T20:34:30.623773+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:30.623773+0000","last_undegraded":"2024-09-20T20:34:30.623773+0000","last_fullsized":"2024-09-20T20:34:30.623773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":587,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.655019+0000","last_change":"2024-09-20T20:34:18.935349+0000","last_active":"2024-09-20T20:34:32.655019+0000","last_peered":"2024-09-20T20:34:32.655019+0000","last_clean":"2024-09-20T20:31:51.164211+0000","last_became_active":"2024-09-20T20:34:18.928354+0000","last_became_peered":"2024-09-20T20:34:18.928354+0000","last_unstale":"2024-09-20T20:34:32.655019+0000","last_undegraded":"2024-09-20T20:34:18.680220+0000","last_fullsized":"2024-09-20T20:34:18.677289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651971+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:32.651971+0000","last_peered":"2024-09-20T20:34:32.651971+0000","last_clean":"2024-09-20T20:34:32.651971+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:32.651971+0000","last_undegraded":"2024-09-20T20:34:32.651971+0000","last_fullsized":"2024-09-20T20:34:32.651971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":581,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624092+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:30.624092+0000","last_peered":"2024-09-20T20:34:30.624092+0000","last_clean":"2024-09-20T20:34:30.624092+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:30.624092+0000","last_undegraded":"2024-09-20T20:34:30.624092+0000","last_fullsized":"2024-09-20T20:34:30.624092+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651712+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:32.651712+0000","last_peered":"2024-09-20T20:34:32.651712+0000","last_clean":"2024-09-20T20:34:32.651712+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:32.651712+0000","last_undegraded":"2024-09-20T20:34:32.651712+0000","last_fullsized":"2024-09-20T20:34:32.651712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650402+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:32.650402+0000","last_peered":"2024-09-20T20:34:32.650402+0000","last_clean":"2024-09-20T20:34:32.650402+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:32.650402+0000","last_undegraded":"2024-09-20T20:34:32.650402+0000","last_fullsized":"2024-09-20T20:34:32.650402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":329,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621007+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:30.621007+0000","last_peered":"2024-09-20T20:34:30.621007+0000","last_clean":"2024-09-20T20:34:30.621007+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:30.621007+0000","last_undegraded":"2024-09-20T20:34:30.621007+0000","last_fullsized":"2024-09-20T20:34:30.621007+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621847+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:30.621847+0000","last_peered":"2024-09-20T20:34:30.621847+0000","last_clean":"2024-09-20T20:34:30.621847+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:30.621847+0000","last_undegraded":"2024-09-20T20:34:30.621847+0000","last_fullsized":"2024-09-20T20:34:30.621847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":708,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649138+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:32.649138+0000","last_peered":"2024-09-20T20:34:32.649138+0000","last_clean":"2024-09-20T20:34:32.649138+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:32.649138+0000","last_undegraded":"2024-09-20T20:34:32.649138+0000","last_fullsized":"2024-09-20T20:34:32.649138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":595,"reported_epoch":82,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:29.658769+0000","last_change":"2024-09-20T20:34:18.934849+0000","last_active":"2024-09-20T20:34:29.658769+0000","last_peered":"2024-09-20T20:34:29.658769+0000","last_clean":"2024-09-20T20:31:51.170388+0000","last_became_active":"2024-09-20T20:34:18.917137+0000","last_became_peered":"2024-09-20T20:34:18.917137+0000","last_unstale":"2024-09-20T20:34:29.658769+0000","last_undegraded":"2024-09-20T20:34:18.675416+0000","last_fullsized":"2024-09-20T20:34:18.656310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621813+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:30.621813+0000","last_peered":"2024-09-20T20:34:30.621813+0000","last_clean":"2024-09-20T20:34:30.621813+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:30.621813+0000","last_undegraded":"2024-09-20T20:34:30.621813+0000","last_fullsized":"2024-09-20T20:34:30.621813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":352,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648304+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:32.648304+0000","last_peered":"2024-09-20T20:34:32.648304+0000","last_clean":"2024-09-20T20:34:32.648304+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:32.648304+0000","last_undegraded":"2024-09-20T20:34:32.648304+0000","last_fullsized":"2024-09-20T20:34:32.648304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653475+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:32.653475+0000","last_peered":"2024-09-20T20:34:32.653475+0000","last_clean":"2024-09-20T20:34:32.653475+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:32.653475+0000","last_undegraded":"2024-09-20T20:34:32.653475+0000","last_fullsized":"2024-09-20T20:34:32.653475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648607+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:32.648607+0000","last_peered":"2024-09-20T20:34:32.648607+0000","last_clean":"2024-09-20T20:34:32.648607+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:32.648607+0000","last_undegraded":"2024-09-20T20:34:32.648607+0000","last_fullsized":"2024-09-20T20:34:32.648607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":385,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651757+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:32.651757+0000","last_peered":"2024-09-20T20:34:32.651757+0000","last_clean":"2024-09-20T20:34:32.651757+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:32.651757+0000","last_undegraded":"2024-09-20T20:34:32.651757+0000","last_fullsized":"2024-09-20T20:34:32.651757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650691+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:32.650691+0000","last_peered":"2024-09-20T20:34:32.650691+0000","last_clean":"2024-09-20T20:34:32.650691+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:32.650691+0000","last_undegraded":"2024-09-20T20:34:32.650691+0000","last_fullsized":"2024-09-20T20:34:32.650691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.621515+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:30.621515+0000","last_peered":"2024-09-20T20:34:30.621515+0000","last_clean":"2024-09-20T20:34:30.621515+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:30.621515+0000","last_undegraded":"2024-09-20T20:34:30.621515+0000","last_fullsized":"2024-09-20T20:34:30.621515+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622125+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:30.622125+0000","last_peered":"2024-09-20T20:34:30.622125+0000","last_clean":"2024-09-20T20:34:30.622125+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:30.622125+0000","last_undegraded":"2024-09-20T20:34:30.622125+0000","last_fullsized":"2024-09-20T20:34:30.622125+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":587,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649271+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:32.649271+0000","last_peered":"2024-09-20T20:34:32.649271+0000","last_clean":"2024-09-20T20:34:32.649271+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:32.649271+0000","last_undegraded":"2024-09-20T20:34:32.649271+0000","last_fullsized":"2024-09-20T20:34:32.649271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":303,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622332+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:30.622332+0000","last_peered":"2024-09-20T20:34:30.622332+0000","last_clean":"2024-09-20T20:34:30.622332+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:30.622332+0000","last_undegraded":"2024-09-20T20:34:30.622332+0000","last_fullsized":"2024-09-20T20:34:30.622332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649730+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:32.649730+0000","last_peered":"2024-09-20T20:34:32.649730+0000","last_clean":"2024-09-20T20:34:32.649730+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:32.649730+0000","last_undegraded":"2024-09-20T20:34:32.649730+0000","last_fullsized":"2024-09-20T20:34:32.649730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":822,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.665825+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:32.665825+0000","last_peered":"2024-09-20T20:34:32.665825+0000","last_clean":"2024-09-20T20:34:32.665825+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:32.665825+0000","last_undegraded":"2024-09-20T20:34:32.665825+0000","last_fullsized":"2024-09-20T20:34:32.665825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":204,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649283+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:32.649283+0000","last_peered":"2024-09-20T20:34:32.649283+0000","last_clean":"2024-09-20T20:34:32.649283+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:32.649283+0000","last_undegraded":"2024-09-20T20:34:32.649283+0000","last_fullsized":"2024-09-20T20:34:32.649283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655611+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:32.655611+0000","last_peered":"2024-09-20T20:34:32.655611+0000","last_clean":"2024-09-20T20:34:32.655611+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:32.655611+0000","last_undegraded":"2024-09-20T20:34:32.655611+0000","last_fullsized":"2024-09-20T20:34:32.655611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":878,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652665+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:32.652665+0000","last_peered":"2024-09-20T20:34:32.652665+0000","last_clean":"2024-09-20T20:34:32.652665+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:32.652665+0000","last_undegraded":"2024-09-20T20:34:32.652665+0000","last_fullsized":"2024-09-20T20:34:32.652665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651127+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:32.651127+0000","last_peered":"2024-09-20T20:34:32.651127+0000","last_clean":"2024-09-20T20:34:32.651127+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:32.651127+0000","last_undegraded":"2024-09-20T20:34:32.651127+0000","last_fullsized":"2024-09-20T20:34:32.651127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651965+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:32.651965+0000","last_peered":"2024-09-20T20:34:32.651965+0000","last_clean":"2024-09-20T20:34:32.651965+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:32.651965+0000","last_undegraded":"2024-09-20T20:34:32.651965+0000","last_fullsized":"2024-09-20T20:34:32.651965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":696,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.648533+0000","last_change":"2024-09-20T20:34:18.940279+0000","last_active":"2024-09-20T20:34:32.648533+0000","last_peered":"2024-09-20T20:34:32.648533+0000","last_clean":"2024-09-20T20:31:51.202703+0000","last_became_active":"2024-09-20T20:34:18.934354+0000","last_became_peered":"2024-09-20T20:34:18.934354+0000","last_unstale":"2024-09-20T20:34:32.648533+0000","last_undegraded":"2024-09-20T20:34:18.689916+0000","last_fullsized":"2024-09-20T20:34:18.683789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651809+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:32.651809+0000","last_peered":"2024-09-20T20:34:32.651809+0000","last_clean":"2024-09-20T20:34:32.651809+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:32.651809+0000","last_undegraded":"2024-09-20T20:34:32.651809+0000","last_fullsized":"2024-09-20T20:34:32.651809+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623459+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:30.623459+0000","last_peered":"2024-09-20T20:34:30.623459+0000","last_clean":"2024-09-20T20:34:30.623459+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:30.623459+0000","last_undegraded":"2024-09-20T20:34:30.623459+0000","last_fullsized":"2024-09-20T20:34:30.623459+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":916,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651638+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:32.651638+0000","last_peered":"2024-09-20T20:34:32.651638+0000","last_clean":"2024-09-20T20:34:32.651638+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:32.651638+0000","last_undegraded":"2024-09-20T20:34:32.651638+0000","last_fullsized":"2024-09-20T20:34:32.651638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.624128+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:30.624128+0000","last_peered":"2024-09-20T20:34:30.624128+0000","last_clean":"2024-09-20T20:34:30.624128+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:30.624128+0000","last_undegraded":"2024-09-20T20:34:30.624128+0000","last_fullsized":"2024-09-20T20:34:30.624128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622111+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:30.622111+0000","last_peered":"2024-09-20T20:34:30.622111+0000","last_clean":"2024-09-20T20:34:30.622111+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:30.622111+0000","last_undegraded":"2024-09-20T20:34:30.622111+0000","last_fullsized":"2024-09-20T20:34:30.622111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":570,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647711+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:32.647711+0000","last_peered":"2024-09-20T20:34:32.647711+0000","last_clean":"2024-09-20T20:34:32.647711+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:32.647711+0000","last_undegraded":"2024-09-20T20:34:32.647711+0000","last_fullsized":"2024-09-20T20:34:32.647711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655189+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:32.655189+0000","last_peered":"2024-09-20T20:34:32.655189+0000","last_clean":"2024-09-20T20:34:32.655189+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:32.655189+0000","last_undegraded":"2024-09-20T20:34:32.655189+0000","last_fullsized":"2024-09-20T20:34:32.655189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":248,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.623583+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:30.623583+0000","last_peered":"2024-09-20T20:34:30.623583+0000","last_clean":"2024-09-20T20:34:30.623583+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:30.623583+0000","last_undegraded":"2024-09-20T20:34:30.623583+0000","last_fullsized":"2024-09-20T20:34:30.623583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1067,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647760+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:32.647760+0000","last_peered":"2024-09-20T20:34:32.647760+0000","last_clean":"2024-09-20T20:34:32.647760+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:32.647760+0000","last_undegraded":"2024-09-20T20:34:32.647760+0000","last_fullsized":"2024-09-20T20:34:32.647760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":213,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650973+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:32.650973+0000","last_peered":"2024-09-20T20:34:32.650973+0000","last_clean":"2024-09-20T20:34:32.650973+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:32.650973+0000","last_undegraded":"2024-09-20T20:34:32.650973+0000","last_fullsized":"2024-09-20T20:34:32.650973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649013+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:32.649013+0000","last_peered":"2024-09-20T20:34:32.649013+0000","last_clean":"2024-09-20T20:34:32.649013+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:32.649013+0000","last_undegraded":"2024-09-20T20:34:32.649013+0000","last_fullsized":"2024-09-20T20:34:32.649013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":531,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.654243+0000","last_change":"2024-09-20T20:34:19.277789+0000","last_active":"2024-09-20T20:34:32.654243+0000","last_peered":"2024-09-20T20:34:32.654243+0000","last_clean":"2024-09-20T20:31:51.167971+0000","last_became_active":"2024-09-20T20:34:18.890488+0000","last_became_peered":"2024-09-20T20:34:18.890488+0000","last_unstale":"2024-09-20T20:34:32.654243+0000","last_undegraded":"2024-09-20T20:34:19.277313+0000","last_fullsized":"2024-09-20T20:34:18.667466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":144,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":846,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649914+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:32.649914+0000","last_peered":"2024-09-20T20:34:32.649914+0000","last_clean":"2024-09-20T20:34:32.649914+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:32.649914+0000","last_undegraded":"2024-09-20T20:34:32.649914+0000","last_fullsized":"2024-09-20T20:34:32.649914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":588,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.650360+0000","last_change":"2024-09-20T20:34:18.935766+0000","last_active":"2024-09-20T20:34:32.650360+0000","last_peered":"2024-09-20T20:34:32.650360+0000","last_clean":"2024-09-20T20:31:51.200271+0000","last_became_active":"2024-09-20T20:34:18.921689+0000","last_became_peered":"2024-09-20T20:34:18.921689+0000","last_unstale":"2024-09-20T20:34:32.650360+0000","last_undegraded":"2024-09-20T20:34:18.680964+0000","last_fullsized":"2024-09-20T20:34:18.663912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":344,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648117+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:32.648117+0000","last_peered":"2024-09-20T20:34:32.648117+0000","last_clean":"2024-09-20T20:34:32.648117+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:32.648117+0000","last_undegraded":"2024-09-20T20:34:32.648117+0000","last_fullsized":"2024-09-20T20:34:32.648117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":642,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.654307+0000","last_change":"2024-09-20T20:34:18.935605+0000","last_active":"2024-09-20T20:34:32.654307+0000","last_peered":"2024-09-20T20:34:32.654307+0000","last_clean":"2024-09-20T20:31:51.202419+0000","last_became_active":"2024-09-20T20:34:18.931023+0000","last_became_peered":"2024-09-20T20:34:18.931023+0000","last_unstale":"2024-09-20T20:34:32.654307+0000","last_undegraded":"2024-09-20T20:34:18.676532+0000","last_fullsized":"2024-09-20T20:34:18.670396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":148,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":306,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653591+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:32.653591+0000","last_peered":"2024-09-20T20:34:32.653591+0000","last_clean":"2024-09-20T20:34:32.653591+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:32.653591+0000","last_undegraded":"2024-09-20T20:34:32.653591+0000","last_fullsized":"2024-09-20T20:34:32.653591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652907+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:32.652907+0000","last_peered":"2024-09-20T20:34:32.652907+0000","last_clean":"2024-09-20T20:34:32.652907+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:32.652907+0000","last_undegraded":"2024-09-20T20:34:32.652907+0000","last_fullsized":"2024-09-20T20:34:32.652907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653048+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:32.653048+0000","last_peered":"2024-09-20T20:34:32.653048+0000","last_clean":"2024-09-20T20:34:32.653048+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:32.653048+0000","last_undegraded":"2024-09-20T20:34:32.653048+0000","last_fullsized":"2024-09-20T20:34:32.653048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":532,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-20T20:34:30.623753+0000","last_change":"2024-09-20T20:34:30.623753+0000","last_active":"2024-09-20T20:34:17.643461+0000","last_peered":"2024-09-20T20:34:15.792678+0000","last_clean":"2024-09-20T20:31:51.144496+0000","last_became_active":"2024-09-20T20:31:52.253537+0000","last_became_peered":"2024-09-20T20:31:52.253537+0000","last_unstale":"2024-09-20T20:34:30.623753+0000","last_undegraded":"2024-09-20T20:34:30.623753+0000","last_fullsized":"2024-09-20T20:34:30.623753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-20T20:34:30.622487+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:30.622487+0000","last_peered":"2024-09-20T20:34:30.622487+0000","last_clean":"2024-09-20T20:34:30.622487+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:30.622487+0000","last_undegraded":"2024-09-20T20:34:30.622487+0000","last_fullsized":"2024-09-20T20:34:30.622487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":590,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647865+0000","last_change":"2024-09-20T20:34:18.937123+0000","last_active":"2024-09-20T20:34:32.647865+0000","last_peered":"2024-09-20T20:34:32.647865+0000","last_clean":"2024-09-20T20:31:51.151591+0000","last_became_active":"2024-09-20T20:34:18.931120+0000","last_became_peered":"2024-09-20T20:34:18.931120+0000","last_unstale":"2024-09-20T20:34:32.647865+0000","last_undegraded":"2024-09-20T20:34:18.677324+0000","last_fullsized":"2024-09-20T20:34:18.663778+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":155,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":432,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655000+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:32.655000+0000","last_peered":"2024-09-20T20:34:32.655000+0000","last_clean":"2024-09-20T20:34:32.655000+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:32.655000+0000","last_undegraded":"2024-09-20T20:34:32.655000+0000","last_fullsized":"2024-09-20T20:34:32.655000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652162+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:32.652162+0000","last_peered":"2024-09-20T20:34:32.652162+0000","last_clean":"2024-09-20T20:34:32.652162+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:32.652162+0000","last_undegraded":"2024-09-20T20:34:32.652162+0000","last_fullsized":"2024-09-20T20:34:32.652162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":213,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651169+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:32.651169+0000","last_peered":"2024-09-20T20:34:32.651169+0000","last_clean":"2024-09-20T20:34:32.651169+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:32.651169+0000","last_undegraded":"2024-09-20T20:34:32.651169+0000","last_fullsized":"2024-09-20T20:34:32.651169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":604,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647417+0000","last_change":"2024-09-20T20:34:18.940010+0000","last_active":"2024-09-20T20:34:32.647417+0000","last_peered":"2024-09-20T20:34:32.647417+0000","last_clean":"2024-09-20T20:31:51.180364+0000","last_became_active":"2024-09-20T20:34:18.923020+0000","last_became_peered":"2024-09-20T20:34:18.923020+0000","last_unstale":"2024-09-20T20:34:32.647417+0000","last_undegraded":"2024-09-20T20:34:18.682966+0000","last_fullsized":"2024-09-20T20:34:18.666887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650690+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:32.650690+0000","last_peered":"2024-09-20T20:34:32.650690+0000","last_clean":"2024-09-20T20:34:32.650690+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:32.650690+0000","last_undegraded":"2024-09-20T20:34:32.650690+0000","last_fullsized":"2024-09-20T20:34:32.650690+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2971,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3318,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19582976,"data_stored":24909753,"data_compressed":2491357,"data_compressed_allocated":3584000,"data_compressed_original":16704652,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":109,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99212,"kb_used_data":27828,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272628,"statfs":{"total":96636764160,"available":96535171072,"internally_reserved":0,"allocated":28495872,"data_stored":81516174,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104244,"kb_used_data":28696,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267596,"statfs":{"total":96636764160,"available":96530018304,"internally_reserved":0,"allocated":29384704,"data_stored":85060401,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81936,"kb_used_data":44096,"kb_used_omap":165,"kb_used_meta":37658,"kb_avail":94289904,"statfs":{"total":96636764160,"available":96552861696,"internally_reserved":0,"allocated":45154304,"data_stored":116629364,"data_compressed":16500653,"data_compressed_allocated":20680704,"data_compressed_original":101057676,"omap_allocated":169794,"internal_metadata":38561982},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19582976,"data_stored":24909753,"data_compressed":2491357,"data_compressed_allocated":3584000,"data_compressed_original":16704652,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:37.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:38.302 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:38.318 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-20T20:34:37.721349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2317,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4217,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":196,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":272296,"kb_used_data":91676,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282843224,"statfs":{"total":289910292480,"available":289631461376,"internally_reserved":0,"allocated":93876224,"data_stored":272048927,"data_compressed":39129583,"data_compressed_allocated":50397184,"data_compressed_original":234760563,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-654,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":885,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001272"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653616+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:32.653616+0000","last_peered":"2024-09-20T20:34:32.653616+0000","last_clean":"2024-09-20T20:34:32.653616+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:32.653616+0000","last_undegraded":"2024-09-20T20:34:32.653616+0000","last_fullsized":"2024-09-20T20:34:32.653616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":649,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652690+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:32.652690+0000","last_peered":"2024-09-20T20:34:32.652690+0000","last_clean":"2024-09-20T20:34:32.652690+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:32.652690+0000","last_undegraded":"2024-09-20T20:34:32.652690+0000","last_fullsized":"2024-09-20T20:34:32.652690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.624916+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:35.624916+0000","last_peered":"2024-09-20T20:34:35.624916+0000","last_clean":"2024-09-20T20:34:35.624916+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:35.624916+0000","last_undegraded":"2024-09-20T20:34:35.624916+0000","last_fullsized":"2024-09-20T20:34:35.624916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":549,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622483+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:35.622483+0000","last_peered":"2024-09-20T20:34:35.622483+0000","last_clean":"2024-09-20T20:34:35.622483+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:35.622483+0000","last_undegraded":"2024-09-20T20:34:35.622483+0000","last_fullsized":"2024-09-20T20:34:35.622483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":499,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652954+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:32.652954+0000","last_peered":"2024-09-20T20:34:32.652954+0000","last_clean":"2024-09-20T20:34:32.652954+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:32.652954+0000","last_undegraded":"2024-09-20T20:34:32.652954+0000","last_fullsized":"2024-09-20T20:34:32.652954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":567,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623692+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:35.623692+0000","last_peered":"2024-09-20T20:34:35.623692+0000","last_clean":"2024-09-20T20:34:35.623692+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:35.623692+0000","last_undegraded":"2024-09-20T20:34:35.623692+0000","last_fullsized":"2024-09-20T20:34:35.623692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.619925+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:35.619925+0000","last_peered":"2024-09-20T20:34:35.619925+0000","last_clean":"2024-09-20T20:34:35.619925+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:35.619925+0000","last_undegraded":"2024-09-20T20:34:35.619925+0000","last_fullsized":"2024-09-20T20:34:35.619925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":606,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646917+0000","last_change":"2024-09-20T20:34:18.940543+0000","last_active":"2024-09-20T20:34:32.646917+0000","last_peered":"2024-09-20T20:34:32.646917+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:34:18.934342+0000","last_became_peered":"2024-09-20T20:34:18.934342+0000","last_unstale":"2024-09-20T20:34:32.646917+0000","last_undegraded":"2024-09-20T20:34:18.666832+0000","last_fullsized":"2024-09-20T20:34:18.649718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":139,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650009+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:32.650009+0000","last_peered":"2024-09-20T20:34:32.650009+0000","last_clean":"2024-09-20T20:34:32.650009+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:32.650009+0000","last_undegraded":"2024-09-20T20:34:32.650009+0000","last_fullsized":"2024-09-20T20:34:32.650009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":552,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.654179+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:32.654179+0000","last_peered":"2024-09-20T20:34:32.654179+0000","last_clean":"2024-09-20T20:34:32.654179+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:32.654179+0000","last_undegraded":"2024-09-20T20:34:32.654179+0000","last_fullsized":"2024-09-20T20:34:32.654179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":539,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.624712+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:35.624712+0000","last_peered":"2024-09-20T20:34:35.624712+0000","last_clean":"2024-09-20T20:34:35.624712+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:35.624712+0000","last_undegraded":"2024-09-20T20:34:35.624712+0000","last_fullsized":"2024-09-20T20:34:35.624712+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":797,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652592+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:32.652592+0000","last_peered":"2024-09-20T20:34:32.652592+0000","last_clean":"2024-09-20T20:34:32.652592+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:32.652592+0000","last_undegraded":"2024-09-20T20:34:32.652592+0000","last_fullsized":"2024-09-20T20:34:32.652592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":519,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652176+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:32.652176+0000","last_peered":"2024-09-20T20:34:32.652176+0000","last_clean":"2024-09-20T20:34:32.652176+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:32.652176+0000","last_undegraded":"2024-09-20T20:34:32.652176+0000","last_fullsized":"2024-09-20T20:34:32.652176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":589,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623433+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:35.623433+0000","last_peered":"2024-09-20T20:34:35.623433+0000","last_clean":"2024-09-20T20:34:35.623433+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:35.623433+0000","last_undegraded":"2024-09-20T20:34:35.623433+0000","last_fullsized":"2024-09-20T20:34:35.623433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":684,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621111+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:35.621111+0000","last_peered":"2024-09-20T20:34:35.621111+0000","last_clean":"2024-09-20T20:34:35.621111+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:35.621111+0000","last_undegraded":"2024-09-20T20:34:35.621111+0000","last_fullsized":"2024-09-20T20:34:35.621111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":631,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646923+0000","last_change":"2024-09-20T20:34:18.939734+0000","last_active":"2024-09-20T20:34:32.646923+0000","last_peered":"2024-09-20T20:34:32.646923+0000","last_clean":"2024-09-20T20:31:51.161495+0000","last_became_active":"2024-09-20T20:34:18.920486+0000","last_became_peered":"2024-09-20T20:34:18.920486+0000","last_unstale":"2024-09-20T20:34:32.646923+0000","last_undegraded":"2024-09-20T20:34:18.665789+0000","last_fullsized":"2024-09-20T20:34:18.649684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651003+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:32.651003+0000","last_peered":"2024-09-20T20:34:32.651003+0000","last_clean":"2024-09-20T20:34:32.651003+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:32.651003+0000","last_undegraded":"2024-09-20T20:34:32.651003+0000","last_fullsized":"2024-09-20T20:34:32.651003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":612,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653017+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:32.653017+0000","last_peered":"2024-09-20T20:34:32.653017+0000","last_clean":"2024-09-20T20:34:32.653017+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:32.653017+0000","last_undegraded":"2024-09-20T20:34:32.653017+0000","last_fullsized":"2024-09-20T20:34:32.653017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652676+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:32.652676+0000","last_peered":"2024-09-20T20:34:32.652676+0000","last_clean":"2024-09-20T20:34:32.652676+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:32.652676+0000","last_undegraded":"2024-09-20T20:34:32.652676+0000","last_fullsized":"2024-09-20T20:34:32.652676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":601,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623238+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:35.623238+0000","last_peered":"2024-09-20T20:34:35.623238+0000","last_clean":"2024-09-20T20:34:35.623238+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:35.623238+0000","last_undegraded":"2024-09-20T20:34:35.623238+0000","last_fullsized":"2024-09-20T20:34:35.623238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":563,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621810+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:35.621810+0000","last_peered":"2024-09-20T20:34:35.621810+0000","last_clean":"2024-09-20T20:34:35.621810+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:35.621810+0000","last_undegraded":"2024-09-20T20:34:35.621810+0000","last_fullsized":"2024-09-20T20:34:35.621810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":603,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.651981+0000","last_change":"2024-09-20T20:34:26.701111+0000","last_active":"2024-09-20T20:34:32.651981+0000","last_peered":"2024-09-20T20:34:32.651981+0000","last_clean":"2024-09-20T20:31:51.184225+0000","last_became_active":"2024-09-20T20:34:26.683873+0000","last_became_peered":"2024-09-20T20:34:26.683873+0000","last_unstale":"2024-09-20T20:34:32.651981+0000","last_undegraded":"2024-09-20T20:34:26.677758+0000","last_fullsized":"2024-09-20T20:34:26.677143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":661,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647212+0000","last_change":"2024-09-20T20:34:18.936170+0000","last_active":"2024-09-20T20:34:32.647212+0000","last_peered":"2024-09-20T20:34:32.647212+0000","last_clean":"2024-09-20T20:31:51.202971+0000","last_became_active":"2024-09-20T20:34:18.927334+0000","last_became_peered":"2024-09-20T20:34:18.927334+0000","last_unstale":"2024-09-20T20:34:32.647212+0000","last_undegraded":"2024-09-20T20:34:18.663132+0000","last_fullsized":"2024-09-20T20:34:18.649746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":674,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651417+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:32.651417+0000","last_peered":"2024-09-20T20:34:32.651417+0000","last_clean":"2024-09-20T20:34:32.651417+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:32.651417+0000","last_undegraded":"2024-09-20T20:34:32.651417+0000","last_fullsized":"2024-09-20T20:34:32.651417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":550,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.653886+0000","last_change":"2024-09-20T20:34:26.691471+0000","last_active":"2024-09-20T20:34:32.653886+0000","last_peered":"2024-09-20T20:34:32.653886+0000","last_clean":"2024-09-20T20:31:51.129241+0000","last_became_active":"2024-09-20T20:34:26.682699+0000","last_became_peered":"2024-09-20T20:34:26.682699+0000","last_unstale":"2024-09-20T20:34:32.653886+0000","last_undegraded":"2024-09-20T20:34:26.676325+0000","last_fullsized":"2024-09-20T20:34:26.675708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1059,"reported_epoch":84,"state":"peering","last_fresh":"2024-09-20T20:34:32.432085+0000","last_change":"2024-09-20T20:34:32.651505+0000","last_active":"2024-09-20T20:34:32.651505+0000","last_peered":"2024-09-20T20:34:32.432085+0000","last_clean":"2024-09-20T20:31:51.173602+0000","last_became_active":"2024-09-20T20:34:18.918961+0000","last_became_peered":"2024-09-20T20:34:18.918961+0000","last_unstale":"2024-09-20T20:34:32.432085+0000","last_undegraded":"2024-09-20T20:34:32.432085+0000","last_fullsized":"2024-09-20T20:34:18.655037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":614,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.624453+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:35.624453+0000","last_peered":"2024-09-20T20:34:35.624453+0000","last_clean":"2024-09-20T20:34:35.624453+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:35.624453+0000","last_undegraded":"2024-09-20T20:34:35.624453+0000","last_fullsized":"2024-09-20T20:34:35.624453+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":915,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653232+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:32.653232+0000","last_peered":"2024-09-20T20:34:32.653232+0000","last_clean":"2024-09-20T20:34:32.653232+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:32.653232+0000","last_undegraded":"2024-09-20T20:34:32.653232+0000","last_fullsized":"2024-09-20T20:34:32.653232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648467+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:32.648467+0000","last_peered":"2024-09-20T20:34:32.648467+0000","last_clean":"2024-09-20T20:34:32.648467+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:32.648467+0000","last_undegraded":"2024-09-20T20:34:32.648467+0000","last_fullsized":"2024-09-20T20:34:32.648467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":614,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.653425+0000","last_change":"2024-09-20T20:34:26.704756+0000","last_active":"2024-09-20T20:34:32.653425+0000","last_peered":"2024-09-20T20:34:32.653425+0000","last_clean":"2024-09-20T20:31:51.179186+0000","last_became_active":"2024-09-20T20:34:26.700667+0000","last_became_peered":"2024-09-20T20:34:26.700667+0000","last_unstale":"2024-09-20T20:34:32.653425+0000","last_undegraded":"2024-09-20T20:34:26.682148+0000","last_fullsized":"2024-09-20T20:34:26.679653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647339+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:32.647339+0000","last_peered":"2024-09-20T20:34:32.647339+0000","last_clean":"2024-09-20T20:34:32.647339+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:32.647339+0000","last_undegraded":"2024-09-20T20:34:32.647339+0000","last_fullsized":"2024-09-20T20:34:32.647339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":591,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647580+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:32.647580+0000","last_peered":"2024-09-20T20:34:32.647580+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:32.647580+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":477,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653227+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:32.653227+0000","last_peered":"2024-09-20T20:34:32.653227+0000","last_clean":"2024-09-20T20:34:32.653227+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:32.653227+0000","last_undegraded":"2024-09-20T20:34:32.653227+0000","last_fullsized":"2024-09-20T20:34:32.653227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":553,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621081+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:35.621081+0000","last_peered":"2024-09-20T20:34:35.621081+0000","last_clean":"2024-09-20T20:34:35.621081+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:35.621081+0000","last_undegraded":"2024-09-20T20:34:35.621081+0000","last_fullsized":"2024-09-20T20:34:35.621081+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.654666+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:32.654666+0000","last_peered":"2024-09-20T20:34:32.654666+0000","last_clean":"2024-09-20T20:34:32.654666+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:32.654666+0000","last_undegraded":"2024-09-20T20:34:32.654666+0000","last_fullsized":"2024-09-20T20:34:32.654666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648311+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:32.648311+0000","last_peered":"2024-09-20T20:34:32.648311+0000","last_clean":"2024-09-20T20:34:32.648311+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:32.648311+0000","last_undegraded":"2024-09-20T20:34:32.648311+0000","last_fullsized":"2024-09-20T20:34:32.648311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":633,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.651455+0000","last_change":"2024-09-20T20:34:18.937745+0000","last_active":"2024-09-20T20:34:32.651455+0000","last_peered":"2024-09-20T20:34:32.651455+0000","last_clean":"2024-09-20T20:31:51.202663+0000","last_became_active":"2024-09-20T20:34:18.931378+0000","last_became_peered":"2024-09-20T20:34:18.931378+0000","last_unstale":"2024-09-20T20:34:32.651455+0000","last_undegraded":"2024-09-20T20:34:18.686815+0000","last_fullsized":"2024-09-20T20:34:18.675123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651869+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:32.651869+0000","last_peered":"2024-09-20T20:34:32.651869+0000","last_clean":"2024-09-20T20:34:32.651869+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:32.651869+0000","last_undegraded":"2024-09-20T20:34:32.651869+0000","last_fullsized":"2024-09-20T20:34:32.651869+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":622,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.650323+0000","last_change":"2024-09-20T20:34:19.225616+0000","last_active":"2024-09-20T20:34:32.650323+0000","last_peered":"2024-09-20T20:34:32.650323+0000","last_clean":"2024-09-20T20:31:51.195638+0000","last_became_active":"2024-09-20T20:34:18.889264+0000","last_became_peered":"2024-09-20T20:34:18.889264+0000","last_unstale":"2024-09-20T20:34:32.650323+0000","last_undegraded":"2024-09-20T20:34:19.225278+0000","last_fullsized":"2024-09-20T20:34:18.651936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620025+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:35.620025+0000","last_peered":"2024-09-20T20:34:35.620025+0000","last_clean":"2024-09-20T20:34:35.620025+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:35.620025+0000","last_undegraded":"2024-09-20T20:34:35.620025+0000","last_fullsized":"2024-09-20T20:34:35.620025+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":203,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622172+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:35.622172+0000","last_peered":"2024-09-20T20:34:35.622172+0000","last_clean":"2024-09-20T20:34:35.622172+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:35.622172+0000","last_undegraded":"2024-09-20T20:34:35.622172+0000","last_fullsized":"2024-09-20T20:34:35.622172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":888,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651443+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:32.651443+0000","last_peered":"2024-09-20T20:34:32.651443+0000","last_clean":"2024-09-20T20:34:32.651443+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:32.651443+0000","last_undegraded":"2024-09-20T20:34:32.651443+0000","last_fullsized":"2024-09-20T20:34:32.651443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":419,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653780+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:32.653780+0000","last_peered":"2024-09-20T20:34:32.653780+0000","last_clean":"2024-09-20T20:34:32.653780+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:32.653780+0000","last_undegraded":"2024-09-20T20:34:32.653780+0000","last_fullsized":"2024-09-20T20:34:32.653780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651591+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:32.651591+0000","last_peered":"2024-09-20T20:34:32.651591+0000","last_clean":"2024-09-20T20:34:32.651591+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:32.651591+0000","last_undegraded":"2024-09-20T20:34:32.651591+0000","last_fullsized":"2024-09-20T20:34:32.651591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":555,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623921+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:35.623921+0000","last_peered":"2024-09-20T20:34:35.623921+0000","last_clean":"2024-09-20T20:34:35.623921+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:35.623921+0000","last_undegraded":"2024-09-20T20:34:35.623921+0000","last_fullsized":"2024-09-20T20:34:35.623921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":621,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623956+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:35.623956+0000","last_peered":"2024-09-20T20:34:35.623956+0000","last_clean":"2024-09-20T20:34:35.623956+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:35.623956+0000","last_undegraded":"2024-09-20T20:34:35.623956+0000","last_fullsized":"2024-09-20T20:34:35.623956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622774+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:35.622774+0000","last_peered":"2024-09-20T20:34:35.622774+0000","last_clean":"2024-09-20T20:34:35.622774+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:35.622774+0000","last_undegraded":"2024-09-20T20:34:35.622774+0000","last_fullsized":"2024-09-20T20:34:35.622774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1054,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648760+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:32.648760+0000","last_peered":"2024-09-20T20:34:32.648760+0000","last_clean":"2024-09-20T20:34:32.648760+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:32.648760+0000","last_undegraded":"2024-09-20T20:34:32.648760+0000","last_fullsized":"2024-09-20T20:34:32.648760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":357,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649212+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:32.649212+0000","last_peered":"2024-09-20T20:34:32.649212+0000","last_clean":"2024-09-20T20:34:32.649212+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:32.649212+0000","last_undegraded":"2024-09-20T20:34:32.649212+0000","last_fullsized":"2024-09-20T20:34:32.649212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":593,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623664+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:35.623664+0000","last_peered":"2024-09-20T20:34:35.623664+0000","last_clean":"2024-09-20T20:34:35.623664+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:35.623664+0000","last_undegraded":"2024-09-20T20:34:35.623664+0000","last_fullsized":"2024-09-20T20:34:35.623664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":182,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620801+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:35.620801+0000","last_peered":"2024-09-20T20:34:35.620801+0000","last_clean":"2024-09-20T20:34:35.620801+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:35.620801+0000","last_undegraded":"2024-09-20T20:34:35.620801+0000","last_fullsized":"2024-09-20T20:34:35.620801+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":564,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.633591+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:35.633591+0000","last_peered":"2024-09-20T20:34:35.633591+0000","last_clean":"2024-09-20T20:34:35.633591+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:35.633591+0000","last_undegraded":"2024-09-20T20:34:35.633591+0000","last_fullsized":"2024-09-20T20:34:35.633591+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651971+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:32.651971+0000","last_peered":"2024-09-20T20:34:32.651971+0000","last_clean":"2024-09-20T20:34:32.651971+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:32.651971+0000","last_undegraded":"2024-09-20T20:34:32.651971+0000","last_fullsized":"2024-09-20T20:34:32.651971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":591,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622690+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:35.622690+0000","last_peered":"2024-09-20T20:34:35.622690+0000","last_clean":"2024-09-20T20:34:35.622690+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:35.622690+0000","last_undegraded":"2024-09-20T20:34:35.622690+0000","last_fullsized":"2024-09-20T20:34:35.622690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651712+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:32.651712+0000","last_peered":"2024-09-20T20:34:32.651712+0000","last_clean":"2024-09-20T20:34:32.651712+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:32.651712+0000","last_undegraded":"2024-09-20T20:34:32.651712+0000","last_fullsized":"2024-09-20T20:34:32.651712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650402+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:32.650402+0000","last_peered":"2024-09-20T20:34:32.650402+0000","last_clean":"2024-09-20T20:34:32.650402+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:32.650402+0000","last_undegraded":"2024-09-20T20:34:32.650402+0000","last_fullsized":"2024-09-20T20:34:32.650402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":339,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.619808+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:35.619808+0000","last_peered":"2024-09-20T20:34:35.619808+0000","last_clean":"2024-09-20T20:34:35.619808+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:35.619808+0000","last_undegraded":"2024-09-20T20:34:35.619808+0000","last_fullsized":"2024-09-20T20:34:35.619808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":79,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620777+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:35.620777+0000","last_peered":"2024-09-20T20:34:35.620777+0000","last_clean":"2024-09-20T20:34:35.620777+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:35.620777+0000","last_undegraded":"2024-09-20T20:34:35.620777+0000","last_fullsized":"2024-09-20T20:34:35.620777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":708,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649138+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:32.649138+0000","last_peered":"2024-09-20T20:34:32.649138+0000","last_clean":"2024-09-20T20:34:32.649138+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:32.649138+0000","last_undegraded":"2024-09-20T20:34:32.649138+0000","last_fullsized":"2024-09-20T20:34:32.649138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.624199+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:35.624199+0000","last_peered":"2024-09-20T20:34:35.624199+0000","last_clean":"2024-09-20T20:34:35.624199+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:35.624199+0000","last_undegraded":"2024-09-20T20:34:35.624199+0000","last_fullsized":"2024-09-20T20:34:35.624199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620499+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:35.620499+0000","last_peered":"2024-09-20T20:34:35.620499+0000","last_clean":"2024-09-20T20:34:35.620499+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:35.620499+0000","last_undegraded":"2024-09-20T20:34:35.620499+0000","last_fullsized":"2024-09-20T20:34:35.620499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":352,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648304+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:32.648304+0000","last_peered":"2024-09-20T20:34:32.648304+0000","last_clean":"2024-09-20T20:34:32.648304+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:32.648304+0000","last_undegraded":"2024-09-20T20:34:32.648304+0000","last_fullsized":"2024-09-20T20:34:32.648304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653475+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:32.653475+0000","last_peered":"2024-09-20T20:34:32.653475+0000","last_clean":"2024-09-20T20:34:32.653475+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:32.653475+0000","last_undegraded":"2024-09-20T20:34:32.653475+0000","last_fullsized":"2024-09-20T20:34:32.653475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648607+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:32.648607+0000","last_peered":"2024-09-20T20:34:32.648607+0000","last_clean":"2024-09-20T20:34:32.648607+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:32.648607+0000","last_undegraded":"2024-09-20T20:34:32.648607+0000","last_fullsized":"2024-09-20T20:34:32.648607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":385,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651757+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:32.651757+0000","last_peered":"2024-09-20T20:34:32.651757+0000","last_clean":"2024-09-20T20:34:32.651757+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:32.651757+0000","last_undegraded":"2024-09-20T20:34:32.651757+0000","last_fullsized":"2024-09-20T20:34:32.651757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650691+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:32.650691+0000","last_peered":"2024-09-20T20:34:32.650691+0000","last_clean":"2024-09-20T20:34:32.650691+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:32.650691+0000","last_undegraded":"2024-09-20T20:34:32.650691+0000","last_fullsized":"2024-09-20T20:34:32.650691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":80,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620974+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:35.620974+0000","last_peered":"2024-09-20T20:34:35.620974+0000","last_clean":"2024-09-20T20:34:35.620974+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:35.620974+0000","last_undegraded":"2024-09-20T20:34:35.620974+0000","last_fullsized":"2024-09-20T20:34:35.620974+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620951+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:35.620951+0000","last_peered":"2024-09-20T20:34:35.620951+0000","last_clean":"2024-09-20T20:34:35.620951+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:35.620951+0000","last_undegraded":"2024-09-20T20:34:35.620951+0000","last_fullsized":"2024-09-20T20:34:35.620951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":587,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649271+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:32.649271+0000","last_peered":"2024-09-20T20:34:32.649271+0000","last_clean":"2024-09-20T20:34:32.649271+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:32.649271+0000","last_undegraded":"2024-09-20T20:34:32.649271+0000","last_fullsized":"2024-09-20T20:34:32.649271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":313,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621396+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:35.621396+0000","last_peered":"2024-09-20T20:34:35.621396+0000","last_clean":"2024-09-20T20:34:35.621396+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:35.621396+0000","last_undegraded":"2024-09-20T20:34:35.621396+0000","last_fullsized":"2024-09-20T20:34:35.621396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649730+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:32.649730+0000","last_peered":"2024-09-20T20:34:32.649730+0000","last_clean":"2024-09-20T20:34:32.649730+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:32.649730+0000","last_undegraded":"2024-09-20T20:34:32.649730+0000","last_fullsized":"2024-09-20T20:34:32.649730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":822,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.665825+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:32.665825+0000","last_peered":"2024-09-20T20:34:32.665825+0000","last_clean":"2024-09-20T20:34:32.665825+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:32.665825+0000","last_undegraded":"2024-09-20T20:34:32.665825+0000","last_fullsized":"2024-09-20T20:34:32.665825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":204,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649283+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:32.649283+0000","last_peered":"2024-09-20T20:34:32.649283+0000","last_clean":"2024-09-20T20:34:32.649283+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:32.649283+0000","last_undegraded":"2024-09-20T20:34:32.649283+0000","last_fullsized":"2024-09-20T20:34:32.649283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655611+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:32.655611+0000","last_peered":"2024-09-20T20:34:32.655611+0000","last_clean":"2024-09-20T20:34:32.655611+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:32.655611+0000","last_undegraded":"2024-09-20T20:34:32.655611+0000","last_fullsized":"2024-09-20T20:34:32.655611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":878,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652665+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:32.652665+0000","last_peered":"2024-09-20T20:34:32.652665+0000","last_clean":"2024-09-20T20:34:32.652665+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:32.652665+0000","last_undegraded":"2024-09-20T20:34:32.652665+0000","last_fullsized":"2024-09-20T20:34:32.652665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651127+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:32.651127+0000","last_peered":"2024-09-20T20:34:32.651127+0000","last_clean":"2024-09-20T20:34:32.651127+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:32.651127+0000","last_undegraded":"2024-09-20T20:34:32.651127+0000","last_fullsized":"2024-09-20T20:34:32.651127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651965+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:32.651965+0000","last_peered":"2024-09-20T20:34:32.651965+0000","last_clean":"2024-09-20T20:34:32.651965+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:32.651965+0000","last_undegraded":"2024-09-20T20:34:32.651965+0000","last_fullsized":"2024-09-20T20:34:32.651965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":696,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.648533+0000","last_change":"2024-09-20T20:34:18.940279+0000","last_active":"2024-09-20T20:34:32.648533+0000","last_peered":"2024-09-20T20:34:32.648533+0000","last_clean":"2024-09-20T20:31:51.202703+0000","last_became_active":"2024-09-20T20:34:18.934354+0000","last_became_peered":"2024-09-20T20:34:18.934354+0000","last_unstale":"2024-09-20T20:34:32.648533+0000","last_undegraded":"2024-09-20T20:34:18.689916+0000","last_fullsized":"2024-09-20T20:34:18.683789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651809+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:32.651809+0000","last_peered":"2024-09-20T20:34:32.651809+0000","last_clean":"2024-09-20T20:34:32.651809+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:32.651809+0000","last_undegraded":"2024-09-20T20:34:32.651809+0000","last_fullsized":"2024-09-20T20:34:32.651809+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621692+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:35.621692+0000","last_peered":"2024-09-20T20:34:35.621692+0000","last_clean":"2024-09-20T20:34:35.621692+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:35.621692+0000","last_undegraded":"2024-09-20T20:34:35.621692+0000","last_fullsized":"2024-09-20T20:34:35.621692+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":916,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651638+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:32.651638+0000","last_peered":"2024-09-20T20:34:32.651638+0000","last_clean":"2024-09-20T20:34:32.651638+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:32.651638+0000","last_undegraded":"2024-09-20T20:34:32.651638+0000","last_fullsized":"2024-09-20T20:34:32.651638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621448+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:35.621448+0000","last_peered":"2024-09-20T20:34:35.621448+0000","last_clean":"2024-09-20T20:34:35.621448+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:35.621448+0000","last_undegraded":"2024-09-20T20:34:35.621448+0000","last_fullsized":"2024-09-20T20:34:35.621448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":423,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621845+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:35.621845+0000","last_peered":"2024-09-20T20:34:35.621845+0000","last_clean":"2024-09-20T20:34:35.621845+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:35.621845+0000","last_undegraded":"2024-09-20T20:34:35.621845+0000","last_fullsized":"2024-09-20T20:34:35.621845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":570,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647711+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:32.647711+0000","last_peered":"2024-09-20T20:34:32.647711+0000","last_clean":"2024-09-20T20:34:32.647711+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:32.647711+0000","last_undegraded":"2024-09-20T20:34:32.647711+0000","last_fullsized":"2024-09-20T20:34:32.647711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":248,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655189+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:32.655189+0000","last_peered":"2024-09-20T20:34:32.655189+0000","last_clean":"2024-09-20T20:34:32.655189+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:32.655189+0000","last_undegraded":"2024-09-20T20:34:32.655189+0000","last_fullsized":"2024-09-20T20:34:32.655189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":258,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622171+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:35.622171+0000","last_peered":"2024-09-20T20:34:35.622171+0000","last_clean":"2024-09-20T20:34:35.622171+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:35.622171+0000","last_undegraded":"2024-09-20T20:34:35.622171+0000","last_fullsized":"2024-09-20T20:34:35.622171+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1067,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.647760+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:32.647760+0000","last_peered":"2024-09-20T20:34:32.647760+0000","last_clean":"2024-09-20T20:34:32.647760+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:32.647760+0000","last_undegraded":"2024-09-20T20:34:32.647760+0000","last_fullsized":"2024-09-20T20:34:32.647760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":213,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650973+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:32.650973+0000","last_peered":"2024-09-20T20:34:32.650973+0000","last_clean":"2024-09-20T20:34:32.650973+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:32.650973+0000","last_undegraded":"2024-09-20T20:34:32.650973+0000","last_fullsized":"2024-09-20T20:34:32.650973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649013+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:32.649013+0000","last_peered":"2024-09-20T20:34:32.649013+0000","last_clean":"2024-09-20T20:34:32.649013+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:32.649013+0000","last_undegraded":"2024-09-20T20:34:32.649013+0000","last_fullsized":"2024-09-20T20:34:32.649013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":531,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.654243+0000","last_change":"2024-09-20T20:34:19.277789+0000","last_active":"2024-09-20T20:34:32.654243+0000","last_peered":"2024-09-20T20:34:32.654243+0000","last_clean":"2024-09-20T20:31:51.167971+0000","last_became_active":"2024-09-20T20:34:18.890488+0000","last_became_peered":"2024-09-20T20:34:18.890488+0000","last_unstale":"2024-09-20T20:34:32.654243+0000","last_undegraded":"2024-09-20T20:34:19.277313+0000","last_fullsized":"2024-09-20T20:34:18.667466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":144,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":846,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.649914+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:32.649914+0000","last_peered":"2024-09-20T20:34:32.649914+0000","last_clean":"2024-09-20T20:34:32.649914+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:32.649914+0000","last_undegraded":"2024-09-20T20:34:32.649914+0000","last_fullsized":"2024-09-20T20:34:32.649914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":588,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.650360+0000","last_change":"2024-09-20T20:34:18.935766+0000","last_active":"2024-09-20T20:34:32.650360+0000","last_peered":"2024-09-20T20:34:32.650360+0000","last_clean":"2024-09-20T20:31:51.200271+0000","last_became_active":"2024-09-20T20:34:18.921689+0000","last_became_peered":"2024-09-20T20:34:18.921689+0000","last_unstale":"2024-09-20T20:34:32.650360+0000","last_undegraded":"2024-09-20T20:34:18.680964+0000","last_fullsized":"2024-09-20T20:34:18.663912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":344,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.648117+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:32.648117+0000","last_peered":"2024-09-20T20:34:32.648117+0000","last_clean":"2024-09-20T20:34:32.648117+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:32.648117+0000","last_undegraded":"2024-09-20T20:34:32.648117+0000","last_fullsized":"2024-09-20T20:34:32.648117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":642,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.654307+0000","last_change":"2024-09-20T20:34:18.935605+0000","last_active":"2024-09-20T20:34:32.654307+0000","last_peered":"2024-09-20T20:34:32.654307+0000","last_clean":"2024-09-20T20:31:51.202419+0000","last_became_active":"2024-09-20T20:34:18.931023+0000","last_became_peered":"2024-09-20T20:34:18.931023+0000","last_unstale":"2024-09-20T20:34:32.654307+0000","last_undegraded":"2024-09-20T20:34:18.676532+0000","last_fullsized":"2024-09-20T20:34:18.670396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":148,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":306,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653591+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:32.653591+0000","last_peered":"2024-09-20T20:34:32.653591+0000","last_clean":"2024-09-20T20:34:32.653591+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:32.653591+0000","last_undegraded":"2024-09-20T20:34:32.653591+0000","last_fullsized":"2024-09-20T20:34:32.653591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652907+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:32.652907+0000","last_peered":"2024-09-20T20:34:32.652907+0000","last_clean":"2024-09-20T20:34:32.652907+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:32.652907+0000","last_undegraded":"2024-09-20T20:34:32.652907+0000","last_fullsized":"2024-09-20T20:34:32.652907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.653048+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:32.653048+0000","last_peered":"2024-09-20T20:34:32.653048+0000","last_clean":"2024-09-20T20:34:32.653048+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:32.653048+0000","last_undegraded":"2024-09-20T20:34:32.653048+0000","last_fullsized":"2024-09-20T20:34:32.653048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":548,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621376+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:35.621376+0000","last_peered":"2024-09-20T20:34:35.621376+0000","last_clean":"2024-09-20T20:34:35.621376+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:35.621376+0000","last_undegraded":"2024-09-20T20:34:35.621376+0000","last_fullsized":"2024-09-20T20:34:35.621376+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622163+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:35.622163+0000","last_peered":"2024-09-20T20:34:35.622163+0000","last_clean":"2024-09-20T20:34:35.622163+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:35.622163+0000","last_undegraded":"2024-09-20T20:34:35.622163+0000","last_fullsized":"2024-09-20T20:34:35.622163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":558,"reported_epoch":88,"state":"peering","last_fresh":"2024-09-20T20:34:35.622589+0000","last_change":"2024-09-20T20:34:35.622589+0000","last_active":"2024-09-20T20:34:17.646639+0000","last_peered":"2024-09-20T20:34:15.793983+0000","last_clean":"2024-09-20T20:31:51.151591+0000","last_became_active":"2024-09-20T20:31:52.254116+0000","last_became_peered":"2024-09-20T20:31:52.254116+0000","last_unstale":"2024-09-20T20:34:35.622589+0000","last_undegraded":"2024-09-20T20:34:35.622589+0000","last_fullsized":"2024-09-20T20:34:35.622589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":432,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.655000+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:32.655000+0000","last_peered":"2024-09-20T20:34:32.655000+0000","last_clean":"2024-09-20T20:34:32.655000+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:32.655000+0000","last_undegraded":"2024-09-20T20:34:32.655000+0000","last_fullsized":"2024-09-20T20:34:32.655000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.652162+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:32.652162+0000","last_peered":"2024-09-20T20:34:32.652162+0000","last_clean":"2024-09-20T20:34:32.652162+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:32.652162+0000","last_undegraded":"2024-09-20T20:34:32.652162+0000","last_fullsized":"2024-09-20T20:34:32.652162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":213,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.651169+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:32.651169+0000","last_peered":"2024-09-20T20:34:32.651169+0000","last_clean":"2024-09-20T20:34:32.651169+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:32.651169+0000","last_undegraded":"2024-09-20T20:34:32.651169+0000","last_fullsized":"2024-09-20T20:34:32.651169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":604,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.647417+0000","last_change":"2024-09-20T20:34:18.940010+0000","last_active":"2024-09-20T20:34:32.647417+0000","last_peered":"2024-09-20T20:34:32.647417+0000","last_clean":"2024-09-20T20:31:51.180364+0000","last_became_active":"2024-09-20T20:34:18.923020+0000","last_became_peered":"2024-09-20T20:34:18.923020+0000","last_unstale":"2024-09-20T20:34:32.647417+0000","last_undegraded":"2024-09-20T20:34:18.682966+0000","last_fullsized":"2024-09-20T20:34:18.666887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-20T20:34:32.650690+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:32.650690+0000","last_peered":"2024-09-20T20:34:32.650690+0000","last_clean":"2024-09-20T20:34:32.650690+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:32.650690+0000","last_undegraded":"2024-09-20T20:34:32.650690+0000","last_fullsized":"2024-09-20T20:34:32.650690+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2317,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10141696,"data_stored":13157737,"data_compressed":1212683,"data_compressed_allocated":1794048,"data_compressed_original":8997235,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":114,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99212,"kb_used_data":27828,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272628,"statfs":{"total":96636764160,"available":96535171072,"internally_reserved":0,"allocated":28495872,"data_stored":81516174,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104244,"kb_used_data":28696,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267596,"statfs":{"total":96636764160,"available":96530018304,"internally_reserved":0,"allocated":29384704,"data_stored":85060401,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68840,"kb_used_data":35152,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94303000,"statfs":{"total":96636764160,"available":96566272000,"internally_reserved":0,"allocated":35995648,"data_stored":105472352,"data_compressed":15406608,"data_compressed_allocated":19103744,"data_compressed_original":93923699,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10141696,"data_stored":13157737,"data_compressed":1212683,"data_compressed_allocated":1794048,"data_compressed_original":8997235,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:38.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-20T20:34:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:38.706 INFO:teuthology.orchestra.run.smithi070.stdout:{"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2971/114 objects degraded (2606.140%), 18 pgs degraded","count":18},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":306,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":91,"num_osds":3,"num_up_osds":3,"osd_up_since":1726864456,"num_in_osds":3,"osd_in_since":1726864173,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":18},{"state_name":"peering","count":3},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128120423,"bytes_used":292241408,"bytes_avail":289618051072,"bytes_total":289910292480,"inactive_pgs_ratio":0.02857142873108387,"degraded_objects":2971,"degraded_total":114,"degraded_ratio":26.061403508771932,"recovering_objects_per_sec":86,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":347,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-20T20:31:03.624405+0000","services":{}},"progress_events":{}} 2024-09-20T20:34:38.726 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-20T20:34:38.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:39.031 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:39.047 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-09-20T20:34:38.649498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5270,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":272424,"kb_used_data":91808,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282843096,"statfs":{"total":289910292480,"available":289631330304,"internally_reserved":0,"allocated":94011392,"data_stored":272099853,"data_compressed":39129583,"data_compressed_allocated":50397184,"data_compressed_original":234760563,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1790,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1938,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002061"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.658232+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:37.658232+0000","last_peered":"2024-09-20T20:34:37.658232+0000","last_clean":"2024-09-20T20:34:37.658232+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:37.658232+0000","last_undegraded":"2024-09-20T20:34:37.658232+0000","last_fullsized":"2024-09-20T20:34:37.658232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":659,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657109+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:37.657109+0000","last_peered":"2024-09-20T20:34:37.657109+0000","last_clean":"2024-09-20T20:34:37.657109+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:37.657109+0000","last_undegraded":"2024-09-20T20:34:37.657109+0000","last_fullsized":"2024-09-20T20:34:37.657109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.624916+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:35.624916+0000","last_peered":"2024-09-20T20:34:35.624916+0000","last_clean":"2024-09-20T20:34:35.624916+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:35.624916+0000","last_undegraded":"2024-09-20T20:34:35.624916+0000","last_fullsized":"2024-09-20T20:34:35.624916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":549,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622483+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:35.622483+0000","last_peered":"2024-09-20T20:34:35.622483+0000","last_clean":"2024-09-20T20:34:35.622483+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:35.622483+0000","last_undegraded":"2024-09-20T20:34:35.622483+0000","last_fullsized":"2024-09-20T20:34:35.622483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":509,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655753+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:37.655753+0000","last_peered":"2024-09-20T20:34:37.655753+0000","last_clean":"2024-09-20T20:34:37.655753+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:37.655753+0000","last_undegraded":"2024-09-20T20:34:37.655753+0000","last_fullsized":"2024-09-20T20:34:37.655753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":567,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623692+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:35.623692+0000","last_peered":"2024-09-20T20:34:35.623692+0000","last_clean":"2024-09-20T20:34:35.623692+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:35.623692+0000","last_undegraded":"2024-09-20T20:34:35.623692+0000","last_fullsized":"2024-09-20T20:34:35.623692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.619925+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:35.619925+0000","last_peered":"2024-09-20T20:34:35.619925+0000","last_clean":"2024-09-20T20:34:35.619925+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:35.619925+0000","last_undegraded":"2024-09-20T20:34:35.619925+0000","last_fullsized":"2024-09-20T20:34:35.619925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":616,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.648974+0000","last_change":"2024-09-20T20:34:18.940543+0000","last_active":"2024-09-20T20:34:37.648974+0000","last_peered":"2024-09-20T20:34:37.648974+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:34:18.934342+0000","last_became_peered":"2024-09-20T20:34:18.934342+0000","last_unstale":"2024-09-20T20:34:37.648974+0000","last_undegraded":"2024-09-20T20:34:18.666832+0000","last_fullsized":"2024-09-20T20:34:18.649718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":139,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":576,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650888+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:37.650888+0000","last_peered":"2024-09-20T20:34:37.650888+0000","last_clean":"2024-09-20T20:34:37.650888+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:37.650888+0000","last_undegraded":"2024-09-20T20:34:37.650888+0000","last_fullsized":"2024-09-20T20:34:37.650888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":562,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657273+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:37.657273+0000","last_peered":"2024-09-20T20:34:37.657273+0000","last_clean":"2024-09-20T20:34:37.657273+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:37.657273+0000","last_undegraded":"2024-09-20T20:34:37.657273+0000","last_fullsized":"2024-09-20T20:34:37.657273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":539,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.624712+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:35.624712+0000","last_peered":"2024-09-20T20:34:35.624712+0000","last_clean":"2024-09-20T20:34:35.624712+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:35.624712+0000","last_undegraded":"2024-09-20T20:34:35.624712+0000","last_fullsized":"2024-09-20T20:34:35.624712+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":807,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655671+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:37.655671+0000","last_peered":"2024-09-20T20:34:37.655671+0000","last_clean":"2024-09-20T20:34:37.655671+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:37.655671+0000","last_undegraded":"2024-09-20T20:34:37.655671+0000","last_fullsized":"2024-09-20T20:34:37.655671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":529,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655223+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:37.655223+0000","last_peered":"2024-09-20T20:34:37.655223+0000","last_clean":"2024-09-20T20:34:37.655223+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:37.655223+0000","last_undegraded":"2024-09-20T20:34:37.655223+0000","last_fullsized":"2024-09-20T20:34:37.655223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":589,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623433+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:35.623433+0000","last_peered":"2024-09-20T20:34:35.623433+0000","last_clean":"2024-09-20T20:34:35.623433+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:35.623433+0000","last_undegraded":"2024-09-20T20:34:35.623433+0000","last_fullsized":"2024-09-20T20:34:35.623433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":684,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621111+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:35.621111+0000","last_peered":"2024-09-20T20:34:35.621111+0000","last_clean":"2024-09-20T20:34:35.621111+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:35.621111+0000","last_undegraded":"2024-09-20T20:34:35.621111+0000","last_fullsized":"2024-09-20T20:34:35.621111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":631,"reported_epoch":85,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:32.646923+0000","last_change":"2024-09-20T20:34:18.939734+0000","last_active":"2024-09-20T20:34:32.646923+0000","last_peered":"2024-09-20T20:34:32.646923+0000","last_clean":"2024-09-20T20:31:51.161495+0000","last_became_active":"2024-09-20T20:34:18.920486+0000","last_became_peered":"2024-09-20T20:34:18.920486+0000","last_unstale":"2024-09-20T20:34:32.646923+0000","last_undegraded":"2024-09-20T20:34:18.665789+0000","last_fullsized":"2024-09-20T20:34:18.649684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":605,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652230+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:37.652230+0000","last_peered":"2024-09-20T20:34:37.652230+0000","last_clean":"2024-09-20T20:34:37.652230+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:37.652230+0000","last_undegraded":"2024-09-20T20:34:37.652230+0000","last_fullsized":"2024-09-20T20:34:37.652230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657647+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:37.657647+0000","last_peered":"2024-09-20T20:34:37.657647+0000","last_clean":"2024-09-20T20:34:37.657647+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:37.657647+0000","last_undegraded":"2024-09-20T20:34:37.657647+0000","last_fullsized":"2024-09-20T20:34:37.657647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":636,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655726+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:37.655726+0000","last_peered":"2024-09-20T20:34:37.655726+0000","last_clean":"2024-09-20T20:34:37.655726+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:37.655726+0000","last_undegraded":"2024-09-20T20:34:37.655726+0000","last_fullsized":"2024-09-20T20:34:37.655726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":601,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623238+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:35.623238+0000","last_peered":"2024-09-20T20:34:35.623238+0000","last_clean":"2024-09-20T20:34:35.623238+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:35.623238+0000","last_undegraded":"2024-09-20T20:34:35.623238+0000","last_fullsized":"2024-09-20T20:34:35.623238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":563,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621810+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:35.621810+0000","last_peered":"2024-09-20T20:34:35.621810+0000","last_clean":"2024-09-20T20:34:35.621810+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:35.621810+0000","last_undegraded":"2024-09-20T20:34:35.621810+0000","last_fullsized":"2024-09-20T20:34:35.621810+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":784,"reported_epoch":90,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-20T20:34:37.733956+0000","last_change":"2024-09-20T20:34:37.495264+0000","last_active":"2024-09-20T20:34:37.733956+0000","last_peered":"2024-09-20T20:34:37.733956+0000","last_clean":"2024-09-20T20:31:51.184225+0000","last_became_active":"2024-09-20T20:34:26.683873+0000","last_became_peered":"2024-09-20T20:34:26.683873+0000","last_unstale":"2024-09-20T20:34:37.733956+0000","last_undegraded":"2024-09-20T20:34:37.733956+0000","last_fullsized":"2024-09-20T20:34:26.677143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1000,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649078+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:37.649078+0000","last_peered":"2024-09-20T20:34:37.649078+0000","last_clean":"2024-09-20T20:34:37.649078+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:37.649078+0000","last_undegraded":"2024-09-20T20:34:37.649078+0000","last_fullsized":"2024-09-20T20:34:37.649078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":684,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653580+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:37.653580+0000","last_peered":"2024-09-20T20:34:37.653580+0000","last_clean":"2024-09-20T20:34:37.653580+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:37.653580+0000","last_undegraded":"2024-09-20T20:34:37.653580+0000","last_fullsized":"2024-09-20T20:34:37.653580+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":919,"reported_epoch":89,"state":"peering","last_fresh":"2024-09-20T20:34:36.900241+0000","last_change":"2024-09-20T20:34:37.656193+0000","last_active":"2024-09-20T20:34:37.656193+0000","last_peered":"2024-09-20T20:34:36.900241+0000","last_clean":"2024-09-20T20:31:51.129241+0000","last_became_active":"2024-09-20T20:34:26.682699+0000","last_became_peered":"2024-09-20T20:34:26.682699+0000","last_unstale":"2024-09-20T20:34:36.900241+0000","last_undegraded":"2024-09-20T20:34:36.900241+0000","last_fullsized":"2024-09-20T20:34:26.675708+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1075,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652190+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:37.652190+0000","last_peered":"2024-09-20T20:34:37.652190+0000","last_clean":"2024-09-20T20:34:37.652190+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:37.652190+0000","last_undegraded":"2024-09-20T20:34:37.652190+0000","last_fullsized":"2024-09-20T20:34:37.652190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":614,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.624453+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:35.624453+0000","last_peered":"2024-09-20T20:34:35.624453+0000","last_clean":"2024-09-20T20:34:35.624453+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:35.624453+0000","last_undegraded":"2024-09-20T20:34:35.624453+0000","last_fullsized":"2024-09-20T20:34:35.624453+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":925,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656372+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:37.656372+0000","last_peered":"2024-09-20T20:34:37.656372+0000","last_clean":"2024-09-20T20:34:37.656372+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:37.656372+0000","last_undegraded":"2024-09-20T20:34:37.656372+0000","last_fullsized":"2024-09-20T20:34:37.656372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":649,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650072+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:37.650072+0000","last_peered":"2024-09-20T20:34:37.650072+0000","last_clean":"2024-09-20T20:34:37.650072+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:37.650072+0000","last_undegraded":"2024-09-20T20:34:37.650072+0000","last_fullsized":"2024-09-20T20:34:37.650072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":624,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.654822+0000","last_change":"2024-09-20T20:34:26.704756+0000","last_active":"2024-09-20T20:34:37.654822+0000","last_peered":"2024-09-20T20:34:37.654822+0000","last_clean":"2024-09-20T20:31:51.179186+0000","last_became_active":"2024-09-20T20:34:26.700667+0000","last_became_peered":"2024-09-20T20:34:26.700667+0000","last_unstale":"2024-09-20T20:34:37.654822+0000","last_undegraded":"2024-09-20T20:34:26.682148+0000","last_fullsized":"2024-09-20T20:34:26.679653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":610,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649231+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:37.649231+0000","last_peered":"2024-09-20T20:34:37.649231+0000","last_clean":"2024-09-20T20:34:37.649231+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:37.649231+0000","last_undegraded":"2024-09-20T20:34:37.649231+0000","last_fullsized":"2024-09-20T20:34:37.649231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":601,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.650356+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:37.650356+0000","last_peered":"2024-09-20T20:34:37.650356+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:37.650356+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":487,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656162+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:37.656162+0000","last_peered":"2024-09-20T20:34:37.656162+0000","last_clean":"2024-09-20T20:34:37.656162+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:37.656162+0000","last_undegraded":"2024-09-20T20:34:37.656162+0000","last_fullsized":"2024-09-20T20:34:37.656162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":553,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621081+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:35.621081+0000","last_peered":"2024-09-20T20:34:35.621081+0000","last_clean":"2024-09-20T20:34:35.621081+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:35.621081+0000","last_undegraded":"2024-09-20T20:34:35.621081+0000","last_fullsized":"2024-09-20T20:34:35.621081+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":525,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656489+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:37.656489+0000","last_peered":"2024-09-20T20:34:37.656489+0000","last_clean":"2024-09-20T20:34:37.656489+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:37.656489+0000","last_undegraded":"2024-09-20T20:34:37.656489+0000","last_fullsized":"2024-09-20T20:34:37.656489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649980+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:37.649980+0000","last_peered":"2024-09-20T20:34:37.649980+0000","last_clean":"2024-09-20T20:34:37.649980+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:37.649980+0000","last_undegraded":"2024-09-20T20:34:37.649980+0000","last_fullsized":"2024-09-20T20:34:37.649980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":992,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.659022+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:37.659022+0000","last_peered":"2024-09-20T20:34:37.659022+0000","last_clean":"2024-09-20T20:34:37.659022+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:37.659022+0000","last_undegraded":"2024-09-20T20:34:37.659022+0000","last_fullsized":"2024-09-20T20:34:37.659022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":230,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654334+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:37.654334+0000","last_peered":"2024-09-20T20:34:37.654334+0000","last_clean":"2024-09-20T20:34:37.654334+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:37.654334+0000","last_undegraded":"2024-09-20T20:34:37.654334+0000","last_fullsized":"2024-09-20T20:34:37.654334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":632,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.651072+0000","last_change":"2024-09-20T20:34:19.225616+0000","last_active":"2024-09-20T20:34:37.651072+0000","last_peered":"2024-09-20T20:34:37.651072+0000","last_clean":"2024-09-20T20:31:51.195638+0000","last_became_active":"2024-09-20T20:34:18.889264+0000","last_became_peered":"2024-09-20T20:34:18.889264+0000","last_unstale":"2024-09-20T20:34:37.651072+0000","last_undegraded":"2024-09-20T20:34:19.225278+0000","last_fullsized":"2024-09-20T20:34:18.651936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620025+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:35.620025+0000","last_peered":"2024-09-20T20:34:35.620025+0000","last_clean":"2024-09-20T20:34:35.620025+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:35.620025+0000","last_undegraded":"2024-09-20T20:34:35.620025+0000","last_fullsized":"2024-09-20T20:34:35.620025+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":203,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622172+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:35.622172+0000","last_peered":"2024-09-20T20:34:35.622172+0000","last_clean":"2024-09-20T20:34:35.622172+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:35.622172+0000","last_undegraded":"2024-09-20T20:34:35.622172+0000","last_fullsized":"2024-09-20T20:34:35.622172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":898,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653718+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:37.653718+0000","last_peered":"2024-09-20T20:34:37.653718+0000","last_clean":"2024-09-20T20:34:37.653718+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:37.653718+0000","last_undegraded":"2024-09-20T20:34:37.653718+0000","last_fullsized":"2024-09-20T20:34:37.653718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":429,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657867+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:37.657867+0000","last_peered":"2024-09-20T20:34:37.657867+0000","last_clean":"2024-09-20T20:34:37.657867+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:37.657867+0000","last_undegraded":"2024-09-20T20:34:37.657867+0000","last_fullsized":"2024-09-20T20:34:37.657867+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":543,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654015+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:37.654015+0000","last_peered":"2024-09-20T20:34:37.654015+0000","last_clean":"2024-09-20T20:34:37.654015+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:37.654015+0000","last_undegraded":"2024-09-20T20:34:37.654015+0000","last_fullsized":"2024-09-20T20:34:37.654015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":555,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623921+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:35.623921+0000","last_peered":"2024-09-20T20:34:35.623921+0000","last_clean":"2024-09-20T20:34:35.623921+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:35.623921+0000","last_undegraded":"2024-09-20T20:34:35.623921+0000","last_fullsized":"2024-09-20T20:34:35.623921+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":621,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623956+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:35.623956+0000","last_peered":"2024-09-20T20:34:35.623956+0000","last_clean":"2024-09-20T20:34:35.623956+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:35.623956+0000","last_undegraded":"2024-09-20T20:34:35.623956+0000","last_fullsized":"2024-09-20T20:34:35.623956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622774+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:35.622774+0000","last_peered":"2024-09-20T20:34:35.622774+0000","last_clean":"2024-09-20T20:34:35.622774+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:35.622774+0000","last_undegraded":"2024-09-20T20:34:35.622774+0000","last_fullsized":"2024-09-20T20:34:35.622774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1064,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650197+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:37.650197+0000","last_peered":"2024-09-20T20:34:37.650197+0000","last_clean":"2024-09-20T20:34:37.650197+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:37.650197+0000","last_undegraded":"2024-09-20T20:34:37.650197+0000","last_fullsized":"2024-09-20T20:34:37.650197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":367,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650711+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:37.650711+0000","last_peered":"2024-09-20T20:34:37.650711+0000","last_clean":"2024-09-20T20:34:37.650711+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:37.650711+0000","last_undegraded":"2024-09-20T20:34:37.650711+0000","last_fullsized":"2024-09-20T20:34:37.650711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":593,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.623664+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:35.623664+0000","last_peered":"2024-09-20T20:34:35.623664+0000","last_clean":"2024-09-20T20:34:35.623664+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:35.623664+0000","last_undegraded":"2024-09-20T20:34:35.623664+0000","last_fullsized":"2024-09-20T20:34:35.623664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":182,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620801+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:35.620801+0000","last_peered":"2024-09-20T20:34:35.620801+0000","last_clean":"2024-09-20T20:34:35.620801+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:35.620801+0000","last_undegraded":"2024-09-20T20:34:35.620801+0000","last_fullsized":"2024-09-20T20:34:35.620801+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":564,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.633591+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:35.633591+0000","last_peered":"2024-09-20T20:34:35.633591+0000","last_clean":"2024-09-20T20:34:35.633591+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:35.633591+0000","last_undegraded":"2024-09-20T20:34:35.633591+0000","last_fullsized":"2024-09-20T20:34:35.633591+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654483+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:37.654483+0000","last_peered":"2024-09-20T20:34:37.654483+0000","last_clean":"2024-09-20T20:34:37.654483+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:37.654483+0000","last_undegraded":"2024-09-20T20:34:37.654483+0000","last_fullsized":"2024-09-20T20:34:37.654483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":591,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622690+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:35.622690+0000","last_peered":"2024-09-20T20:34:35.622690+0000","last_clean":"2024-09-20T20:34:35.622690+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:35.622690+0000","last_undegraded":"2024-09-20T20:34:35.622690+0000","last_fullsized":"2024-09-20T20:34:35.622690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":639,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653966+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:37.653966+0000","last_peered":"2024-09-20T20:34:37.653966+0000","last_clean":"2024-09-20T20:34:37.653966+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:37.653966+0000","last_undegraded":"2024-09-20T20:34:37.653966+0000","last_fullsized":"2024-09-20T20:34:37.653966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":587,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651244+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:37.651244+0000","last_peered":"2024-09-20T20:34:37.651244+0000","last_clean":"2024-09-20T20:34:37.651244+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:37.651244+0000","last_undegraded":"2024-09-20T20:34:37.651244+0000","last_fullsized":"2024-09-20T20:34:37.651244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":339,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.619808+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:35.619808+0000","last_peered":"2024-09-20T20:34:35.619808+0000","last_clean":"2024-09-20T20:34:35.619808+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:35.619808+0000","last_undegraded":"2024-09-20T20:34:35.619808+0000","last_fullsized":"2024-09-20T20:34:35.619808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":79,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620777+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:35.620777+0000","last_peered":"2024-09-20T20:34:35.620777+0000","last_clean":"2024-09-20T20:34:35.620777+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:35.620777+0000","last_undegraded":"2024-09-20T20:34:35.620777+0000","last_fullsized":"2024-09-20T20:34:35.620777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":718,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650167+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:37.650167+0000","last_peered":"2024-09-20T20:34:37.650167+0000","last_clean":"2024-09-20T20:34:37.650167+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:37.650167+0000","last_undegraded":"2024-09-20T20:34:37.650167+0000","last_fullsized":"2024-09-20T20:34:37.650167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":582,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.624199+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:35.624199+0000","last_peered":"2024-09-20T20:34:35.624199+0000","last_clean":"2024-09-20T20:34:35.624199+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:35.624199+0000","last_undegraded":"2024-09-20T20:34:35.624199+0000","last_fullsized":"2024-09-20T20:34:35.624199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620499+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:35.620499+0000","last_peered":"2024-09-20T20:34:35.620499+0000","last_clean":"2024-09-20T20:34:35.620499+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:35.620499+0000","last_undegraded":"2024-09-20T20:34:35.620499+0000","last_fullsized":"2024-09-20T20:34:35.620499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":362,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650082+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:37.650082+0000","last_peered":"2024-09-20T20:34:37.650082+0000","last_clean":"2024-09-20T20:34:37.650082+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:37.650082+0000","last_undegraded":"2024-09-20T20:34:37.650082+0000","last_fullsized":"2024-09-20T20:34:37.650082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657850+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:37.657850+0000","last_peered":"2024-09-20T20:34:37.657850+0000","last_clean":"2024-09-20T20:34:37.657850+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:37.657850+0000","last_undegraded":"2024-09-20T20:34:37.657850+0000","last_fullsized":"2024-09-20T20:34:37.657850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650424+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:37.650424+0000","last_peered":"2024-09-20T20:34:37.650424+0000","last_clean":"2024-09-20T20:34:37.650424+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:37.650424+0000","last_undegraded":"2024-09-20T20:34:37.650424+0000","last_fullsized":"2024-09-20T20:34:37.650424+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":395,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654071+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:37.654071+0000","last_peered":"2024-09-20T20:34:37.654071+0000","last_clean":"2024-09-20T20:34:37.654071+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:37.654071+0000","last_undegraded":"2024-09-20T20:34:37.654071+0000","last_fullsized":"2024-09-20T20:34:37.654071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":549,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651568+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:37.651568+0000","last_peered":"2024-09-20T20:34:37.651568+0000","last_clean":"2024-09-20T20:34:37.651568+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:37.651568+0000","last_undegraded":"2024-09-20T20:34:37.651568+0000","last_fullsized":"2024-09-20T20:34:37.651568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":80,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620974+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:35.620974+0000","last_peered":"2024-09-20T20:34:35.620974+0000","last_clean":"2024-09-20T20:34:35.620974+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:35.620974+0000","last_undegraded":"2024-09-20T20:34:35.620974+0000","last_fullsized":"2024-09-20T20:34:35.620974+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.620951+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:35.620951+0000","last_peered":"2024-09-20T20:34:35.620951+0000","last_clean":"2024-09-20T20:34:35.620951+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:35.620951+0000","last_undegraded":"2024-09-20T20:34:35.620951+0000","last_fullsized":"2024-09-20T20:34:35.620951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":597,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651834+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:37.651834+0000","last_peered":"2024-09-20T20:34:37.651834+0000","last_clean":"2024-09-20T20:34:37.651834+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:37.651834+0000","last_undegraded":"2024-09-20T20:34:37.651834+0000","last_fullsized":"2024-09-20T20:34:37.651834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":313,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621396+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:35.621396+0000","last_peered":"2024-09-20T20:34:35.621396+0000","last_clean":"2024-09-20T20:34:35.621396+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:35.621396+0000","last_undegraded":"2024-09-20T20:34:35.621396+0000","last_fullsized":"2024-09-20T20:34:35.621396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652206+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:37.652206+0000","last_peered":"2024-09-20T20:34:37.652206+0000","last_clean":"2024-09-20T20:34:37.652206+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:37.652206+0000","last_undegraded":"2024-09-20T20:34:37.652206+0000","last_fullsized":"2024-09-20T20:34:37.652206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":832,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654592+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:37.654592+0000","last_peered":"2024-09-20T20:34:37.654592+0000","last_clean":"2024-09-20T20:34:37.654592+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:37.654592+0000","last_undegraded":"2024-09-20T20:34:37.654592+0000","last_fullsized":"2024-09-20T20:34:37.654592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":214,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652000+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:37.652000+0000","last_peered":"2024-09-20T20:34:37.652000+0000","last_clean":"2024-09-20T20:34:37.652000+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:37.652000+0000","last_undegraded":"2024-09-20T20:34:37.652000+0000","last_fullsized":"2024-09-20T20:34:37.652000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657264+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:37.657264+0000","last_peered":"2024-09-20T20:34:37.657264+0000","last_clean":"2024-09-20T20:34:37.657264+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:37.657264+0000","last_undegraded":"2024-09-20T20:34:37.657264+0000","last_fullsized":"2024-09-20T20:34:37.657264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":888,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655324+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:37.655324+0000","last_peered":"2024-09-20T20:34:37.655324+0000","last_clean":"2024-09-20T20:34:37.655324+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:37.655324+0000","last_undegraded":"2024-09-20T20:34:37.655324+0000","last_fullsized":"2024-09-20T20:34:37.655324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652551+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:37.652551+0000","last_peered":"2024-09-20T20:34:37.652551+0000","last_clean":"2024-09-20T20:34:37.652551+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:37.652551+0000","last_undegraded":"2024-09-20T20:34:37.652551+0000","last_fullsized":"2024-09-20T20:34:37.652551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653170+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:37.653170+0000","last_peered":"2024-09-20T20:34:37.653170+0000","last_clean":"2024-09-20T20:34:37.653170+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:37.653170+0000","last_undegraded":"2024-09-20T20:34:37.653170+0000","last_fullsized":"2024-09-20T20:34:37.653170+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":706,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.651554+0000","last_change":"2024-09-20T20:34:18.940279+0000","last_active":"2024-09-20T20:34:37.651554+0000","last_peered":"2024-09-20T20:34:37.651554+0000","last_clean":"2024-09-20T20:31:51.202703+0000","last_became_active":"2024-09-20T20:34:18.934354+0000","last_became_peered":"2024-09-20T20:34:18.934354+0000","last_unstale":"2024-09-20T20:34:37.651554+0000","last_undegraded":"2024-09-20T20:34:18.689916+0000","last_fullsized":"2024-09-20T20:34:18.683789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653000+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:37.653000+0000","last_peered":"2024-09-20T20:34:37.653000+0000","last_clean":"2024-09-20T20:34:37.653000+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:37.653000+0000","last_undegraded":"2024-09-20T20:34:37.653000+0000","last_fullsized":"2024-09-20T20:34:37.653000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621692+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:35.621692+0000","last_peered":"2024-09-20T20:34:35.621692+0000","last_clean":"2024-09-20T20:34:35.621692+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:35.621692+0000","last_undegraded":"2024-09-20T20:34:35.621692+0000","last_fullsized":"2024-09-20T20:34:35.621692+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":926,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654299+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:37.654299+0000","last_peered":"2024-09-20T20:34:37.654299+0000","last_clean":"2024-09-20T20:34:37.654299+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:37.654299+0000","last_undegraded":"2024-09-20T20:34:37.654299+0000","last_fullsized":"2024-09-20T20:34:37.654299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621448+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:35.621448+0000","last_peered":"2024-09-20T20:34:35.621448+0000","last_clean":"2024-09-20T20:34:35.621448+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:35.621448+0000","last_undegraded":"2024-09-20T20:34:35.621448+0000","last_fullsized":"2024-09-20T20:34:35.621448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":423,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621845+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:35.621845+0000","last_peered":"2024-09-20T20:34:35.621845+0000","last_clean":"2024-09-20T20:34:35.621845+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:35.621845+0000","last_undegraded":"2024-09-20T20:34:35.621845+0000","last_fullsized":"2024-09-20T20:34:35.621845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":581,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649647+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:37.649647+0000","last_peered":"2024-09-20T20:34:37.649647+0000","last_clean":"2024-09-20T20:34:37.649647+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:37.649647+0000","last_undegraded":"2024-09-20T20:34:37.649647+0000","last_fullsized":"2024-09-20T20:34:37.649647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":258,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657034+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:37.657034+0000","last_peered":"2024-09-20T20:34:37.657034+0000","last_clean":"2024-09-20T20:34:37.657034+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:37.657034+0000","last_undegraded":"2024-09-20T20:34:37.657034+0000","last_fullsized":"2024-09-20T20:34:37.657034+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":258,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622171+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:35.622171+0000","last_peered":"2024-09-20T20:34:35.622171+0000","last_clean":"2024-09-20T20:34:35.622171+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:35.622171+0000","last_undegraded":"2024-09-20T20:34:35.622171+0000","last_fullsized":"2024-09-20T20:34:35.622171+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1078,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650042+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:37.650042+0000","last_peered":"2024-09-20T20:34:37.650042+0000","last_clean":"2024-09-20T20:34:37.650042+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:37.650042+0000","last_undegraded":"2024-09-20T20:34:37.650042+0000","last_fullsized":"2024-09-20T20:34:37.650042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652058+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:37.652058+0000","last_peered":"2024-09-20T20:34:37.652058+0000","last_clean":"2024-09-20T20:34:37.652058+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:37.652058+0000","last_undegraded":"2024-09-20T20:34:37.652058+0000","last_fullsized":"2024-09-20T20:34:37.652058+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":666,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651391+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:37.651391+0000","last_peered":"2024-09-20T20:34:37.651391+0000","last_clean":"2024-09-20T20:34:37.651391+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:37.651391+0000","last_undegraded":"2024-09-20T20:34:37.651391+0000","last_fullsized":"2024-09-20T20:34:37.651391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":836,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.663406+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:37.663406+0000","last_peered":"2024-09-20T20:34:37.663406+0000","last_clean":"2024-09-20T20:34:37.663406+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:37.663406+0000","last_undegraded":"2024-09-20T20:34:37.663406+0000","last_fullsized":"2024-09-20T20:34:37.663406+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":856,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651733+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:37.651733+0000","last_peered":"2024-09-20T20:34:37.651733+0000","last_clean":"2024-09-20T20:34:37.651733+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:37.651733+0000","last_undegraded":"2024-09-20T20:34:37.651733+0000","last_fullsized":"2024-09-20T20:34:37.651733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":935,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652697+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:37.652697+0000","last_peered":"2024-09-20T20:34:37.652697+0000","last_clean":"2024-09-20T20:34:37.652697+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:37.652697+0000","last_undegraded":"2024-09-20T20:34:37.652697+0000","last_fullsized":"2024-09-20T20:34:37.652697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":354,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649750+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:37.649750+0000","last_peered":"2024-09-20T20:34:37.649750+0000","last_clean":"2024-09-20T20:34:37.649750+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:37.649750+0000","last_undegraded":"2024-09-20T20:34:37.649750+0000","last_fullsized":"2024-09-20T20:34:37.649750+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":955,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656555+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:37.656555+0000","last_peered":"2024-09-20T20:34:37.656555+0000","last_clean":"2024-09-20T20:34:37.656555+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:37.656555+0000","last_undegraded":"2024-09-20T20:34:37.656555+0000","last_fullsized":"2024-09-20T20:34:37.656555+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":316,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655100+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:37.655100+0000","last_peered":"2024-09-20T20:34:37.655100+0000","last_clean":"2024-09-20T20:34:37.655100+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:37.655100+0000","last_undegraded":"2024-09-20T20:34:37.655100+0000","last_fullsized":"2024-09-20T20:34:37.655100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":528,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655674+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:37.655674+0000","last_peered":"2024-09-20T20:34:37.655674+0000","last_clean":"2024-09-20T20:34:37.655674+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:37.655674+0000","last_undegraded":"2024-09-20T20:34:37.655674+0000","last_fullsized":"2024-09-20T20:34:37.655674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":225,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655777+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:37.655777+0000","last_peered":"2024-09-20T20:34:37.655777+0000","last_clean":"2024-09-20T20:34:37.655777+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:37.655777+0000","last_undegraded":"2024-09-20T20:34:37.655777+0000","last_fullsized":"2024-09-20T20:34:37.655777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":548,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.621376+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:35.621376+0000","last_peered":"2024-09-20T20:34:35.621376+0000","last_clean":"2024-09-20T20:34:35.621376+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:35.621376+0000","last_undegraded":"2024-09-20T20:34:35.621376+0000","last_fullsized":"2024-09-20T20:34:35.621376+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":356,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-20T20:34:35.622163+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:35.622163+0000","last_peered":"2024-09-20T20:34:35.622163+0000","last_clean":"2024-09-20T20:34:35.622163+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:35.622163+0000","last_undegraded":"2024-09-20T20:34:35.622163+0000","last_fullsized":"2024-09-20T20:34:35.622163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":558,"reported_epoch":88,"state":"peering","last_fresh":"2024-09-20T20:34:35.622589+0000","last_change":"2024-09-20T20:34:35.622589+0000","last_active":"2024-09-20T20:34:17.646639+0000","last_peered":"2024-09-20T20:34:15.793983+0000","last_clean":"2024-09-20T20:31:51.151591+0000","last_became_active":"2024-09-20T20:31:52.254116+0000","last_became_peered":"2024-09-20T20:31:52.254116+0000","last_unstale":"2024-09-20T20:34:35.622589+0000","last_undegraded":"2024-09-20T20:34:35.622589+0000","last_fullsized":"2024-09-20T20:34:35.622589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":442,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656777+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:37.656777+0000","last_peered":"2024-09-20T20:34:37.656777+0000","last_clean":"2024-09-20T20:34:37.656777+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:37.656777+0000","last_undegraded":"2024-09-20T20:34:37.656777+0000","last_fullsized":"2024-09-20T20:34:37.656777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":604,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654606+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:37.654606+0000","last_peered":"2024-09-20T20:34:37.654606+0000","last_clean":"2024-09-20T20:34:37.654606+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:37.654606+0000","last_undegraded":"2024-09-20T20:34:37.654606+0000","last_fullsized":"2024-09-20T20:34:37.654606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652846+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:37.652846+0000","last_peered":"2024-09-20T20:34:37.652846+0000","last_clean":"2024-09-20T20:34:37.652846+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:37.652846+0000","last_undegraded":"2024-09-20T20:34:37.652846+0000","last_fullsized":"2024-09-20T20:34:37.652846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":614,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.649678+0000","last_change":"2024-09-20T20:34:18.940010+0000","last_active":"2024-09-20T20:34:37.649678+0000","last_peered":"2024-09-20T20:34:37.649678+0000","last_clean":"2024-09-20T20:31:51.180364+0000","last_became_active":"2024-09-20T20:34:18.923020+0000","last_became_peered":"2024-09-20T20:34:18.923020+0000","last_unstale":"2024-09-20T20:34:37.649678+0000","last_undegraded":"2024-09-20T20:34:18.682966+0000","last_fullsized":"2024-09-20T20:34:18.666887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651780+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:37.651780+0000","last_peered":"2024-09-20T20:34:37.651780+0000","last_clean":"2024-09-20T20:34:37.651780+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:37.651780+0000","last_undegraded":"2024-09-20T20:34:37.651780+0000","last_fullsized":"2024-09-20T20:34:37.651780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5256,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10141696,"data_stored":13157737,"data_compressed":1212683,"data_compressed_allocated":1794048,"data_compressed_original":8997235,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":120,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99284,"kb_used_data":27900,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272556,"statfs":{"total":96636764160,"available":96535097344,"internally_reserved":0,"allocated":28569600,"data_stored":81543880,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104300,"kb_used_data":28756,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267540,"statfs":{"total":96636764160,"available":96529960960,"internally_reserved":0,"allocated":29446144,"data_stored":85083621,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68840,"kb_used_data":35152,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94303000,"statfs":{"total":96636764160,"available":96566272000,"internally_reserved":0,"allocated":35995648,"data_stored":105472352,"data_compressed":15406608,"data_compressed_allocated":19103744,"data_compressed_original":93923699,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10141696,"data_stored":13157737,"data_compressed":1212683,"data_compressed_allocated":1794048,"data_compressed_original":8997235,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:42.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:42.363 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:42.365 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:42.380 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-20T20:34:41.722772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5783,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":205,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":262100,"kb_used_data":81480,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282853420,"statfs":{"total":289910292480,"available":289641902080,"internally_reserved":0,"allocated":83435520,"data_stored":259766312,"data_compressed":37788283,"data_compressed_allocated":48537600,"data_compressed_original":226779136,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1633,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1566,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001423"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.658232+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:37.658232+0000","last_peered":"2024-09-20T20:34:37.658232+0000","last_clean":"2024-09-20T20:34:37.658232+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:37.658232+0000","last_undegraded":"2024-09-20T20:34:37.658232+0000","last_fullsized":"2024-09-20T20:34:37.658232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":659,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657109+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:37.657109+0000","last_peered":"2024-09-20T20:34:37.657109+0000","last_clean":"2024-09-20T20:34:37.657109+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:37.657109+0000","last_undegraded":"2024-09-20T20:34:37.657109+0000","last_fullsized":"2024-09-20T20:34:37.657109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635579+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:40.635579+0000","last_peered":"2024-09-20T20:34:40.635579+0000","last_clean":"2024-09-20T20:34:40.635579+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:40.635579+0000","last_undegraded":"2024-09-20T20:34:40.635579+0000","last_fullsized":"2024-09-20T20:34:40.635579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":559,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633524+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:40.633524+0000","last_peered":"2024-09-20T20:34:40.633524+0000","last_clean":"2024-09-20T20:34:40.633524+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:40.633524+0000","last_undegraded":"2024-09-20T20:34:40.633524+0000","last_fullsized":"2024-09-20T20:34:40.633524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":509,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655753+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:37.655753+0000","last_peered":"2024-09-20T20:34:37.655753+0000","last_clean":"2024-09-20T20:34:37.655753+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:37.655753+0000","last_undegraded":"2024-09-20T20:34:37.655753+0000","last_fullsized":"2024-09-20T20:34:37.655753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":577,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633512+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:40.633512+0000","last_peered":"2024-09-20T20:34:40.633512+0000","last_clean":"2024-09-20T20:34:40.633512+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:40.633512+0000","last_undegraded":"2024-09-20T20:34:40.633512+0000","last_fullsized":"2024-09-20T20:34:40.633512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":622,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632527+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:40.632527+0000","last_peered":"2024-09-20T20:34:40.632527+0000","last_clean":"2024-09-20T20:34:40.632527+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:40.632527+0000","last_undegraded":"2024-09-20T20:34:40.632527+0000","last_fullsized":"2024-09-20T20:34:40.632527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":574,"reported_epoch":93,"state":"peering","last_fresh":"2024-09-20T20:34:40.632445+0000","last_change":"2024-09-20T20:34:40.632445+0000","last_active":"2024-09-20T20:34:17.643078+0000","last_peered":"2024-09-20T20:34:15.791607+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:31:52.246684+0000","last_became_peered":"2024-09-20T20:31:52.246684+0000","last_unstale":"2024-09-20T20:34:40.632445+0000","last_undegraded":"2024-09-20T20:34:40.632445+0000","last_fullsized":"2024-09-20T20:34:40.632445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":576,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650888+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:37.650888+0000","last_peered":"2024-09-20T20:34:37.650888+0000","last_clean":"2024-09-20T20:34:37.650888+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:37.650888+0000","last_undegraded":"2024-09-20T20:34:37.650888+0000","last_fullsized":"2024-09-20T20:34:37.650888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":562,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657273+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:37.657273+0000","last_peered":"2024-09-20T20:34:37.657273+0000","last_clean":"2024-09-20T20:34:37.657273+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:37.657273+0000","last_undegraded":"2024-09-20T20:34:37.657273+0000","last_fullsized":"2024-09-20T20:34:37.657273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":549,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635321+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:40.635321+0000","last_peered":"2024-09-20T20:34:40.635321+0000","last_clean":"2024-09-20T20:34:40.635321+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:40.635321+0000","last_undegraded":"2024-09-20T20:34:40.635321+0000","last_fullsized":"2024-09-20T20:34:40.635321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":807,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655671+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:37.655671+0000","last_peered":"2024-09-20T20:34:37.655671+0000","last_clean":"2024-09-20T20:34:37.655671+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:37.655671+0000","last_undegraded":"2024-09-20T20:34:37.655671+0000","last_fullsized":"2024-09-20T20:34:37.655671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":529,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655223+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:37.655223+0000","last_peered":"2024-09-20T20:34:37.655223+0000","last_clean":"2024-09-20T20:34:37.655223+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:37.655223+0000","last_undegraded":"2024-09-20T20:34:37.655223+0000","last_fullsized":"2024-09-20T20:34:37.655223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":599,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633488+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:40.633488+0000","last_peered":"2024-09-20T20:34:40.633488+0000","last_clean":"2024-09-20T20:34:40.633488+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:40.633488+0000","last_undegraded":"2024-09-20T20:34:40.633488+0000","last_fullsized":"2024-09-20T20:34:40.633488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":694,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632459+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:40.632459+0000","last_peered":"2024-09-20T20:34:40.632459+0000","last_clean":"2024-09-20T20:34:40.632459+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:40.632459+0000","last_undegraded":"2024-09-20T20:34:40.632459+0000","last_fullsized":"2024-09-20T20:34:40.632459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":612,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635336+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:40.635336+0000","last_peered":"2024-09-20T20:34:40.635336+0000","last_clean":"2024-09-20T20:34:40.635336+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:40.635336+0000","last_undegraded":"2024-09-20T20:34:40.635336+0000","last_fullsized":"2024-09-20T20:34:40.635336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":605,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652230+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:37.652230+0000","last_peered":"2024-09-20T20:34:37.652230+0000","last_clean":"2024-09-20T20:34:37.652230+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:37.652230+0000","last_undegraded":"2024-09-20T20:34:37.652230+0000","last_fullsized":"2024-09-20T20:34:37.652230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657647+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:37.657647+0000","last_peered":"2024-09-20T20:34:37.657647+0000","last_clean":"2024-09-20T20:34:37.657647+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:37.657647+0000","last_undegraded":"2024-09-20T20:34:37.657647+0000","last_fullsized":"2024-09-20T20:34:37.657647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":636,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655726+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:37.655726+0000","last_peered":"2024-09-20T20:34:37.655726+0000","last_clean":"2024-09-20T20:34:37.655726+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:37.655726+0000","last_undegraded":"2024-09-20T20:34:37.655726+0000","last_fullsized":"2024-09-20T20:34:37.655726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":611,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634099+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:40.634099+0000","last_peered":"2024-09-20T20:34:40.634099+0000","last_clean":"2024-09-20T20:34:40.634099+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:40.634099+0000","last_undegraded":"2024-09-20T20:34:40.634099+0000","last_fullsized":"2024-09-20T20:34:40.634099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":573,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.631604+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:40.631604+0000","last_peered":"2024-09-20T20:34:40.631604+0000","last_clean":"2024-09-20T20:34:40.631604+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:40.631604+0000","last_undegraded":"2024-09-20T20:34:40.631604+0000","last_fullsized":"2024-09-20T20:34:40.631604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":784,"reported_epoch":90,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-20T20:34:37.733956+0000","last_change":"2024-09-20T20:34:37.495264+0000","last_active":"2024-09-20T20:34:37.733956+0000","last_peered":"2024-09-20T20:34:37.733956+0000","last_clean":"2024-09-20T20:31:51.184225+0000","last_became_active":"2024-09-20T20:34:26.683873+0000","last_became_peered":"2024-09-20T20:34:26.683873+0000","last_unstale":"2024-09-20T20:34:37.733956+0000","last_undegraded":"2024-09-20T20:34:37.733956+0000","last_fullsized":"2024-09-20T20:34:26.677143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1000,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649078+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:37.649078+0000","last_peered":"2024-09-20T20:34:37.649078+0000","last_clean":"2024-09-20T20:34:37.649078+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:37.649078+0000","last_undegraded":"2024-09-20T20:34:37.649078+0000","last_fullsized":"2024-09-20T20:34:37.649078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":684,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653580+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:37.653580+0000","last_peered":"2024-09-20T20:34:37.653580+0000","last_clean":"2024-09-20T20:34:37.653580+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:37.653580+0000","last_undegraded":"2024-09-20T20:34:37.653580+0000","last_fullsized":"2024-09-20T20:34:37.653580+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":919,"reported_epoch":89,"state":"peering","last_fresh":"2024-09-20T20:34:36.900241+0000","last_change":"2024-09-20T20:34:37.656193+0000","last_active":"2024-09-20T20:34:37.656193+0000","last_peered":"2024-09-20T20:34:36.900241+0000","last_clean":"2024-09-20T20:31:51.129241+0000","last_became_active":"2024-09-20T20:34:26.682699+0000","last_became_peered":"2024-09-20T20:34:26.682699+0000","last_unstale":"2024-09-20T20:34:36.900241+0000","last_undegraded":"2024-09-20T20:34:36.900241+0000","last_fullsized":"2024-09-20T20:34:26.675708+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1075,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652190+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:37.652190+0000","last_peered":"2024-09-20T20:34:37.652190+0000","last_clean":"2024-09-20T20:34:37.652190+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:37.652190+0000","last_undegraded":"2024-09-20T20:34:37.652190+0000","last_fullsized":"2024-09-20T20:34:37.652190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":624,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635213+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:40.635213+0000","last_peered":"2024-09-20T20:34:40.635213+0000","last_clean":"2024-09-20T20:34:40.635213+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:40.635213+0000","last_undegraded":"2024-09-20T20:34:40.635213+0000","last_fullsized":"2024-09-20T20:34:40.635213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":925,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656372+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:37.656372+0000","last_peered":"2024-09-20T20:34:37.656372+0000","last_clean":"2024-09-20T20:34:37.656372+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:37.656372+0000","last_undegraded":"2024-09-20T20:34:37.656372+0000","last_fullsized":"2024-09-20T20:34:37.656372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":649,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650072+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:37.650072+0000","last_peered":"2024-09-20T20:34:37.650072+0000","last_clean":"2024-09-20T20:34:37.650072+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:37.650072+0000","last_undegraded":"2024-09-20T20:34:37.650072+0000","last_fullsized":"2024-09-20T20:34:37.650072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":624,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.654822+0000","last_change":"2024-09-20T20:34:26.704756+0000","last_active":"2024-09-20T20:34:37.654822+0000","last_peered":"2024-09-20T20:34:37.654822+0000","last_clean":"2024-09-20T20:31:51.179186+0000","last_became_active":"2024-09-20T20:34:26.700667+0000","last_became_peered":"2024-09-20T20:34:26.700667+0000","last_unstale":"2024-09-20T20:34:37.654822+0000","last_undegraded":"2024-09-20T20:34:26.682148+0000","last_fullsized":"2024-09-20T20:34:26.679653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":610,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649231+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:37.649231+0000","last_peered":"2024-09-20T20:34:37.649231+0000","last_clean":"2024-09-20T20:34:37.649231+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:37.649231+0000","last_undegraded":"2024-09-20T20:34:37.649231+0000","last_fullsized":"2024-09-20T20:34:37.649231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":601,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.650356+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:37.650356+0000","last_peered":"2024-09-20T20:34:37.650356+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:37.650356+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":487,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656162+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:37.656162+0000","last_peered":"2024-09-20T20:34:37.656162+0000","last_clean":"2024-09-20T20:34:37.656162+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:37.656162+0000","last_undegraded":"2024-09-20T20:34:37.656162+0000","last_fullsized":"2024-09-20T20:34:37.656162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":563,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633432+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:40.633432+0000","last_peered":"2024-09-20T20:34:40.633432+0000","last_clean":"2024-09-20T20:34:40.633432+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:40.633432+0000","last_undegraded":"2024-09-20T20:34:40.633432+0000","last_fullsized":"2024-09-20T20:34:40.633432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":525,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656489+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:37.656489+0000","last_peered":"2024-09-20T20:34:37.656489+0000","last_clean":"2024-09-20T20:34:37.656489+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:37.656489+0000","last_undegraded":"2024-09-20T20:34:37.656489+0000","last_fullsized":"2024-09-20T20:34:37.656489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649980+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:37.649980+0000","last_peered":"2024-09-20T20:34:37.649980+0000","last_clean":"2024-09-20T20:34:37.649980+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:37.649980+0000","last_undegraded":"2024-09-20T20:34:37.649980+0000","last_fullsized":"2024-09-20T20:34:37.649980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":992,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.659022+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:37.659022+0000","last_peered":"2024-09-20T20:34:37.659022+0000","last_clean":"2024-09-20T20:34:37.659022+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:37.659022+0000","last_undegraded":"2024-09-20T20:34:37.659022+0000","last_fullsized":"2024-09-20T20:34:37.659022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":230,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654334+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:37.654334+0000","last_peered":"2024-09-20T20:34:37.654334+0000","last_clean":"2024-09-20T20:34:37.654334+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:37.654334+0000","last_undegraded":"2024-09-20T20:34:37.654334+0000","last_fullsized":"2024-09-20T20:34:37.654334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":632,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.651072+0000","last_change":"2024-09-20T20:34:19.225616+0000","last_active":"2024-09-20T20:34:37.651072+0000","last_peered":"2024-09-20T20:34:37.651072+0000","last_clean":"2024-09-20T20:31:51.195638+0000","last_became_active":"2024-09-20T20:34:18.889264+0000","last_became_peered":"2024-09-20T20:34:18.889264+0000","last_unstale":"2024-09-20T20:34:37.651072+0000","last_undegraded":"2024-09-20T20:34:19.225278+0000","last_fullsized":"2024-09-20T20:34:18.651936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633780+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:40.633780+0000","last_peered":"2024-09-20T20:34:40.633780+0000","last_clean":"2024-09-20T20:34:40.633780+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:40.633780+0000","last_undegraded":"2024-09-20T20:34:40.633780+0000","last_fullsized":"2024-09-20T20:34:40.633780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":213,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635542+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:40.635542+0000","last_peered":"2024-09-20T20:34:40.635542+0000","last_clean":"2024-09-20T20:34:40.635542+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:40.635542+0000","last_undegraded":"2024-09-20T20:34:40.635542+0000","last_fullsized":"2024-09-20T20:34:40.635542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":898,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653718+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:37.653718+0000","last_peered":"2024-09-20T20:34:37.653718+0000","last_clean":"2024-09-20T20:34:37.653718+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:37.653718+0000","last_undegraded":"2024-09-20T20:34:37.653718+0000","last_fullsized":"2024-09-20T20:34:37.653718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":429,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657867+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:37.657867+0000","last_peered":"2024-09-20T20:34:37.657867+0000","last_clean":"2024-09-20T20:34:37.657867+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:37.657867+0000","last_undegraded":"2024-09-20T20:34:37.657867+0000","last_fullsized":"2024-09-20T20:34:37.657867+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":543,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654015+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:37.654015+0000","last_peered":"2024-09-20T20:34:37.654015+0000","last_clean":"2024-09-20T20:34:37.654015+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:37.654015+0000","last_undegraded":"2024-09-20T20:34:37.654015+0000","last_fullsized":"2024-09-20T20:34:37.654015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":565,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634877+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:40.634877+0000","last_peered":"2024-09-20T20:34:40.634877+0000","last_clean":"2024-09-20T20:34:40.634877+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:40.634877+0000","last_undegraded":"2024-09-20T20:34:40.634877+0000","last_fullsized":"2024-09-20T20:34:40.634877+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":631,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633749+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:40.633749+0000","last_peered":"2024-09-20T20:34:40.633749+0000","last_clean":"2024-09-20T20:34:40.633749+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:40.633749+0000","last_undegraded":"2024-09-20T20:34:40.633749+0000","last_fullsized":"2024-09-20T20:34:40.633749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633887+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:40.633887+0000","last_peered":"2024-09-20T20:34:40.633887+0000","last_clean":"2024-09-20T20:34:40.633887+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:40.633887+0000","last_undegraded":"2024-09-20T20:34:40.633887+0000","last_fullsized":"2024-09-20T20:34:40.633887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1064,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650197+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:37.650197+0000","last_peered":"2024-09-20T20:34:37.650197+0000","last_clean":"2024-09-20T20:34:37.650197+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:37.650197+0000","last_undegraded":"2024-09-20T20:34:37.650197+0000","last_fullsized":"2024-09-20T20:34:37.650197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":367,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650711+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:37.650711+0000","last_peered":"2024-09-20T20:34:37.650711+0000","last_clean":"2024-09-20T20:34:37.650711+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:37.650711+0000","last_undegraded":"2024-09-20T20:34:37.650711+0000","last_fullsized":"2024-09-20T20:34:37.650711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":603,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634343+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:40.634343+0000","last_peered":"2024-09-20T20:34:40.634343+0000","last_clean":"2024-09-20T20:34:40.634343+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:40.634343+0000","last_undegraded":"2024-09-20T20:34:40.634343+0000","last_fullsized":"2024-09-20T20:34:40.634343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":192,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632857+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:40.632857+0000","last_peered":"2024-09-20T20:34:40.632857+0000","last_clean":"2024-09-20T20:34:40.632857+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:40.632857+0000","last_undegraded":"2024-09-20T20:34:40.632857+0000","last_fullsized":"2024-09-20T20:34:40.632857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":574,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634581+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:40.634581+0000","last_peered":"2024-09-20T20:34:40.634581+0000","last_clean":"2024-09-20T20:34:40.634581+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:40.634581+0000","last_undegraded":"2024-09-20T20:34:40.634581+0000","last_fullsized":"2024-09-20T20:34:40.634581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654483+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:37.654483+0000","last_peered":"2024-09-20T20:34:37.654483+0000","last_clean":"2024-09-20T20:34:37.654483+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:37.654483+0000","last_undegraded":"2024-09-20T20:34:37.654483+0000","last_fullsized":"2024-09-20T20:34:37.654483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":601,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635660+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:40.635660+0000","last_peered":"2024-09-20T20:34:40.635660+0000","last_clean":"2024-09-20T20:34:40.635660+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:40.635660+0000","last_undegraded":"2024-09-20T20:34:40.635660+0000","last_fullsized":"2024-09-20T20:34:40.635660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":639,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653966+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:37.653966+0000","last_peered":"2024-09-20T20:34:37.653966+0000","last_clean":"2024-09-20T20:34:37.653966+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:37.653966+0000","last_undegraded":"2024-09-20T20:34:37.653966+0000","last_fullsized":"2024-09-20T20:34:37.653966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":587,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651244+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:37.651244+0000","last_peered":"2024-09-20T20:34:37.651244+0000","last_clean":"2024-09-20T20:34:37.651244+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:37.651244+0000","last_undegraded":"2024-09-20T20:34:37.651244+0000","last_fullsized":"2024-09-20T20:34:37.651244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633294+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:40.633294+0000","last_peered":"2024-09-20T20:34:40.633294+0000","last_clean":"2024-09-20T20:34:40.633294+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:40.633294+0000","last_undegraded":"2024-09-20T20:34:40.633294+0000","last_fullsized":"2024-09-20T20:34:40.633294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":89,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632789+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:40.632789+0000","last_peered":"2024-09-20T20:34:40.632789+0000","last_clean":"2024-09-20T20:34:40.632789+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:40.632789+0000","last_undegraded":"2024-09-20T20:34:40.632789+0000","last_fullsized":"2024-09-20T20:34:40.632789+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":718,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650167+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:37.650167+0000","last_peered":"2024-09-20T20:34:37.650167+0000","last_clean":"2024-09-20T20:34:37.650167+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:37.650167+0000","last_undegraded":"2024-09-20T20:34:37.650167+0000","last_fullsized":"2024-09-20T20:34:37.650167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":592,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635003+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:40.635003+0000","last_peered":"2024-09-20T20:34:40.635003+0000","last_clean":"2024-09-20T20:34:40.635003+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:40.635003+0000","last_undegraded":"2024-09-20T20:34:40.635003+0000","last_fullsized":"2024-09-20T20:34:40.635003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634940+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:40.634940+0000","last_peered":"2024-09-20T20:34:40.634940+0000","last_clean":"2024-09-20T20:34:40.634940+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:40.634940+0000","last_undegraded":"2024-09-20T20:34:40.634940+0000","last_fullsized":"2024-09-20T20:34:40.634940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":362,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650082+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:37.650082+0000","last_peered":"2024-09-20T20:34:37.650082+0000","last_clean":"2024-09-20T20:34:37.650082+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:37.650082+0000","last_undegraded":"2024-09-20T20:34:37.650082+0000","last_fullsized":"2024-09-20T20:34:37.650082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657850+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:37.657850+0000","last_peered":"2024-09-20T20:34:37.657850+0000","last_clean":"2024-09-20T20:34:37.657850+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:37.657850+0000","last_undegraded":"2024-09-20T20:34:37.657850+0000","last_fullsized":"2024-09-20T20:34:37.657850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650424+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:37.650424+0000","last_peered":"2024-09-20T20:34:37.650424+0000","last_clean":"2024-09-20T20:34:37.650424+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:37.650424+0000","last_undegraded":"2024-09-20T20:34:37.650424+0000","last_fullsized":"2024-09-20T20:34:37.650424+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":395,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654071+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:37.654071+0000","last_peered":"2024-09-20T20:34:37.654071+0000","last_clean":"2024-09-20T20:34:37.654071+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:37.654071+0000","last_undegraded":"2024-09-20T20:34:37.654071+0000","last_fullsized":"2024-09-20T20:34:37.654071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":549,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651568+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:37.651568+0000","last_peered":"2024-09-20T20:34:37.651568+0000","last_clean":"2024-09-20T20:34:37.651568+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:37.651568+0000","last_undegraded":"2024-09-20T20:34:37.651568+0000","last_fullsized":"2024-09-20T20:34:37.651568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632438+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:40.632438+0000","last_peered":"2024-09-20T20:34:40.632438+0000","last_clean":"2024-09-20T20:34:40.632438+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:40.632438+0000","last_undegraded":"2024-09-20T20:34:40.632438+0000","last_fullsized":"2024-09-20T20:34:40.632438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633112+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:40.633112+0000","last_peered":"2024-09-20T20:34:40.633112+0000","last_clean":"2024-09-20T20:34:40.633112+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:40.633112+0000","last_undegraded":"2024-09-20T20:34:40.633112+0000","last_fullsized":"2024-09-20T20:34:40.633112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":597,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651834+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:37.651834+0000","last_peered":"2024-09-20T20:34:37.651834+0000","last_clean":"2024-09-20T20:34:37.651834+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:37.651834+0000","last_undegraded":"2024-09-20T20:34:37.651834+0000","last_fullsized":"2024-09-20T20:34:37.651834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":323,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633075+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:40.633075+0000","last_peered":"2024-09-20T20:34:40.633075+0000","last_clean":"2024-09-20T20:34:40.633075+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:40.633075+0000","last_undegraded":"2024-09-20T20:34:40.633075+0000","last_fullsized":"2024-09-20T20:34:40.633075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652206+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:37.652206+0000","last_peered":"2024-09-20T20:34:37.652206+0000","last_clean":"2024-09-20T20:34:37.652206+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:37.652206+0000","last_undegraded":"2024-09-20T20:34:37.652206+0000","last_fullsized":"2024-09-20T20:34:37.652206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":832,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654592+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:37.654592+0000","last_peered":"2024-09-20T20:34:37.654592+0000","last_clean":"2024-09-20T20:34:37.654592+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:37.654592+0000","last_undegraded":"2024-09-20T20:34:37.654592+0000","last_fullsized":"2024-09-20T20:34:37.654592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":214,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652000+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:37.652000+0000","last_peered":"2024-09-20T20:34:37.652000+0000","last_clean":"2024-09-20T20:34:37.652000+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:37.652000+0000","last_undegraded":"2024-09-20T20:34:37.652000+0000","last_fullsized":"2024-09-20T20:34:37.652000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657264+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:37.657264+0000","last_peered":"2024-09-20T20:34:37.657264+0000","last_clean":"2024-09-20T20:34:37.657264+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:37.657264+0000","last_undegraded":"2024-09-20T20:34:37.657264+0000","last_fullsized":"2024-09-20T20:34:37.657264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":888,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655324+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:37.655324+0000","last_peered":"2024-09-20T20:34:37.655324+0000","last_clean":"2024-09-20T20:34:37.655324+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:37.655324+0000","last_undegraded":"2024-09-20T20:34:37.655324+0000","last_fullsized":"2024-09-20T20:34:37.655324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652551+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:37.652551+0000","last_peered":"2024-09-20T20:34:37.652551+0000","last_clean":"2024-09-20T20:34:37.652551+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:37.652551+0000","last_undegraded":"2024-09-20T20:34:37.652551+0000","last_fullsized":"2024-09-20T20:34:37.652551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653170+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:37.653170+0000","last_peered":"2024-09-20T20:34:37.653170+0000","last_clean":"2024-09-20T20:34:37.653170+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:37.653170+0000","last_undegraded":"2024-09-20T20:34:37.653170+0000","last_fullsized":"2024-09-20T20:34:37.653170+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":706,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.651554+0000","last_change":"2024-09-20T20:34:18.940279+0000","last_active":"2024-09-20T20:34:37.651554+0000","last_peered":"2024-09-20T20:34:37.651554+0000","last_clean":"2024-09-20T20:31:51.202703+0000","last_became_active":"2024-09-20T20:34:18.934354+0000","last_became_peered":"2024-09-20T20:34:18.934354+0000","last_unstale":"2024-09-20T20:34:37.651554+0000","last_undegraded":"2024-09-20T20:34:18.689916+0000","last_fullsized":"2024-09-20T20:34:18.683789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653000+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:37.653000+0000","last_peered":"2024-09-20T20:34:37.653000+0000","last_clean":"2024-09-20T20:34:37.653000+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:37.653000+0000","last_undegraded":"2024-09-20T20:34:37.653000+0000","last_fullsized":"2024-09-20T20:34:37.653000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635079+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:40.635079+0000","last_peered":"2024-09-20T20:34:40.635079+0000","last_clean":"2024-09-20T20:34:40.635079+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:40.635079+0000","last_undegraded":"2024-09-20T20:34:40.635079+0000","last_fullsized":"2024-09-20T20:34:40.635079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":926,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654299+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:37.654299+0000","last_peered":"2024-09-20T20:34:37.654299+0000","last_clean":"2024-09-20T20:34:37.654299+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:37.654299+0000","last_undegraded":"2024-09-20T20:34:37.654299+0000","last_fullsized":"2024-09-20T20:34:37.654299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":570,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633892+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:40.633892+0000","last_peered":"2024-09-20T20:34:40.633892+0000","last_clean":"2024-09-20T20:34:40.633892+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:40.633892+0000","last_undegraded":"2024-09-20T20:34:40.633892+0000","last_fullsized":"2024-09-20T20:34:40.633892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":433,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632877+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:40.632877+0000","last_peered":"2024-09-20T20:34:40.632877+0000","last_clean":"2024-09-20T20:34:40.632877+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:40.632877+0000","last_undegraded":"2024-09-20T20:34:40.632877+0000","last_fullsized":"2024-09-20T20:34:40.632877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":581,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649647+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:37.649647+0000","last_peered":"2024-09-20T20:34:37.649647+0000","last_clean":"2024-09-20T20:34:37.649647+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:37.649647+0000","last_undegraded":"2024-09-20T20:34:37.649647+0000","last_fullsized":"2024-09-20T20:34:37.649647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":258,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657034+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:37.657034+0000","last_peered":"2024-09-20T20:34:37.657034+0000","last_clean":"2024-09-20T20:34:37.657034+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:37.657034+0000","last_undegraded":"2024-09-20T20:34:37.657034+0000","last_fullsized":"2024-09-20T20:34:37.657034+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":268,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635218+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:40.635218+0000","last_peered":"2024-09-20T20:34:40.635218+0000","last_clean":"2024-09-20T20:34:40.635218+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:40.635218+0000","last_undegraded":"2024-09-20T20:34:40.635218+0000","last_fullsized":"2024-09-20T20:34:40.635218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1078,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650042+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:37.650042+0000","last_peered":"2024-09-20T20:34:37.650042+0000","last_clean":"2024-09-20T20:34:37.650042+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:37.650042+0000","last_undegraded":"2024-09-20T20:34:37.650042+0000","last_fullsized":"2024-09-20T20:34:37.650042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652058+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:37.652058+0000","last_peered":"2024-09-20T20:34:37.652058+0000","last_clean":"2024-09-20T20:34:37.652058+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:37.652058+0000","last_undegraded":"2024-09-20T20:34:37.652058+0000","last_fullsized":"2024-09-20T20:34:37.652058+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":666,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651391+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:37.651391+0000","last_peered":"2024-09-20T20:34:37.651391+0000","last_clean":"2024-09-20T20:34:37.651391+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:37.651391+0000","last_undegraded":"2024-09-20T20:34:37.651391+0000","last_fullsized":"2024-09-20T20:34:37.651391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":836,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.663406+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:37.663406+0000","last_peered":"2024-09-20T20:34:37.663406+0000","last_clean":"2024-09-20T20:34:37.663406+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:37.663406+0000","last_undegraded":"2024-09-20T20:34:37.663406+0000","last_fullsized":"2024-09-20T20:34:37.663406+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":856,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651733+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:37.651733+0000","last_peered":"2024-09-20T20:34:37.651733+0000","last_clean":"2024-09-20T20:34:37.651733+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:37.651733+0000","last_undegraded":"2024-09-20T20:34:37.651733+0000","last_fullsized":"2024-09-20T20:34:37.651733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":935,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652697+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:37.652697+0000","last_peered":"2024-09-20T20:34:37.652697+0000","last_clean":"2024-09-20T20:34:37.652697+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:37.652697+0000","last_undegraded":"2024-09-20T20:34:37.652697+0000","last_fullsized":"2024-09-20T20:34:37.652697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":354,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649750+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:37.649750+0000","last_peered":"2024-09-20T20:34:37.649750+0000","last_clean":"2024-09-20T20:34:37.649750+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:37.649750+0000","last_undegraded":"2024-09-20T20:34:37.649750+0000","last_fullsized":"2024-09-20T20:34:37.649750+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":955,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656555+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:37.656555+0000","last_peered":"2024-09-20T20:34:37.656555+0000","last_clean":"2024-09-20T20:34:37.656555+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:37.656555+0000","last_undegraded":"2024-09-20T20:34:37.656555+0000","last_fullsized":"2024-09-20T20:34:37.656555+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":316,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655100+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:37.655100+0000","last_peered":"2024-09-20T20:34:37.655100+0000","last_clean":"2024-09-20T20:34:37.655100+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:37.655100+0000","last_undegraded":"2024-09-20T20:34:37.655100+0000","last_fullsized":"2024-09-20T20:34:37.655100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":528,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655674+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:37.655674+0000","last_peered":"2024-09-20T20:34:37.655674+0000","last_clean":"2024-09-20T20:34:37.655674+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:37.655674+0000","last_undegraded":"2024-09-20T20:34:37.655674+0000","last_fullsized":"2024-09-20T20:34:37.655674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":225,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655777+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:37.655777+0000","last_peered":"2024-09-20T20:34:37.655777+0000","last_clean":"2024-09-20T20:34:37.655777+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:37.655777+0000","last_undegraded":"2024-09-20T20:34:37.655777+0000","last_fullsized":"2024-09-20T20:34:37.655777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":558,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635840+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:40.635840+0000","last_peered":"2024-09-20T20:34:40.635840+0000","last_clean":"2024-09-20T20:34:40.635840+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:40.635840+0000","last_undegraded":"2024-09-20T20:34:40.635840+0000","last_fullsized":"2024-09-20T20:34:40.635840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":366,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633181+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:40.633181+0000","last_peered":"2024-09-20T20:34:40.633181+0000","last_clean":"2024-09-20T20:34:40.633181+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:40.633181+0000","last_undegraded":"2024-09-20T20:34:40.633181+0000","last_fullsized":"2024-09-20T20:34:40.633181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":574,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633138+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:40.633138+0000","last_peered":"2024-09-20T20:34:40.633138+0000","last_clean":"2024-09-20T20:34:40.633138+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:40.633138+0000","last_undegraded":"2024-09-20T20:34:40.633138+0000","last_fullsized":"2024-09-20T20:34:40.633138+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":442,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656777+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:37.656777+0000","last_peered":"2024-09-20T20:34:37.656777+0000","last_clean":"2024-09-20T20:34:37.656777+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:37.656777+0000","last_undegraded":"2024-09-20T20:34:37.656777+0000","last_fullsized":"2024-09-20T20:34:37.656777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":604,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654606+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:37.654606+0000","last_peered":"2024-09-20T20:34:37.654606+0000","last_clean":"2024-09-20T20:34:37.654606+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:37.654606+0000","last_undegraded":"2024-09-20T20:34:37.654606+0000","last_fullsized":"2024-09-20T20:34:37.654606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652846+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:37.652846+0000","last_peered":"2024-09-20T20:34:37.652846+0000","last_clean":"2024-09-20T20:34:37.652846+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:37.652846+0000","last_undegraded":"2024-09-20T20:34:37.652846+0000","last_fullsized":"2024-09-20T20:34:37.652846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":581,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.642728+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:40.642728+0000","last_peered":"2024-09-20T20:34:40.642728+0000","last_clean":"2024-09-20T20:34:40.642728+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:40.642728+0000","last_undegraded":"2024-09-20T20:34:40.642728+0000","last_fullsized":"2024-09-20T20:34:40.642728+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651780+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:37.651780+0000","last_peered":"2024-09-20T20:34:37.651780+0000","last_clean":"2024-09-20T20:34:37.651780+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:37.651780+0000","last_undegraded":"2024-09-20T20:34:37.651780+0000","last_fullsized":"2024-09-20T20:34:37.651780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5769,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":739717,"data_compressed":113351,"data_compressed_allocated":135168,"data_compressed_original":319488,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":123,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99284,"kb_used_data":27900,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272556,"statfs":{"total":96636764160,"available":96535097344,"internally_reserved":0,"allocated":28569600,"data_stored":81543880,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104300,"kb_used_data":28756,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267540,"statfs":{"total":96636764160,"available":96529960960,"internally_reserved":0,"allocated":29446144,"data_stored":85083621,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58516,"kb_used_data":24824,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94313324,"statfs":{"total":96636764160,"available":96576843776,"internally_reserved":0,"allocated":25419776,"data_stored":93138811,"data_compressed":14065308,"data_compressed_allocated":17244160,"data_compressed_original":85942272,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":739717,"data_compressed":113351,"data_compressed_allocated":135168,"data_compressed_original":319488,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:42.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-20T20:34:42.769 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:42.770 INFO:teuthology.orchestra.run.smithi070.stdout:{"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 684/114 objects degraded (600.000%), 4 pgs degraded","count":4},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":310,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":3,"num_up_osds":3,"osd_up_since":1726864456,"num_in_osds":3,"osd_in_since":1726864173,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":98},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128120423,"bytes_used":268390400,"bytes_avail":289641902080,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":684,"degraded_total":114,"degraded_ratio":6,"recovering_objects_per_sec":391,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1566,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-20T20:31:03.624405+0000","services":{}},"progress_events":{}} 2024-09-20T20:34:42.788 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-20T20:34:42.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:43.099 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:43.117 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-09-20T20:34:42.668621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5783,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":205,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":262100,"kb_used_data":81480,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282853420,"statfs":{"total":289910292480,"available":289641902080,"internally_reserved":0,"allocated":83435520,"data_stored":259766312,"data_compressed":37788283,"data_compressed_allocated":48537600,"data_compressed_original":226779136,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-497,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":513,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019123"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.658232+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:37.658232+0000","last_peered":"2024-09-20T20:34:37.658232+0000","last_clean":"2024-09-20T20:34:37.658232+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:37.658232+0000","last_undegraded":"2024-09-20T20:34:37.658232+0000","last_fullsized":"2024-09-20T20:34:37.658232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":659,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657109+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:37.657109+0000","last_peered":"2024-09-20T20:34:37.657109+0000","last_clean":"2024-09-20T20:34:37.657109+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:37.657109+0000","last_undegraded":"2024-09-20T20:34:37.657109+0000","last_fullsized":"2024-09-20T20:34:37.657109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635579+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:40.635579+0000","last_peered":"2024-09-20T20:34:40.635579+0000","last_clean":"2024-09-20T20:34:40.635579+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:40.635579+0000","last_undegraded":"2024-09-20T20:34:40.635579+0000","last_fullsized":"2024-09-20T20:34:40.635579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":559,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633524+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:40.633524+0000","last_peered":"2024-09-20T20:34:40.633524+0000","last_clean":"2024-09-20T20:34:40.633524+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:40.633524+0000","last_undegraded":"2024-09-20T20:34:40.633524+0000","last_fullsized":"2024-09-20T20:34:40.633524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":509,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655753+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:37.655753+0000","last_peered":"2024-09-20T20:34:37.655753+0000","last_clean":"2024-09-20T20:34:37.655753+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:37.655753+0000","last_undegraded":"2024-09-20T20:34:37.655753+0000","last_fullsized":"2024-09-20T20:34:37.655753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":577,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633512+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:40.633512+0000","last_peered":"2024-09-20T20:34:40.633512+0000","last_clean":"2024-09-20T20:34:40.633512+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:40.633512+0000","last_undegraded":"2024-09-20T20:34:40.633512+0000","last_fullsized":"2024-09-20T20:34:40.633512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":622,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632527+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:40.632527+0000","last_peered":"2024-09-20T20:34:40.632527+0000","last_clean":"2024-09-20T20:34:40.632527+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:40.632527+0000","last_undegraded":"2024-09-20T20:34:40.632527+0000","last_fullsized":"2024-09-20T20:34:40.632527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":574,"reported_epoch":93,"state":"peering","last_fresh":"2024-09-20T20:34:40.632445+0000","last_change":"2024-09-20T20:34:40.632445+0000","last_active":"2024-09-20T20:34:17.643078+0000","last_peered":"2024-09-20T20:34:15.791607+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:31:52.246684+0000","last_became_peered":"2024-09-20T20:31:52.246684+0000","last_unstale":"2024-09-20T20:34:40.632445+0000","last_undegraded":"2024-09-20T20:34:40.632445+0000","last_fullsized":"2024-09-20T20:34:40.632445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":576,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650888+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:37.650888+0000","last_peered":"2024-09-20T20:34:37.650888+0000","last_clean":"2024-09-20T20:34:37.650888+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:37.650888+0000","last_undegraded":"2024-09-20T20:34:37.650888+0000","last_fullsized":"2024-09-20T20:34:37.650888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":562,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657273+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:37.657273+0000","last_peered":"2024-09-20T20:34:37.657273+0000","last_clean":"2024-09-20T20:34:37.657273+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:37.657273+0000","last_undegraded":"2024-09-20T20:34:37.657273+0000","last_fullsized":"2024-09-20T20:34:37.657273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":549,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635321+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:40.635321+0000","last_peered":"2024-09-20T20:34:40.635321+0000","last_clean":"2024-09-20T20:34:40.635321+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:40.635321+0000","last_undegraded":"2024-09-20T20:34:40.635321+0000","last_fullsized":"2024-09-20T20:34:40.635321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":807,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655671+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:37.655671+0000","last_peered":"2024-09-20T20:34:37.655671+0000","last_clean":"2024-09-20T20:34:37.655671+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:37.655671+0000","last_undegraded":"2024-09-20T20:34:37.655671+0000","last_fullsized":"2024-09-20T20:34:37.655671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":529,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655223+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:37.655223+0000","last_peered":"2024-09-20T20:34:37.655223+0000","last_clean":"2024-09-20T20:34:37.655223+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:37.655223+0000","last_undegraded":"2024-09-20T20:34:37.655223+0000","last_fullsized":"2024-09-20T20:34:37.655223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":599,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633488+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:40.633488+0000","last_peered":"2024-09-20T20:34:40.633488+0000","last_clean":"2024-09-20T20:34:40.633488+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:40.633488+0000","last_undegraded":"2024-09-20T20:34:40.633488+0000","last_fullsized":"2024-09-20T20:34:40.633488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":694,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632459+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:40.632459+0000","last_peered":"2024-09-20T20:34:40.632459+0000","last_clean":"2024-09-20T20:34:40.632459+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:40.632459+0000","last_undegraded":"2024-09-20T20:34:40.632459+0000","last_fullsized":"2024-09-20T20:34:40.632459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":612,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635336+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:40.635336+0000","last_peered":"2024-09-20T20:34:40.635336+0000","last_clean":"2024-09-20T20:34:40.635336+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:40.635336+0000","last_undegraded":"2024-09-20T20:34:40.635336+0000","last_fullsized":"2024-09-20T20:34:40.635336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":605,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652230+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:37.652230+0000","last_peered":"2024-09-20T20:34:37.652230+0000","last_clean":"2024-09-20T20:34:37.652230+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:37.652230+0000","last_undegraded":"2024-09-20T20:34:37.652230+0000","last_fullsized":"2024-09-20T20:34:37.652230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":623,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657647+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:37.657647+0000","last_peered":"2024-09-20T20:34:37.657647+0000","last_clean":"2024-09-20T20:34:37.657647+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:37.657647+0000","last_undegraded":"2024-09-20T20:34:37.657647+0000","last_fullsized":"2024-09-20T20:34:37.657647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":636,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655726+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:37.655726+0000","last_peered":"2024-09-20T20:34:37.655726+0000","last_clean":"2024-09-20T20:34:37.655726+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:37.655726+0000","last_undegraded":"2024-09-20T20:34:37.655726+0000","last_fullsized":"2024-09-20T20:34:37.655726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":611,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634099+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:40.634099+0000","last_peered":"2024-09-20T20:34:40.634099+0000","last_clean":"2024-09-20T20:34:40.634099+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:40.634099+0000","last_undegraded":"2024-09-20T20:34:40.634099+0000","last_fullsized":"2024-09-20T20:34:40.634099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":573,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.631604+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:40.631604+0000","last_peered":"2024-09-20T20:34:40.631604+0000","last_clean":"2024-09-20T20:34:40.631604+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:40.631604+0000","last_undegraded":"2024-09-20T20:34:40.631604+0000","last_fullsized":"2024-09-20T20:34:40.631604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":784,"reported_epoch":90,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-20T20:34:37.733956+0000","last_change":"2024-09-20T20:34:37.495264+0000","last_active":"2024-09-20T20:34:37.733956+0000","last_peered":"2024-09-20T20:34:37.733956+0000","last_clean":"2024-09-20T20:31:51.184225+0000","last_became_active":"2024-09-20T20:34:26.683873+0000","last_became_peered":"2024-09-20T20:34:26.683873+0000","last_unstale":"2024-09-20T20:34:37.733956+0000","last_undegraded":"2024-09-20T20:34:37.733956+0000","last_fullsized":"2024-09-20T20:34:26.677143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1000,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649078+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:37.649078+0000","last_peered":"2024-09-20T20:34:37.649078+0000","last_clean":"2024-09-20T20:34:37.649078+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:37.649078+0000","last_undegraded":"2024-09-20T20:34:37.649078+0000","last_fullsized":"2024-09-20T20:34:37.649078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":684,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653580+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:37.653580+0000","last_peered":"2024-09-20T20:34:37.653580+0000","last_clean":"2024-09-20T20:34:37.653580+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:37.653580+0000","last_undegraded":"2024-09-20T20:34:37.653580+0000","last_fullsized":"2024-09-20T20:34:37.653580+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":919,"reported_epoch":89,"state":"peering","last_fresh":"2024-09-20T20:34:36.900241+0000","last_change":"2024-09-20T20:34:37.656193+0000","last_active":"2024-09-20T20:34:37.656193+0000","last_peered":"2024-09-20T20:34:36.900241+0000","last_clean":"2024-09-20T20:31:51.129241+0000","last_became_active":"2024-09-20T20:34:26.682699+0000","last_became_peered":"2024-09-20T20:34:26.682699+0000","last_unstale":"2024-09-20T20:34:36.900241+0000","last_undegraded":"2024-09-20T20:34:36.900241+0000","last_fullsized":"2024-09-20T20:34:26.675708+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1075,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652190+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:37.652190+0000","last_peered":"2024-09-20T20:34:37.652190+0000","last_clean":"2024-09-20T20:34:37.652190+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:37.652190+0000","last_undegraded":"2024-09-20T20:34:37.652190+0000","last_fullsized":"2024-09-20T20:34:37.652190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":624,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635213+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:40.635213+0000","last_peered":"2024-09-20T20:34:40.635213+0000","last_clean":"2024-09-20T20:34:40.635213+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:40.635213+0000","last_undegraded":"2024-09-20T20:34:40.635213+0000","last_fullsized":"2024-09-20T20:34:40.635213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":925,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656372+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:37.656372+0000","last_peered":"2024-09-20T20:34:37.656372+0000","last_clean":"2024-09-20T20:34:37.656372+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:37.656372+0000","last_undegraded":"2024-09-20T20:34:37.656372+0000","last_fullsized":"2024-09-20T20:34:37.656372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":649,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650072+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:37.650072+0000","last_peered":"2024-09-20T20:34:37.650072+0000","last_clean":"2024-09-20T20:34:37.650072+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:37.650072+0000","last_undegraded":"2024-09-20T20:34:37.650072+0000","last_fullsized":"2024-09-20T20:34:37.650072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":624,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.654822+0000","last_change":"2024-09-20T20:34:26.704756+0000","last_active":"2024-09-20T20:34:37.654822+0000","last_peered":"2024-09-20T20:34:37.654822+0000","last_clean":"2024-09-20T20:31:51.179186+0000","last_became_active":"2024-09-20T20:34:26.700667+0000","last_became_peered":"2024-09-20T20:34:26.700667+0000","last_unstale":"2024-09-20T20:34:37.654822+0000","last_undegraded":"2024-09-20T20:34:26.682148+0000","last_fullsized":"2024-09-20T20:34:26.679653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":610,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649231+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:37.649231+0000","last_peered":"2024-09-20T20:34:37.649231+0000","last_clean":"2024-09-20T20:34:37.649231+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:37.649231+0000","last_undegraded":"2024-09-20T20:34:37.649231+0000","last_fullsized":"2024-09-20T20:34:37.649231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":601,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.650356+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:37.650356+0000","last_peered":"2024-09-20T20:34:37.650356+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:37.650356+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":487,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656162+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:37.656162+0000","last_peered":"2024-09-20T20:34:37.656162+0000","last_clean":"2024-09-20T20:34:37.656162+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:37.656162+0000","last_undegraded":"2024-09-20T20:34:37.656162+0000","last_fullsized":"2024-09-20T20:34:37.656162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":563,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633432+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:40.633432+0000","last_peered":"2024-09-20T20:34:40.633432+0000","last_clean":"2024-09-20T20:34:40.633432+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:40.633432+0000","last_undegraded":"2024-09-20T20:34:40.633432+0000","last_fullsized":"2024-09-20T20:34:40.633432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":525,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656489+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:37.656489+0000","last_peered":"2024-09-20T20:34:37.656489+0000","last_clean":"2024-09-20T20:34:37.656489+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:37.656489+0000","last_undegraded":"2024-09-20T20:34:37.656489+0000","last_fullsized":"2024-09-20T20:34:37.656489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649980+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:37.649980+0000","last_peered":"2024-09-20T20:34:37.649980+0000","last_clean":"2024-09-20T20:34:37.649980+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:37.649980+0000","last_undegraded":"2024-09-20T20:34:37.649980+0000","last_fullsized":"2024-09-20T20:34:37.649980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":992,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.659022+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:37.659022+0000","last_peered":"2024-09-20T20:34:37.659022+0000","last_clean":"2024-09-20T20:34:37.659022+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:37.659022+0000","last_undegraded":"2024-09-20T20:34:37.659022+0000","last_fullsized":"2024-09-20T20:34:37.659022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":230,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654334+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:37.654334+0000","last_peered":"2024-09-20T20:34:37.654334+0000","last_clean":"2024-09-20T20:34:37.654334+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:37.654334+0000","last_undegraded":"2024-09-20T20:34:37.654334+0000","last_fullsized":"2024-09-20T20:34:37.654334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":632,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.651072+0000","last_change":"2024-09-20T20:34:19.225616+0000","last_active":"2024-09-20T20:34:37.651072+0000","last_peered":"2024-09-20T20:34:37.651072+0000","last_clean":"2024-09-20T20:31:51.195638+0000","last_became_active":"2024-09-20T20:34:18.889264+0000","last_became_peered":"2024-09-20T20:34:18.889264+0000","last_unstale":"2024-09-20T20:34:37.651072+0000","last_undegraded":"2024-09-20T20:34:19.225278+0000","last_fullsized":"2024-09-20T20:34:18.651936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633780+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:40.633780+0000","last_peered":"2024-09-20T20:34:40.633780+0000","last_clean":"2024-09-20T20:34:40.633780+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:40.633780+0000","last_undegraded":"2024-09-20T20:34:40.633780+0000","last_fullsized":"2024-09-20T20:34:40.633780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":213,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635542+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:40.635542+0000","last_peered":"2024-09-20T20:34:40.635542+0000","last_clean":"2024-09-20T20:34:40.635542+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:40.635542+0000","last_undegraded":"2024-09-20T20:34:40.635542+0000","last_fullsized":"2024-09-20T20:34:40.635542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":898,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653718+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:37.653718+0000","last_peered":"2024-09-20T20:34:37.653718+0000","last_clean":"2024-09-20T20:34:37.653718+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:37.653718+0000","last_undegraded":"2024-09-20T20:34:37.653718+0000","last_fullsized":"2024-09-20T20:34:37.653718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":429,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657867+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:37.657867+0000","last_peered":"2024-09-20T20:34:37.657867+0000","last_clean":"2024-09-20T20:34:37.657867+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:37.657867+0000","last_undegraded":"2024-09-20T20:34:37.657867+0000","last_fullsized":"2024-09-20T20:34:37.657867+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":543,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654015+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:37.654015+0000","last_peered":"2024-09-20T20:34:37.654015+0000","last_clean":"2024-09-20T20:34:37.654015+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:37.654015+0000","last_undegraded":"2024-09-20T20:34:37.654015+0000","last_fullsized":"2024-09-20T20:34:37.654015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":565,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634877+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:40.634877+0000","last_peered":"2024-09-20T20:34:40.634877+0000","last_clean":"2024-09-20T20:34:40.634877+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:40.634877+0000","last_undegraded":"2024-09-20T20:34:40.634877+0000","last_fullsized":"2024-09-20T20:34:40.634877+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":631,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633749+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:40.633749+0000","last_peered":"2024-09-20T20:34:40.633749+0000","last_clean":"2024-09-20T20:34:40.633749+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:40.633749+0000","last_undegraded":"2024-09-20T20:34:40.633749+0000","last_fullsized":"2024-09-20T20:34:40.633749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633887+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:40.633887+0000","last_peered":"2024-09-20T20:34:40.633887+0000","last_clean":"2024-09-20T20:34:40.633887+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:40.633887+0000","last_undegraded":"2024-09-20T20:34:40.633887+0000","last_fullsized":"2024-09-20T20:34:40.633887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1064,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650197+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:37.650197+0000","last_peered":"2024-09-20T20:34:37.650197+0000","last_clean":"2024-09-20T20:34:37.650197+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:37.650197+0000","last_undegraded":"2024-09-20T20:34:37.650197+0000","last_fullsized":"2024-09-20T20:34:37.650197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":367,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650711+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:37.650711+0000","last_peered":"2024-09-20T20:34:37.650711+0000","last_clean":"2024-09-20T20:34:37.650711+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:37.650711+0000","last_undegraded":"2024-09-20T20:34:37.650711+0000","last_fullsized":"2024-09-20T20:34:37.650711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":603,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634343+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:40.634343+0000","last_peered":"2024-09-20T20:34:40.634343+0000","last_clean":"2024-09-20T20:34:40.634343+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:40.634343+0000","last_undegraded":"2024-09-20T20:34:40.634343+0000","last_fullsized":"2024-09-20T20:34:40.634343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":192,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632857+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:40.632857+0000","last_peered":"2024-09-20T20:34:40.632857+0000","last_clean":"2024-09-20T20:34:40.632857+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:40.632857+0000","last_undegraded":"2024-09-20T20:34:40.632857+0000","last_fullsized":"2024-09-20T20:34:40.632857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":574,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634581+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:40.634581+0000","last_peered":"2024-09-20T20:34:40.634581+0000","last_clean":"2024-09-20T20:34:40.634581+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:40.634581+0000","last_undegraded":"2024-09-20T20:34:40.634581+0000","last_fullsized":"2024-09-20T20:34:40.634581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654483+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:37.654483+0000","last_peered":"2024-09-20T20:34:37.654483+0000","last_clean":"2024-09-20T20:34:37.654483+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:37.654483+0000","last_undegraded":"2024-09-20T20:34:37.654483+0000","last_fullsized":"2024-09-20T20:34:37.654483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":601,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635660+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:40.635660+0000","last_peered":"2024-09-20T20:34:40.635660+0000","last_clean":"2024-09-20T20:34:40.635660+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:40.635660+0000","last_undegraded":"2024-09-20T20:34:40.635660+0000","last_fullsized":"2024-09-20T20:34:40.635660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":639,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653966+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:37.653966+0000","last_peered":"2024-09-20T20:34:37.653966+0000","last_clean":"2024-09-20T20:34:37.653966+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:37.653966+0000","last_undegraded":"2024-09-20T20:34:37.653966+0000","last_fullsized":"2024-09-20T20:34:37.653966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":587,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651244+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:37.651244+0000","last_peered":"2024-09-20T20:34:37.651244+0000","last_clean":"2024-09-20T20:34:37.651244+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:37.651244+0000","last_undegraded":"2024-09-20T20:34:37.651244+0000","last_fullsized":"2024-09-20T20:34:37.651244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633294+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:40.633294+0000","last_peered":"2024-09-20T20:34:40.633294+0000","last_clean":"2024-09-20T20:34:40.633294+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:40.633294+0000","last_undegraded":"2024-09-20T20:34:40.633294+0000","last_fullsized":"2024-09-20T20:34:40.633294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":89,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632789+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:40.632789+0000","last_peered":"2024-09-20T20:34:40.632789+0000","last_clean":"2024-09-20T20:34:40.632789+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:40.632789+0000","last_undegraded":"2024-09-20T20:34:40.632789+0000","last_fullsized":"2024-09-20T20:34:40.632789+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":718,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650167+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:37.650167+0000","last_peered":"2024-09-20T20:34:37.650167+0000","last_clean":"2024-09-20T20:34:37.650167+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:37.650167+0000","last_undegraded":"2024-09-20T20:34:37.650167+0000","last_fullsized":"2024-09-20T20:34:37.650167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":592,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635003+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:40.635003+0000","last_peered":"2024-09-20T20:34:40.635003+0000","last_clean":"2024-09-20T20:34:40.635003+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:40.635003+0000","last_undegraded":"2024-09-20T20:34:40.635003+0000","last_fullsized":"2024-09-20T20:34:40.635003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634940+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:40.634940+0000","last_peered":"2024-09-20T20:34:40.634940+0000","last_clean":"2024-09-20T20:34:40.634940+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:40.634940+0000","last_undegraded":"2024-09-20T20:34:40.634940+0000","last_fullsized":"2024-09-20T20:34:40.634940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":362,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650082+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:37.650082+0000","last_peered":"2024-09-20T20:34:37.650082+0000","last_clean":"2024-09-20T20:34:37.650082+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:37.650082+0000","last_undegraded":"2024-09-20T20:34:37.650082+0000","last_fullsized":"2024-09-20T20:34:37.650082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657850+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:37.657850+0000","last_peered":"2024-09-20T20:34:37.657850+0000","last_clean":"2024-09-20T20:34:37.657850+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:37.657850+0000","last_undegraded":"2024-09-20T20:34:37.657850+0000","last_fullsized":"2024-09-20T20:34:37.657850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650424+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:37.650424+0000","last_peered":"2024-09-20T20:34:37.650424+0000","last_clean":"2024-09-20T20:34:37.650424+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:37.650424+0000","last_undegraded":"2024-09-20T20:34:37.650424+0000","last_fullsized":"2024-09-20T20:34:37.650424+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":395,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654071+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:37.654071+0000","last_peered":"2024-09-20T20:34:37.654071+0000","last_clean":"2024-09-20T20:34:37.654071+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:37.654071+0000","last_undegraded":"2024-09-20T20:34:37.654071+0000","last_fullsized":"2024-09-20T20:34:37.654071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":549,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651568+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:37.651568+0000","last_peered":"2024-09-20T20:34:37.651568+0000","last_clean":"2024-09-20T20:34:37.651568+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:37.651568+0000","last_undegraded":"2024-09-20T20:34:37.651568+0000","last_fullsized":"2024-09-20T20:34:37.651568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632438+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:40.632438+0000","last_peered":"2024-09-20T20:34:40.632438+0000","last_clean":"2024-09-20T20:34:40.632438+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:40.632438+0000","last_undegraded":"2024-09-20T20:34:40.632438+0000","last_fullsized":"2024-09-20T20:34:40.632438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633112+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:40.633112+0000","last_peered":"2024-09-20T20:34:40.633112+0000","last_clean":"2024-09-20T20:34:40.633112+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:40.633112+0000","last_undegraded":"2024-09-20T20:34:40.633112+0000","last_fullsized":"2024-09-20T20:34:40.633112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":597,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651834+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:37.651834+0000","last_peered":"2024-09-20T20:34:37.651834+0000","last_clean":"2024-09-20T20:34:37.651834+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:37.651834+0000","last_undegraded":"2024-09-20T20:34:37.651834+0000","last_fullsized":"2024-09-20T20:34:37.651834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":323,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633075+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:40.633075+0000","last_peered":"2024-09-20T20:34:40.633075+0000","last_clean":"2024-09-20T20:34:40.633075+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:40.633075+0000","last_undegraded":"2024-09-20T20:34:40.633075+0000","last_fullsized":"2024-09-20T20:34:40.633075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652206+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:37.652206+0000","last_peered":"2024-09-20T20:34:37.652206+0000","last_clean":"2024-09-20T20:34:37.652206+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:37.652206+0000","last_undegraded":"2024-09-20T20:34:37.652206+0000","last_fullsized":"2024-09-20T20:34:37.652206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":832,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654592+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:37.654592+0000","last_peered":"2024-09-20T20:34:37.654592+0000","last_clean":"2024-09-20T20:34:37.654592+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:37.654592+0000","last_undegraded":"2024-09-20T20:34:37.654592+0000","last_fullsized":"2024-09-20T20:34:37.654592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":214,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652000+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:37.652000+0000","last_peered":"2024-09-20T20:34:37.652000+0000","last_clean":"2024-09-20T20:34:37.652000+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:37.652000+0000","last_undegraded":"2024-09-20T20:34:37.652000+0000","last_fullsized":"2024-09-20T20:34:37.652000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657264+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:37.657264+0000","last_peered":"2024-09-20T20:34:37.657264+0000","last_clean":"2024-09-20T20:34:37.657264+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:37.657264+0000","last_undegraded":"2024-09-20T20:34:37.657264+0000","last_fullsized":"2024-09-20T20:34:37.657264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":888,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655324+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:37.655324+0000","last_peered":"2024-09-20T20:34:37.655324+0000","last_clean":"2024-09-20T20:34:37.655324+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:37.655324+0000","last_undegraded":"2024-09-20T20:34:37.655324+0000","last_fullsized":"2024-09-20T20:34:37.655324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652551+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:37.652551+0000","last_peered":"2024-09-20T20:34:37.652551+0000","last_clean":"2024-09-20T20:34:37.652551+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:37.652551+0000","last_undegraded":"2024-09-20T20:34:37.652551+0000","last_fullsized":"2024-09-20T20:34:37.652551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653170+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:37.653170+0000","last_peered":"2024-09-20T20:34:37.653170+0000","last_clean":"2024-09-20T20:34:37.653170+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:37.653170+0000","last_undegraded":"2024-09-20T20:34:37.653170+0000","last_fullsized":"2024-09-20T20:34:37.653170+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":706,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.651554+0000","last_change":"2024-09-20T20:34:18.940279+0000","last_active":"2024-09-20T20:34:37.651554+0000","last_peered":"2024-09-20T20:34:37.651554+0000","last_clean":"2024-09-20T20:31:51.202703+0000","last_became_active":"2024-09-20T20:34:18.934354+0000","last_became_peered":"2024-09-20T20:34:18.934354+0000","last_unstale":"2024-09-20T20:34:37.651554+0000","last_undegraded":"2024-09-20T20:34:18.689916+0000","last_fullsized":"2024-09-20T20:34:18.683789+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.653000+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:37.653000+0000","last_peered":"2024-09-20T20:34:37.653000+0000","last_clean":"2024-09-20T20:34:37.653000+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:37.653000+0000","last_undegraded":"2024-09-20T20:34:37.653000+0000","last_fullsized":"2024-09-20T20:34:37.653000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635079+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:40.635079+0000","last_peered":"2024-09-20T20:34:40.635079+0000","last_clean":"2024-09-20T20:34:40.635079+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:40.635079+0000","last_undegraded":"2024-09-20T20:34:40.635079+0000","last_fullsized":"2024-09-20T20:34:40.635079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":926,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654299+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:37.654299+0000","last_peered":"2024-09-20T20:34:37.654299+0000","last_clean":"2024-09-20T20:34:37.654299+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:37.654299+0000","last_undegraded":"2024-09-20T20:34:37.654299+0000","last_fullsized":"2024-09-20T20:34:37.654299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":570,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633892+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:40.633892+0000","last_peered":"2024-09-20T20:34:40.633892+0000","last_clean":"2024-09-20T20:34:40.633892+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:40.633892+0000","last_undegraded":"2024-09-20T20:34:40.633892+0000","last_fullsized":"2024-09-20T20:34:40.633892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":433,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632877+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:40.632877+0000","last_peered":"2024-09-20T20:34:40.632877+0000","last_clean":"2024-09-20T20:34:40.632877+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:40.632877+0000","last_undegraded":"2024-09-20T20:34:40.632877+0000","last_fullsized":"2024-09-20T20:34:40.632877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":581,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649647+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:37.649647+0000","last_peered":"2024-09-20T20:34:37.649647+0000","last_clean":"2024-09-20T20:34:37.649647+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:37.649647+0000","last_undegraded":"2024-09-20T20:34:37.649647+0000","last_fullsized":"2024-09-20T20:34:37.649647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":258,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.657034+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:37.657034+0000","last_peered":"2024-09-20T20:34:37.657034+0000","last_clean":"2024-09-20T20:34:37.657034+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:37.657034+0000","last_undegraded":"2024-09-20T20:34:37.657034+0000","last_fullsized":"2024-09-20T20:34:37.657034+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":268,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635218+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:40.635218+0000","last_peered":"2024-09-20T20:34:40.635218+0000","last_clean":"2024-09-20T20:34:40.635218+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:40.635218+0000","last_undegraded":"2024-09-20T20:34:40.635218+0000","last_fullsized":"2024-09-20T20:34:40.635218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1078,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.650042+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:37.650042+0000","last_peered":"2024-09-20T20:34:37.650042+0000","last_clean":"2024-09-20T20:34:37.650042+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:37.650042+0000","last_undegraded":"2024-09-20T20:34:37.650042+0000","last_fullsized":"2024-09-20T20:34:37.650042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652058+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:37.652058+0000","last_peered":"2024-09-20T20:34:37.652058+0000","last_clean":"2024-09-20T20:34:37.652058+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:37.652058+0000","last_undegraded":"2024-09-20T20:34:37.652058+0000","last_fullsized":"2024-09-20T20:34:37.652058+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":666,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651391+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:37.651391+0000","last_peered":"2024-09-20T20:34:37.651391+0000","last_clean":"2024-09-20T20:34:37.651391+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:37.651391+0000","last_undegraded":"2024-09-20T20:34:37.651391+0000","last_fullsized":"2024-09-20T20:34:37.651391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":836,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.663406+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:37.663406+0000","last_peered":"2024-09-20T20:34:37.663406+0000","last_clean":"2024-09-20T20:34:37.663406+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:37.663406+0000","last_undegraded":"2024-09-20T20:34:37.663406+0000","last_fullsized":"2024-09-20T20:34:37.663406+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":856,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651733+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:37.651733+0000","last_peered":"2024-09-20T20:34:37.651733+0000","last_clean":"2024-09-20T20:34:37.651733+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:37.651733+0000","last_undegraded":"2024-09-20T20:34:37.651733+0000","last_fullsized":"2024-09-20T20:34:37.651733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":935,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652697+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:37.652697+0000","last_peered":"2024-09-20T20:34:37.652697+0000","last_clean":"2024-09-20T20:34:37.652697+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:37.652697+0000","last_undegraded":"2024-09-20T20:34:37.652697+0000","last_fullsized":"2024-09-20T20:34:37.652697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":354,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.649750+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:37.649750+0000","last_peered":"2024-09-20T20:34:37.649750+0000","last_clean":"2024-09-20T20:34:37.649750+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:37.649750+0000","last_undegraded":"2024-09-20T20:34:37.649750+0000","last_fullsized":"2024-09-20T20:34:37.649750+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":955,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656555+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:37.656555+0000","last_peered":"2024-09-20T20:34:37.656555+0000","last_clean":"2024-09-20T20:34:37.656555+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:37.656555+0000","last_undegraded":"2024-09-20T20:34:37.656555+0000","last_fullsized":"2024-09-20T20:34:37.656555+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":316,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655100+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:37.655100+0000","last_peered":"2024-09-20T20:34:37.655100+0000","last_clean":"2024-09-20T20:34:37.655100+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:37.655100+0000","last_undegraded":"2024-09-20T20:34:37.655100+0000","last_fullsized":"2024-09-20T20:34:37.655100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":528,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655674+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:37.655674+0000","last_peered":"2024-09-20T20:34:37.655674+0000","last_clean":"2024-09-20T20:34:37.655674+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:37.655674+0000","last_undegraded":"2024-09-20T20:34:37.655674+0000","last_fullsized":"2024-09-20T20:34:37.655674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":225,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.655777+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:37.655777+0000","last_peered":"2024-09-20T20:34:37.655777+0000","last_clean":"2024-09-20T20:34:37.655777+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:37.655777+0000","last_undegraded":"2024-09-20T20:34:37.655777+0000","last_fullsized":"2024-09-20T20:34:37.655777+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":558,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635840+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:40.635840+0000","last_peered":"2024-09-20T20:34:40.635840+0000","last_clean":"2024-09-20T20:34:40.635840+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:40.635840+0000","last_undegraded":"2024-09-20T20:34:40.635840+0000","last_fullsized":"2024-09-20T20:34:40.635840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":366,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633181+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:40.633181+0000","last_peered":"2024-09-20T20:34:40.633181+0000","last_clean":"2024-09-20T20:34:40.633181+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:40.633181+0000","last_undegraded":"2024-09-20T20:34:40.633181+0000","last_fullsized":"2024-09-20T20:34:40.633181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":574,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633138+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:40.633138+0000","last_peered":"2024-09-20T20:34:40.633138+0000","last_clean":"2024-09-20T20:34:40.633138+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:40.633138+0000","last_undegraded":"2024-09-20T20:34:40.633138+0000","last_fullsized":"2024-09-20T20:34:40.633138+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":442,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.656777+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:37.656777+0000","last_peered":"2024-09-20T20:34:37.656777+0000","last_clean":"2024-09-20T20:34:37.656777+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:37.656777+0000","last_undegraded":"2024-09-20T20:34:37.656777+0000","last_fullsized":"2024-09-20T20:34:37.656777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":604,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.654606+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:37.654606+0000","last_peered":"2024-09-20T20:34:37.654606+0000","last_clean":"2024-09-20T20:34:37.654606+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:37.654606+0000","last_undegraded":"2024-09-20T20:34:37.654606+0000","last_fullsized":"2024-09-20T20:34:37.654606+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.652846+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:37.652846+0000","last_peered":"2024-09-20T20:34:37.652846+0000","last_clean":"2024-09-20T20:34:37.652846+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:37.652846+0000","last_undegraded":"2024-09-20T20:34:37.652846+0000","last_fullsized":"2024-09-20T20:34:37.652846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":581,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.642728+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:40.642728+0000","last_peered":"2024-09-20T20:34:40.642728+0000","last_clean":"2024-09-20T20:34:40.642728+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:40.642728+0000","last_undegraded":"2024-09-20T20:34:40.642728+0000","last_fullsized":"2024-09-20T20:34:40.642728+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-20T20:34:37.651780+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:37.651780+0000","last_peered":"2024-09-20T20:34:37.651780+0000","last_clean":"2024-09-20T20:34:37.651780+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:37.651780+0000","last_undegraded":"2024-09-20T20:34:37.651780+0000","last_fullsized":"2024-09-20T20:34:37.651780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5769,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":739717,"data_compressed":113351,"data_compressed_allocated":135168,"data_compressed_original":319488,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":123,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99284,"kb_used_data":27900,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272556,"statfs":{"total":96636764160,"available":96535097344,"internally_reserved":0,"allocated":28569600,"data_stored":81543880,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104300,"kb_used_data":28756,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267540,"statfs":{"total":96636764160,"available":96529960960,"internally_reserved":0,"allocated":29446144,"data_stored":85083621,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58516,"kb_used_data":24824,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94313324,"statfs":{"total":96636764160,"available":96576843776,"internally_reserved":0,"allocated":25419776,"data_stored":93138811,"data_compressed":14065308,"data_compressed_allocated":17244160,"data_compressed_original":85942272,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":739717,"data_compressed":113351,"data_compressed_allocated":135168,"data_compressed_original":319488,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:46.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:46.449 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-20T20:34:45.724330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6372,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":209,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":262192,"kb_used_data":81580,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282853328,"statfs":{"total":289910292480,"available":289641807872,"internally_reserved":0,"allocated":83537920,"data_stored":259810129,"data_compressed":37788283,"data_compressed_allocated":48537600,"data_compressed_original":226779136,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1003,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1102,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002228"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672420+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:42.672420+0000","last_peered":"2024-09-20T20:34:42.672420+0000","last_clean":"2024-09-20T20:34:42.672420+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:42.672420+0000","last_undegraded":"2024-09-20T20:34:42.672420+0000","last_fullsized":"2024-09-20T20:34:42.672420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":669,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672061+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:42.672061+0000","last_peered":"2024-09-20T20:34:42.672061+0000","last_clean":"2024-09-20T20:34:42.672061+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:42.672061+0000","last_undegraded":"2024-09-20T20:34:42.672061+0000","last_fullsized":"2024-09-20T20:34:42.672061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635579+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:40.635579+0000","last_peered":"2024-09-20T20:34:40.635579+0000","last_clean":"2024-09-20T20:34:40.635579+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:40.635579+0000","last_undegraded":"2024-09-20T20:34:40.635579+0000","last_fullsized":"2024-09-20T20:34:40.635579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":559,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633524+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:40.633524+0000","last_peered":"2024-09-20T20:34:40.633524+0000","last_clean":"2024-09-20T20:34:40.633524+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:40.633524+0000","last_undegraded":"2024-09-20T20:34:40.633524+0000","last_fullsized":"2024-09-20T20:34:40.633524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":519,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":577,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633512+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:40.633512+0000","last_peered":"2024-09-20T20:34:40.633512+0000","last_clean":"2024-09-20T20:34:40.633512+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:40.633512+0000","last_undegraded":"2024-09-20T20:34:40.633512+0000","last_fullsized":"2024-09-20T20:34:40.633512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":622,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632527+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:40.632527+0000","last_peered":"2024-09-20T20:34:40.632527+0000","last_clean":"2024-09-20T20:34:40.632527+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:40.632527+0000","last_undegraded":"2024-09-20T20:34:40.632527+0000","last_fullsized":"2024-09-20T20:34:40.632527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":574,"reported_epoch":93,"state":"peering","last_fresh":"2024-09-20T20:34:40.632445+0000","last_change":"2024-09-20T20:34:40.632445+0000","last_active":"2024-09-20T20:34:17.643078+0000","last_peered":"2024-09-20T20:34:15.791607+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:31:52.246684+0000","last_became_peered":"2024-09-20T20:31:52.246684+0000","last_unstale":"2024-09-20T20:34:40.632445+0000","last_undegraded":"2024-09-20T20:34:40.632445+0000","last_fullsized":"2024-09-20T20:34:40.632445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672109+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:42.672109+0000","last_peered":"2024-09-20T20:34:42.672109+0000","last_clean":"2024-09-20T20:34:42.672109+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:42.672109+0000","last_undegraded":"2024-09-20T20:34:42.672109+0000","last_fullsized":"2024-09-20T20:34:42.672109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":572,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672325+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:42.672325+0000","last_peered":"2024-09-20T20:34:42.672325+0000","last_clean":"2024-09-20T20:34:42.672325+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:42.672325+0000","last_undegraded":"2024-09-20T20:34:42.672325+0000","last_fullsized":"2024-09-20T20:34:42.672325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":549,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635321+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:40.635321+0000","last_peered":"2024-09-20T20:34:40.635321+0000","last_clean":"2024-09-20T20:34:40.635321+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:40.635321+0000","last_undegraded":"2024-09-20T20:34:40.635321+0000","last_fullsized":"2024-09-20T20:34:40.635321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":817,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671272+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:42.671272+0000","last_peered":"2024-09-20T20:34:42.671272+0000","last_clean":"2024-09-20T20:34:42.671272+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:42.671272+0000","last_undegraded":"2024-09-20T20:34:42.671272+0000","last_fullsized":"2024-09-20T20:34:42.671272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670951+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:42.670951+0000","last_peered":"2024-09-20T20:34:42.670951+0000","last_clean":"2024-09-20T20:34:42.670951+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:42.670951+0000","last_undegraded":"2024-09-20T20:34:42.670951+0000","last_fullsized":"2024-09-20T20:34:42.670951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":599,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633488+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:40.633488+0000","last_peered":"2024-09-20T20:34:40.633488+0000","last_clean":"2024-09-20T20:34:40.633488+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:40.633488+0000","last_undegraded":"2024-09-20T20:34:40.633488+0000","last_fullsized":"2024-09-20T20:34:40.633488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":694,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632459+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:40.632459+0000","last_peered":"2024-09-20T20:34:40.632459+0000","last_clean":"2024-09-20T20:34:40.632459+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:40.632459+0000","last_undegraded":"2024-09-20T20:34:40.632459+0000","last_fullsized":"2024-09-20T20:34:40.632459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":612,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635336+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:40.635336+0000","last_peered":"2024-09-20T20:34:40.635336+0000","last_clean":"2024-09-20T20:34:40.635336+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:40.635336+0000","last_undegraded":"2024-09-20T20:34:40.635336+0000","last_fullsized":"2024-09-20T20:34:40.635336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673148+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:42.673148+0000","last_peered":"2024-09-20T20:34:42.673148+0000","last_clean":"2024-09-20T20:34:42.673148+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:42.673148+0000","last_undegraded":"2024-09-20T20:34:42.673148+0000","last_fullsized":"2024-09-20T20:34:42.673148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672427+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:42.672427+0000","last_peered":"2024-09-20T20:34:42.672427+0000","last_clean":"2024-09-20T20:34:42.672427+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:42.672427+0000","last_undegraded":"2024-09-20T20:34:42.672427+0000","last_fullsized":"2024-09-20T20:34:42.672427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":646,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671368+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:42.671368+0000","last_peered":"2024-09-20T20:34:42.671368+0000","last_clean":"2024-09-20T20:34:42.671368+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:42.671368+0000","last_undegraded":"2024-09-20T20:34:42.671368+0000","last_fullsized":"2024-09-20T20:34:42.671368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":611,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634099+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:40.634099+0000","last_peered":"2024-09-20T20:34:40.634099+0000","last_clean":"2024-09-20T20:34:40.634099+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:40.634099+0000","last_undegraded":"2024-09-20T20:34:40.634099+0000","last_fullsized":"2024-09-20T20:34:40.634099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":573,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.631604+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:40.631604+0000","last_peered":"2024-09-20T20:34:40.631604+0000","last_clean":"2024-09-20T20:34:40.631604+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:40.631604+0000","last_undegraded":"2024-09-20T20:34:40.631604+0000","last_fullsized":"2024-09-20T20:34:40.631604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":966,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670666+0000","last_change":"2024-09-20T20:34:39.664844+0000","last_active":"2024-09-20T20:34:42.670666+0000","last_peered":"2024-09-20T20:34:42.670666+0000","last_clean":"2024-09-20T20:34:42.670666+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:34:42.670666+0000","last_undegraded":"2024-09-20T20:34:42.670666+0000","last_fullsized":"2024-09-20T20:34:42.670666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1010,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670184+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:42.670184+0000","last_peered":"2024-09-20T20:34:42.670184+0000","last_clean":"2024-09-20T20:34:42.670184+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:42.670184+0000","last_undegraded":"2024-09-20T20:34:42.670184+0000","last_fullsized":"2024-09-20T20:34:42.670184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":694,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670222+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:42.670222+0000","last_peered":"2024-09-20T20:34:42.670222+0000","last_clean":"2024-09-20T20:34:42.670222+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:42.670222+0000","last_undegraded":"2024-09-20T20:34:42.670222+0000","last_fullsized":"2024-09-20T20:34:42.670222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672720+0000","last_change":"2024-09-20T20:34:38.665667+0000","last_active":"2024-09-20T20:34:42.672720+0000","last_peered":"2024-09-20T20:34:42.672720+0000","last_clean":"2024-09-20T20:34:42.672720+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:34:42.672720+0000","last_undegraded":"2024-09-20T20:34:42.672720+0000","last_fullsized":"2024-09-20T20:34:42.672720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:54.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1085,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672227+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:42.672227+0000","last_peered":"2024-09-20T20:34:42.672227+0000","last_clean":"2024-09-20T20:34:42.672227+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:42.672227+0000","last_undegraded":"2024-09-20T20:34:42.672227+0000","last_fullsized":"2024-09-20T20:34:42.672227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":624,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635213+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:40.635213+0000","last_peered":"2024-09-20T20:34:40.635213+0000","last_clean":"2024-09-20T20:34:40.635213+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:40.635213+0000","last_undegraded":"2024-09-20T20:34:40.635213+0000","last_fullsized":"2024-09-20T20:34:40.635213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671857+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:42.671857+0000","last_peered":"2024-09-20T20:34:42.671857+0000","last_clean":"2024-09-20T20:34:42.671857+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:42.671857+0000","last_undegraded":"2024-09-20T20:34:42.671857+0000","last_fullsized":"2024-09-20T20:34:42.671857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671485+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:42.671485+0000","last_peered":"2024-09-20T20:34:42.671485+0000","last_clean":"2024-09-20T20:34:42.671485+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:42.671485+0000","last_undegraded":"2024-09-20T20:34:42.671485+0000","last_fullsized":"2024-09-20T20:34:42.671485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1021,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671161+0000","last_change":"2024-09-20T20:34:40.670826+0000","last_active":"2024-09-20T20:34:42.671161+0000","last_peered":"2024-09-20T20:34:42.671161+0000","last_clean":"2024-09-20T20:34:42.671161+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:34:42.671161+0000","last_undegraded":"2024-09-20T20:34:42.671161+0000","last_fullsized":"2024-09-20T20:34:42.671161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:58.351454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":620,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670205+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:42.670205+0000","last_peered":"2024-09-20T20:34:42.670205+0000","last_clean":"2024-09-20T20:34:42.670205+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:42.670205+0000","last_undegraded":"2024-09-20T20:34:42.670205+0000","last_fullsized":"2024-09-20T20:34:42.670205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":601,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.650356+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:37.650356+0000","last_peered":"2024-09-20T20:34:37.650356+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:37.650356+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":497,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":563,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633432+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:40.633432+0000","last_peered":"2024-09-20T20:34:40.633432+0000","last_clean":"2024-09-20T20:34:40.633432+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:40.633432+0000","last_undegraded":"2024-09-20T20:34:40.633432+0000","last_fullsized":"2024-09-20T20:34:40.633432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":535,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671908+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:42.671908+0000","last_peered":"2024-09-20T20:34:42.671908+0000","last_clean":"2024-09-20T20:34:42.671908+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:42.671908+0000","last_undegraded":"2024-09-20T20:34:42.671908+0000","last_fullsized":"2024-09-20T20:34:42.671908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1002,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672706+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:42.672706+0000","last_peered":"2024-09-20T20:34:42.672706+0000","last_clean":"2024-09-20T20:34:42.672706+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:42.672706+0000","last_undegraded":"2024-09-20T20:34:42.672706+0000","last_fullsized":"2024-09-20T20:34:42.672706+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670825+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:42.670825+0000","last_peered":"2024-09-20T20:34:42.670825+0000","last_clean":"2024-09-20T20:34:42.670825+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:42.670825+0000","last_undegraded":"2024-09-20T20:34:42.670825+0000","last_fullsized":"2024-09-20T20:34:42.670825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":943,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.679159+0000","last_change":"2024-09-20T20:34:42.679159+0000","last_active":"2024-09-20T20:34:42.679159+0000","last_peered":"2024-09-20T20:34:42.679159+0000","last_clean":"2024-09-20T20:34:42.679159+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:34:42.679159+0000","last_undegraded":"2024-09-20T20:34:42.679159+0000","last_fullsized":"2024-09-20T20:34:42.679159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633780+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:40.633780+0000","last_peered":"2024-09-20T20:34:40.633780+0000","last_clean":"2024-09-20T20:34:40.633780+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:40.633780+0000","last_undegraded":"2024-09-20T20:34:40.633780+0000","last_fullsized":"2024-09-20T20:34:40.633780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":213,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635542+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:40.635542+0000","last_peered":"2024-09-20T20:34:40.635542+0000","last_clean":"2024-09-20T20:34:40.635542+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:40.635542+0000","last_undegraded":"2024-09-20T20:34:40.635542+0000","last_fullsized":"2024-09-20T20:34:40.635542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":908,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670248+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:42.670248+0000","last_peered":"2024-09-20T20:34:42.670248+0000","last_clean":"2024-09-20T20:34:42.670248+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:42.670248+0000","last_undegraded":"2024-09-20T20:34:42.670248+0000","last_fullsized":"2024-09-20T20:34:42.670248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672716+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:42.672716+0000","last_peered":"2024-09-20T20:34:42.672716+0000","last_clean":"2024-09-20T20:34:42.672716+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:42.672716+0000","last_undegraded":"2024-09-20T20:34:42.672716+0000","last_fullsized":"2024-09-20T20:34:42.672716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670493+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:42.670493+0000","last_peered":"2024-09-20T20:34:42.670493+0000","last_clean":"2024-09-20T20:34:42.670493+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:42.670493+0000","last_undegraded":"2024-09-20T20:34:42.670493+0000","last_fullsized":"2024-09-20T20:34:42.670493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":565,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634877+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:40.634877+0000","last_peered":"2024-09-20T20:34:40.634877+0000","last_clean":"2024-09-20T20:34:40.634877+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:40.634877+0000","last_undegraded":"2024-09-20T20:34:40.634877+0000","last_fullsized":"2024-09-20T20:34:40.634877+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":631,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633749+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:40.633749+0000","last_peered":"2024-09-20T20:34:40.633749+0000","last_clean":"2024-09-20T20:34:40.633749+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:40.633749+0000","last_undegraded":"2024-09-20T20:34:40.633749+0000","last_fullsized":"2024-09-20T20:34:40.633749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633887+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:40.633887+0000","last_peered":"2024-09-20T20:34:40.633887+0000","last_clean":"2024-09-20T20:34:40.633887+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:40.633887+0000","last_undegraded":"2024-09-20T20:34:40.633887+0000","last_fullsized":"2024-09-20T20:34:40.633887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671371+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:42.671371+0000","last_peered":"2024-09-20T20:34:42.671371+0000","last_clean":"2024-09-20T20:34:42.671371+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:42.671371+0000","last_undegraded":"2024-09-20T20:34:42.671371+0000","last_fullsized":"2024-09-20T20:34:42.671371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":377,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672768+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:42.672768+0000","last_peered":"2024-09-20T20:34:42.672768+0000","last_clean":"2024-09-20T20:34:42.672768+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:42.672768+0000","last_undegraded":"2024-09-20T20:34:42.672768+0000","last_fullsized":"2024-09-20T20:34:42.672768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":603,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634343+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:40.634343+0000","last_peered":"2024-09-20T20:34:40.634343+0000","last_clean":"2024-09-20T20:34:40.634343+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:40.634343+0000","last_undegraded":"2024-09-20T20:34:40.634343+0000","last_fullsized":"2024-09-20T20:34:40.634343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":192,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632857+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:40.632857+0000","last_peered":"2024-09-20T20:34:40.632857+0000","last_clean":"2024-09-20T20:34:40.632857+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:40.632857+0000","last_undegraded":"2024-09-20T20:34:40.632857+0000","last_fullsized":"2024-09-20T20:34:40.632857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":574,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634581+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:40.634581+0000","last_peered":"2024-09-20T20:34:40.634581+0000","last_clean":"2024-09-20T20:34:40.634581+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:40.634581+0000","last_undegraded":"2024-09-20T20:34:40.634581+0000","last_fullsized":"2024-09-20T20:34:40.634581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671097+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:42.671097+0000","last_peered":"2024-09-20T20:34:42.671097+0000","last_clean":"2024-09-20T20:34:42.671097+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:42.671097+0000","last_undegraded":"2024-09-20T20:34:42.671097+0000","last_fullsized":"2024-09-20T20:34:42.671097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":601,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635660+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:40.635660+0000","last_peered":"2024-09-20T20:34:40.635660+0000","last_clean":"2024-09-20T20:34:40.635660+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:40.635660+0000","last_undegraded":"2024-09-20T20:34:40.635660+0000","last_fullsized":"2024-09-20T20:34:40.635660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":649,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670459+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:42.670459+0000","last_peered":"2024-09-20T20:34:42.670459+0000","last_clean":"2024-09-20T20:34:42.670459+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:42.670459+0000","last_undegraded":"2024-09-20T20:34:42.670459+0000","last_fullsized":"2024-09-20T20:34:42.670459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":597,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672394+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:42.672394+0000","last_peered":"2024-09-20T20:34:42.672394+0000","last_clean":"2024-09-20T20:34:42.672394+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:42.672394+0000","last_undegraded":"2024-09-20T20:34:42.672394+0000","last_fullsized":"2024-09-20T20:34:42.672394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633294+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:40.633294+0000","last_peered":"2024-09-20T20:34:40.633294+0000","last_clean":"2024-09-20T20:34:40.633294+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:40.633294+0000","last_undegraded":"2024-09-20T20:34:40.633294+0000","last_fullsized":"2024-09-20T20:34:40.633294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":89,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632789+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:40.632789+0000","last_peered":"2024-09-20T20:34:40.632789+0000","last_clean":"2024-09-20T20:34:40.632789+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:40.632789+0000","last_undegraded":"2024-09-20T20:34:40.632789+0000","last_fullsized":"2024-09-20T20:34:40.632789+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":728,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672067+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:42.672067+0000","last_peered":"2024-09-20T20:34:42.672067+0000","last_clean":"2024-09-20T20:34:42.672067+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:42.672067+0000","last_undegraded":"2024-09-20T20:34:42.672067+0000","last_fullsized":"2024-09-20T20:34:42.672067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":592,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635003+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:40.635003+0000","last_peered":"2024-09-20T20:34:40.635003+0000","last_clean":"2024-09-20T20:34:40.635003+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:40.635003+0000","last_undegraded":"2024-09-20T20:34:40.635003+0000","last_fullsized":"2024-09-20T20:34:40.635003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634940+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:40.634940+0000","last_peered":"2024-09-20T20:34:40.634940+0000","last_clean":"2024-09-20T20:34:40.634940+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:40.634940+0000","last_undegraded":"2024-09-20T20:34:40.634940+0000","last_fullsized":"2024-09-20T20:34:40.634940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":372,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670895+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:42.670895+0000","last_peered":"2024-09-20T20:34:42.670895+0000","last_clean":"2024-09-20T20:34:42.670895+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:42.670895+0000","last_undegraded":"2024-09-20T20:34:42.670895+0000","last_fullsized":"2024-09-20T20:34:42.670895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672614+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:42.672614+0000","last_peered":"2024-09-20T20:34:42.672614+0000","last_clean":"2024-09-20T20:34:42.672614+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:42.672614+0000","last_undegraded":"2024-09-20T20:34:42.672614+0000","last_fullsized":"2024-09-20T20:34:42.672614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670548+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:42.670548+0000","last_peered":"2024-09-20T20:34:42.670548+0000","last_clean":"2024-09-20T20:34:42.670548+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:42.670548+0000","last_undegraded":"2024-09-20T20:34:42.670548+0000","last_fullsized":"2024-09-20T20:34:42.670548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672623+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:42.672623+0000","last_peered":"2024-09-20T20:34:42.672623+0000","last_clean":"2024-09-20T20:34:42.672623+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:42.672623+0000","last_undegraded":"2024-09-20T20:34:42.672623+0000","last_fullsized":"2024-09-20T20:34:42.672623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632438+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:40.632438+0000","last_peered":"2024-09-20T20:34:40.632438+0000","last_clean":"2024-09-20T20:34:40.632438+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:40.632438+0000","last_undegraded":"2024-09-20T20:34:40.632438+0000","last_fullsized":"2024-09-20T20:34:40.632438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633112+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:40.633112+0000","last_peered":"2024-09-20T20:34:40.633112+0000","last_clean":"2024-09-20T20:34:40.633112+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:40.633112+0000","last_undegraded":"2024-09-20T20:34:40.633112+0000","last_fullsized":"2024-09-20T20:34:40.633112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672046+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:42.672046+0000","last_peered":"2024-09-20T20:34:42.672046+0000","last_clean":"2024-09-20T20:34:42.672046+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:42.672046+0000","last_undegraded":"2024-09-20T20:34:42.672046+0000","last_fullsized":"2024-09-20T20:34:42.672046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":323,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633075+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:40.633075+0000","last_peered":"2024-09-20T20:34:40.633075+0000","last_clean":"2024-09-20T20:34:40.633075+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:40.633075+0000","last_undegraded":"2024-09-20T20:34:40.633075+0000","last_fullsized":"2024-09-20T20:34:40.633075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672338+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:42.672338+0000","last_peered":"2024-09-20T20:34:42.672338+0000","last_clean":"2024-09-20T20:34:42.672338+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:42.672338+0000","last_undegraded":"2024-09-20T20:34:42.672338+0000","last_fullsized":"2024-09-20T20:34:42.672338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":842,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670969+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:42.670969+0000","last_peered":"2024-09-20T20:34:42.670969+0000","last_clean":"2024-09-20T20:34:42.670969+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:42.670969+0000","last_undegraded":"2024-09-20T20:34:42.670969+0000","last_fullsized":"2024-09-20T20:34:42.670969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672097+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:42.672097+0000","last_peered":"2024-09-20T20:34:42.672097+0000","last_clean":"2024-09-20T20:34:42.672097+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:42.672097+0000","last_undegraded":"2024-09-20T20:34:42.672097+0000","last_fullsized":"2024-09-20T20:34:42.672097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672545+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:42.672545+0000","last_peered":"2024-09-20T20:34:42.672545+0000","last_clean":"2024-09-20T20:34:42.672545+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:42.672545+0000","last_undegraded":"2024-09-20T20:34:42.672545+0000","last_fullsized":"2024-09-20T20:34:42.672545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":898,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671061+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:42.671061+0000","last_peered":"2024-09-20T20:34:42.671061+0000","last_clean":"2024-09-20T20:34:42.671061+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:42.671061+0000","last_undegraded":"2024-09-20T20:34:42.671061+0000","last_fullsized":"2024-09-20T20:34:42.671061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673319+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:42.673319+0000","last_peered":"2024-09-20T20:34:42.673319+0000","last_clean":"2024-09-20T20:34:42.673319+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:42.673319+0000","last_undegraded":"2024-09-20T20:34:42.673319+0000","last_fullsized":"2024-09-20T20:34:42.673319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672991+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:42.672991+0000","last_peered":"2024-09-20T20:34:42.672991+0000","last_clean":"2024-09-20T20:34:42.672991+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:42.672991+0000","last_undegraded":"2024-09-20T20:34:42.672991+0000","last_fullsized":"2024-09-20T20:34:42.672991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1061,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670650+0000","last_change":"2024-09-20T20:34:41.673197+0000","last_active":"2024-09-20T20:34:42.670650+0000","last_peered":"2024-09-20T20:34:42.670650+0000","last_clean":"2024-09-20T20:34:42.670650+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:34:42.670650+0000","last_undegraded":"2024-09-20T20:34:42.670650+0000","last_fullsized":"2024-09-20T20:34:42.670650+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672875+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:42.672875+0000","last_peered":"2024-09-20T20:34:42.672875+0000","last_clean":"2024-09-20T20:34:42.672875+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:42.672875+0000","last_undegraded":"2024-09-20T20:34:42.672875+0000","last_fullsized":"2024-09-20T20:34:42.672875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635079+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:40.635079+0000","last_peered":"2024-09-20T20:34:40.635079+0000","last_clean":"2024-09-20T20:34:40.635079+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:40.635079+0000","last_undegraded":"2024-09-20T20:34:40.635079+0000","last_fullsized":"2024-09-20T20:34:40.635079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670502+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:42.670502+0000","last_peered":"2024-09-20T20:34:42.670502+0000","last_clean":"2024-09-20T20:34:42.670502+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:42.670502+0000","last_undegraded":"2024-09-20T20:34:42.670502+0000","last_fullsized":"2024-09-20T20:34:42.670502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":570,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633892+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:40.633892+0000","last_peered":"2024-09-20T20:34:40.633892+0000","last_clean":"2024-09-20T20:34:40.633892+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:40.633892+0000","last_undegraded":"2024-09-20T20:34:40.633892+0000","last_fullsized":"2024-09-20T20:34:40.633892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":433,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632877+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:40.632877+0000","last_peered":"2024-09-20T20:34:40.632877+0000","last_clean":"2024-09-20T20:34:40.632877+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:40.632877+0000","last_undegraded":"2024-09-20T20:34:40.632877+0000","last_fullsized":"2024-09-20T20:34:40.632877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":591,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670675+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:42.670675+0000","last_peered":"2024-09-20T20:34:42.670675+0000","last_clean":"2024-09-20T20:34:42.670675+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:42.670675+0000","last_undegraded":"2024-09-20T20:34:42.670675+0000","last_fullsized":"2024-09-20T20:34:42.670675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":268,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672378+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:42.672378+0000","last_peered":"2024-09-20T20:34:42.672378+0000","last_clean":"2024-09-20T20:34:42.672378+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:42.672378+0000","last_undegraded":"2024-09-20T20:34:42.672378+0000","last_fullsized":"2024-09-20T20:34:42.672378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":268,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635218+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:40.635218+0000","last_peered":"2024-09-20T20:34:40.635218+0000","last_clean":"2024-09-20T20:34:40.635218+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:40.635218+0000","last_undegraded":"2024-09-20T20:34:40.635218+0000","last_fullsized":"2024-09-20T20:34:40.635218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1088,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670557+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:42.670557+0000","last_peered":"2024-09-20T20:34:42.670557+0000","last_clean":"2024-09-20T20:34:42.670557+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:42.670557+0000","last_undegraded":"2024-09-20T20:34:42.670557+0000","last_fullsized":"2024-09-20T20:34:42.670557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673111+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:42.673111+0000","last_peered":"2024-09-20T20:34:42.673111+0000","last_clean":"2024-09-20T20:34:42.673111+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:42.673111+0000","last_undegraded":"2024-09-20T20:34:42.673111+0000","last_fullsized":"2024-09-20T20:34:42.673111+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":676,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670536+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:42.670536+0000","last_peered":"2024-09-20T20:34:42.670536+0000","last_clean":"2024-09-20T20:34:42.670536+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:42.670536+0000","last_undegraded":"2024-09-20T20:34:42.670536+0000","last_fullsized":"2024-09-20T20:34:42.670536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":846,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672855+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:42.672855+0000","last_peered":"2024-09-20T20:34:42.672855+0000","last_clean":"2024-09-20T20:34:42.672855+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:42.672855+0000","last_undegraded":"2024-09-20T20:34:42.672855+0000","last_fullsized":"2024-09-20T20:34:42.672855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":866,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670990+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:42.670990+0000","last_peered":"2024-09-20T20:34:42.670990+0000","last_clean":"2024-09-20T20:34:42.670990+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:42.670990+0000","last_undegraded":"2024-09-20T20:34:42.670990+0000","last_fullsized":"2024-09-20T20:34:42.670990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672283+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:42.672283+0000","last_peered":"2024-09-20T20:34:42.672283+0000","last_clean":"2024-09-20T20:34:42.672283+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:42.672283+0000","last_undegraded":"2024-09-20T20:34:42.672283+0000","last_fullsized":"2024-09-20T20:34:42.672283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":364,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670891+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:42.670891+0000","last_peered":"2024-09-20T20:34:42.670891+0000","last_clean":"2024-09-20T20:34:42.670891+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:42.670891+0000","last_undegraded":"2024-09-20T20:34:42.670891+0000","last_fullsized":"2024-09-20T20:34:42.670891+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671738+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:42.671738+0000","last_peered":"2024-09-20T20:34:42.671738+0000","last_clean":"2024-09-20T20:34:42.671738+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:42.671738+0000","last_undegraded":"2024-09-20T20:34:42.671738+0000","last_fullsized":"2024-09-20T20:34:42.671738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671260+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:42.671260+0000","last_peered":"2024-09-20T20:34:42.671260+0000","last_clean":"2024-09-20T20:34:42.671260+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:42.671260+0000","last_undegraded":"2024-09-20T20:34:42.671260+0000","last_fullsized":"2024-09-20T20:34:42.671260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":538,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671557+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:42.671557+0000","last_peered":"2024-09-20T20:34:42.671557+0000","last_clean":"2024-09-20T20:34:42.671557+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:42.671557+0000","last_undegraded":"2024-09-20T20:34:42.671557+0000","last_fullsized":"2024-09-20T20:34:42.671557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671334+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:42.671334+0000","last_peered":"2024-09-20T20:34:42.671334+0000","last_clean":"2024-09-20T20:34:42.671334+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:42.671334+0000","last_undegraded":"2024-09-20T20:34:42.671334+0000","last_fullsized":"2024-09-20T20:34:42.671334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":558,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635840+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:40.635840+0000","last_peered":"2024-09-20T20:34:40.635840+0000","last_clean":"2024-09-20T20:34:40.635840+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:40.635840+0000","last_undegraded":"2024-09-20T20:34:40.635840+0000","last_fullsized":"2024-09-20T20:34:40.635840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":366,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633181+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:40.633181+0000","last_peered":"2024-09-20T20:34:40.633181+0000","last_clean":"2024-09-20T20:34:40.633181+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:40.633181+0000","last_undegraded":"2024-09-20T20:34:40.633181+0000","last_fullsized":"2024-09-20T20:34:40.633181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":574,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633138+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:40.633138+0000","last_peered":"2024-09-20T20:34:40.633138+0000","last_clean":"2024-09-20T20:34:40.633138+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:40.633138+0000","last_undegraded":"2024-09-20T20:34:40.633138+0000","last_fullsized":"2024-09-20T20:34:40.633138+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672043+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:42.672043+0000","last_peered":"2024-09-20T20:34:42.672043+0000","last_clean":"2024-09-20T20:34:42.672043+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:42.672043+0000","last_undegraded":"2024-09-20T20:34:42.672043+0000","last_fullsized":"2024-09-20T20:34:42.672043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671503+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:42.671503+0000","last_peered":"2024-09-20T20:34:42.671503+0000","last_clean":"2024-09-20T20:34:42.671503+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:42.671503+0000","last_undegraded":"2024-09-20T20:34:42.671503+0000","last_fullsized":"2024-09-20T20:34:42.671503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672549+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:42.672549+0000","last_peered":"2024-09-20T20:34:42.672549+0000","last_clean":"2024-09-20T20:34:42.672549+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:42.672549+0000","last_undegraded":"2024-09-20T20:34:42.672549+0000","last_fullsized":"2024-09-20T20:34:42.672549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":581,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.642728+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:40.642728+0000","last_peered":"2024-09-20T20:34:40.642728+0000","last_clean":"2024-09-20T20:34:40.642728+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:40.642728+0000","last_undegraded":"2024-09-20T20:34:40.642728+0000","last_fullsized":"2024-09-20T20:34:40.642728+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672824+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:42.672824+0000","last_peered":"2024-09-20T20:34:42.672824+0000","last_clean":"2024-09-20T20:34:42.672824+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:42.672824+0000","last_undegraded":"2024-09-20T20:34:42.672824+0000","last_fullsized":"2024-09-20T20:34:42.672824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6358,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":739717,"data_compressed":113351,"data_compressed_allocated":135168,"data_compressed_original":319488,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":127,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99328,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272512,"statfs":{"total":96636764160,"available":96535052288,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104348,"kb_used_data":28808,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267492,"statfs":{"total":96636764160,"available":96529911808,"internally_reserved":0,"allocated":29499392,"data_stored":85105638,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58516,"kb_used_data":24824,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94313324,"statfs":{"total":96636764160,"available":96576843776,"internally_reserved":0,"allocated":25419776,"data_stored":93138811,"data_compressed":14065308,"data_compressed_allocated":17244160,"data_compressed_original":85942272,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":739717,"data_compressed":113351,"data_compressed_allocated":135168,"data_compressed_original":319488,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:46.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-20T20:34:46.849 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:46.849 INFO:teuthology.orchestra.run.smithi070.stdout:{"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 178/114 objects degraded (156.140%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":314,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":3,"num_up_osds":3,"osd_up_since":1726864456,"num_in_osds":3,"osd_in_since":1726864173,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":103},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128120423,"bytes_used":268484608,"bytes_avail":289641807872,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":178,"degraded_total":114,"degraded_ratio":1.5614035087719298,"recovering_objects_per_sec":183,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1102,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4230}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-20T20:31:03.624405+0000","services":{}},"progress_events":{}} 2024-09-20T20:34:46.868 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-20T20:34:46.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:47.161 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:47.163 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:47.180 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-20T20:34:45.724330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6372,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":209,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":262192,"kb_used_data":81580,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282853328,"statfs":{"total":289910292480,"available":289641807872,"internally_reserved":0,"allocated":83537920,"data_stored":259810129,"data_compressed":37788283,"data_compressed_allocated":48537600,"data_compressed_original":226779136,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1003,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1102,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002228"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672420+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:42.672420+0000","last_peered":"2024-09-20T20:34:42.672420+0000","last_clean":"2024-09-20T20:34:42.672420+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:42.672420+0000","last_undegraded":"2024-09-20T20:34:42.672420+0000","last_fullsized":"2024-09-20T20:34:42.672420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":669,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672061+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:42.672061+0000","last_peered":"2024-09-20T20:34:42.672061+0000","last_clean":"2024-09-20T20:34:42.672061+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:42.672061+0000","last_undegraded":"2024-09-20T20:34:42.672061+0000","last_fullsized":"2024-09-20T20:34:42.672061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635579+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:40.635579+0000","last_peered":"2024-09-20T20:34:40.635579+0000","last_clean":"2024-09-20T20:34:40.635579+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:40.635579+0000","last_undegraded":"2024-09-20T20:34:40.635579+0000","last_fullsized":"2024-09-20T20:34:40.635579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":559,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633524+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:40.633524+0000","last_peered":"2024-09-20T20:34:40.633524+0000","last_clean":"2024-09-20T20:34:40.633524+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:40.633524+0000","last_undegraded":"2024-09-20T20:34:40.633524+0000","last_fullsized":"2024-09-20T20:34:40.633524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":519,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":577,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633512+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:40.633512+0000","last_peered":"2024-09-20T20:34:40.633512+0000","last_clean":"2024-09-20T20:34:40.633512+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:40.633512+0000","last_undegraded":"2024-09-20T20:34:40.633512+0000","last_fullsized":"2024-09-20T20:34:40.633512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":622,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632527+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:40.632527+0000","last_peered":"2024-09-20T20:34:40.632527+0000","last_clean":"2024-09-20T20:34:40.632527+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:40.632527+0000","last_undegraded":"2024-09-20T20:34:40.632527+0000","last_fullsized":"2024-09-20T20:34:40.632527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":574,"reported_epoch":93,"state":"peering","last_fresh":"2024-09-20T20:34:40.632445+0000","last_change":"2024-09-20T20:34:40.632445+0000","last_active":"2024-09-20T20:34:17.643078+0000","last_peered":"2024-09-20T20:34:15.791607+0000","last_clean":"2024-09-20T20:31:51.199112+0000","last_became_active":"2024-09-20T20:31:52.246684+0000","last_became_peered":"2024-09-20T20:31:52.246684+0000","last_unstale":"2024-09-20T20:34:40.632445+0000","last_undegraded":"2024-09-20T20:34:40.632445+0000","last_fullsized":"2024-09-20T20:34:40.632445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672109+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:42.672109+0000","last_peered":"2024-09-20T20:34:42.672109+0000","last_clean":"2024-09-20T20:34:42.672109+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:42.672109+0000","last_undegraded":"2024-09-20T20:34:42.672109+0000","last_fullsized":"2024-09-20T20:34:42.672109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":572,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672325+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:42.672325+0000","last_peered":"2024-09-20T20:34:42.672325+0000","last_clean":"2024-09-20T20:34:42.672325+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:42.672325+0000","last_undegraded":"2024-09-20T20:34:42.672325+0000","last_fullsized":"2024-09-20T20:34:42.672325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":549,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635321+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:40.635321+0000","last_peered":"2024-09-20T20:34:40.635321+0000","last_clean":"2024-09-20T20:34:40.635321+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:40.635321+0000","last_undegraded":"2024-09-20T20:34:40.635321+0000","last_fullsized":"2024-09-20T20:34:40.635321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":817,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671272+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:42.671272+0000","last_peered":"2024-09-20T20:34:42.671272+0000","last_clean":"2024-09-20T20:34:42.671272+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:42.671272+0000","last_undegraded":"2024-09-20T20:34:42.671272+0000","last_fullsized":"2024-09-20T20:34:42.671272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670951+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:42.670951+0000","last_peered":"2024-09-20T20:34:42.670951+0000","last_clean":"2024-09-20T20:34:42.670951+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:42.670951+0000","last_undegraded":"2024-09-20T20:34:42.670951+0000","last_fullsized":"2024-09-20T20:34:42.670951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":599,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633488+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:40.633488+0000","last_peered":"2024-09-20T20:34:40.633488+0000","last_clean":"2024-09-20T20:34:40.633488+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:40.633488+0000","last_undegraded":"2024-09-20T20:34:40.633488+0000","last_fullsized":"2024-09-20T20:34:40.633488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":694,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632459+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:40.632459+0000","last_peered":"2024-09-20T20:34:40.632459+0000","last_clean":"2024-09-20T20:34:40.632459+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:40.632459+0000","last_undegraded":"2024-09-20T20:34:40.632459+0000","last_fullsized":"2024-09-20T20:34:40.632459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":612,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635336+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:40.635336+0000","last_peered":"2024-09-20T20:34:40.635336+0000","last_clean":"2024-09-20T20:34:40.635336+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:40.635336+0000","last_undegraded":"2024-09-20T20:34:40.635336+0000","last_fullsized":"2024-09-20T20:34:40.635336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673148+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:42.673148+0000","last_peered":"2024-09-20T20:34:42.673148+0000","last_clean":"2024-09-20T20:34:42.673148+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:42.673148+0000","last_undegraded":"2024-09-20T20:34:42.673148+0000","last_fullsized":"2024-09-20T20:34:42.673148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672427+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:42.672427+0000","last_peered":"2024-09-20T20:34:42.672427+0000","last_clean":"2024-09-20T20:34:42.672427+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:42.672427+0000","last_undegraded":"2024-09-20T20:34:42.672427+0000","last_fullsized":"2024-09-20T20:34:42.672427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":646,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671368+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:42.671368+0000","last_peered":"2024-09-20T20:34:42.671368+0000","last_clean":"2024-09-20T20:34:42.671368+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:42.671368+0000","last_undegraded":"2024-09-20T20:34:42.671368+0000","last_fullsized":"2024-09-20T20:34:42.671368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":611,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634099+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:40.634099+0000","last_peered":"2024-09-20T20:34:40.634099+0000","last_clean":"2024-09-20T20:34:40.634099+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:40.634099+0000","last_undegraded":"2024-09-20T20:34:40.634099+0000","last_fullsized":"2024-09-20T20:34:40.634099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":573,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.631604+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:40.631604+0000","last_peered":"2024-09-20T20:34:40.631604+0000","last_clean":"2024-09-20T20:34:40.631604+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:40.631604+0000","last_undegraded":"2024-09-20T20:34:40.631604+0000","last_fullsized":"2024-09-20T20:34:40.631604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":966,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670666+0000","last_change":"2024-09-20T20:34:39.664844+0000","last_active":"2024-09-20T20:34:42.670666+0000","last_peered":"2024-09-20T20:34:42.670666+0000","last_clean":"2024-09-20T20:34:42.670666+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:34:42.670666+0000","last_undegraded":"2024-09-20T20:34:42.670666+0000","last_fullsized":"2024-09-20T20:34:42.670666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1010,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670184+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:42.670184+0000","last_peered":"2024-09-20T20:34:42.670184+0000","last_clean":"2024-09-20T20:34:42.670184+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:42.670184+0000","last_undegraded":"2024-09-20T20:34:42.670184+0000","last_fullsized":"2024-09-20T20:34:42.670184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":694,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670222+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:42.670222+0000","last_peered":"2024-09-20T20:34:42.670222+0000","last_clean":"2024-09-20T20:34:42.670222+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:42.670222+0000","last_undegraded":"2024-09-20T20:34:42.670222+0000","last_fullsized":"2024-09-20T20:34:42.670222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672720+0000","last_change":"2024-09-20T20:34:38.665667+0000","last_active":"2024-09-20T20:34:42.672720+0000","last_peered":"2024-09-20T20:34:42.672720+0000","last_clean":"2024-09-20T20:34:42.672720+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:34:42.672720+0000","last_undegraded":"2024-09-20T20:34:42.672720+0000","last_fullsized":"2024-09-20T20:34:42.672720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:54.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1085,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672227+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:42.672227+0000","last_peered":"2024-09-20T20:34:42.672227+0000","last_clean":"2024-09-20T20:34:42.672227+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:42.672227+0000","last_undegraded":"2024-09-20T20:34:42.672227+0000","last_fullsized":"2024-09-20T20:34:42.672227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":624,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635213+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:40.635213+0000","last_peered":"2024-09-20T20:34:40.635213+0000","last_clean":"2024-09-20T20:34:40.635213+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:40.635213+0000","last_undegraded":"2024-09-20T20:34:40.635213+0000","last_fullsized":"2024-09-20T20:34:40.635213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671857+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:42.671857+0000","last_peered":"2024-09-20T20:34:42.671857+0000","last_clean":"2024-09-20T20:34:42.671857+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:42.671857+0000","last_undegraded":"2024-09-20T20:34:42.671857+0000","last_fullsized":"2024-09-20T20:34:42.671857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671485+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:42.671485+0000","last_peered":"2024-09-20T20:34:42.671485+0000","last_clean":"2024-09-20T20:34:42.671485+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:42.671485+0000","last_undegraded":"2024-09-20T20:34:42.671485+0000","last_fullsized":"2024-09-20T20:34:42.671485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1021,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671161+0000","last_change":"2024-09-20T20:34:40.670826+0000","last_active":"2024-09-20T20:34:42.671161+0000","last_peered":"2024-09-20T20:34:42.671161+0000","last_clean":"2024-09-20T20:34:42.671161+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:34:42.671161+0000","last_undegraded":"2024-09-20T20:34:42.671161+0000","last_fullsized":"2024-09-20T20:34:42.671161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:58.351454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":620,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670205+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:42.670205+0000","last_peered":"2024-09-20T20:34:42.670205+0000","last_clean":"2024-09-20T20:34:42.670205+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:42.670205+0000","last_undegraded":"2024-09-20T20:34:42.670205+0000","last_fullsized":"2024-09-20T20:34:42.670205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":601,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-20T20:34:37.650356+0000","last_change":"2024-09-20T20:34:18.941542+0000","last_active":"2024-09-20T20:34:37.650356+0000","last_peered":"2024-09-20T20:34:37.650356+0000","last_clean":"2024-09-20T20:31:51.139702+0000","last_became_active":"2024-09-20T20:34:18.938865+0000","last_became_peered":"2024-09-20T20:34:18.938865+0000","last_unstale":"2024-09-20T20:34:37.650356+0000","last_undegraded":"2024-09-20T20:34:18.681013+0000","last_fullsized":"2024-09-20T20:34:18.669358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":497,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":563,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633432+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:40.633432+0000","last_peered":"2024-09-20T20:34:40.633432+0000","last_clean":"2024-09-20T20:34:40.633432+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:40.633432+0000","last_undegraded":"2024-09-20T20:34:40.633432+0000","last_fullsized":"2024-09-20T20:34:40.633432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":535,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671908+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:42.671908+0000","last_peered":"2024-09-20T20:34:42.671908+0000","last_clean":"2024-09-20T20:34:42.671908+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:42.671908+0000","last_undegraded":"2024-09-20T20:34:42.671908+0000","last_fullsized":"2024-09-20T20:34:42.671908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1002,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672706+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:42.672706+0000","last_peered":"2024-09-20T20:34:42.672706+0000","last_clean":"2024-09-20T20:34:42.672706+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:42.672706+0000","last_undegraded":"2024-09-20T20:34:42.672706+0000","last_fullsized":"2024-09-20T20:34:42.672706+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670825+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:42.670825+0000","last_peered":"2024-09-20T20:34:42.670825+0000","last_clean":"2024-09-20T20:34:42.670825+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:42.670825+0000","last_undegraded":"2024-09-20T20:34:42.670825+0000","last_fullsized":"2024-09-20T20:34:42.670825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":943,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.679159+0000","last_change":"2024-09-20T20:34:42.679159+0000","last_active":"2024-09-20T20:34:42.679159+0000","last_peered":"2024-09-20T20:34:42.679159+0000","last_clean":"2024-09-20T20:34:42.679159+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:34:42.679159+0000","last_undegraded":"2024-09-20T20:34:42.679159+0000","last_fullsized":"2024-09-20T20:34:42.679159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633780+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:40.633780+0000","last_peered":"2024-09-20T20:34:40.633780+0000","last_clean":"2024-09-20T20:34:40.633780+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:40.633780+0000","last_undegraded":"2024-09-20T20:34:40.633780+0000","last_fullsized":"2024-09-20T20:34:40.633780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":213,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635542+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:40.635542+0000","last_peered":"2024-09-20T20:34:40.635542+0000","last_clean":"2024-09-20T20:34:40.635542+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:40.635542+0000","last_undegraded":"2024-09-20T20:34:40.635542+0000","last_fullsized":"2024-09-20T20:34:40.635542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":908,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670248+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:42.670248+0000","last_peered":"2024-09-20T20:34:42.670248+0000","last_clean":"2024-09-20T20:34:42.670248+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:42.670248+0000","last_undegraded":"2024-09-20T20:34:42.670248+0000","last_fullsized":"2024-09-20T20:34:42.670248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672716+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:42.672716+0000","last_peered":"2024-09-20T20:34:42.672716+0000","last_clean":"2024-09-20T20:34:42.672716+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:42.672716+0000","last_undegraded":"2024-09-20T20:34:42.672716+0000","last_fullsized":"2024-09-20T20:34:42.672716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670493+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:42.670493+0000","last_peered":"2024-09-20T20:34:42.670493+0000","last_clean":"2024-09-20T20:34:42.670493+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:42.670493+0000","last_undegraded":"2024-09-20T20:34:42.670493+0000","last_fullsized":"2024-09-20T20:34:42.670493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":565,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634877+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:40.634877+0000","last_peered":"2024-09-20T20:34:40.634877+0000","last_clean":"2024-09-20T20:34:40.634877+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:40.634877+0000","last_undegraded":"2024-09-20T20:34:40.634877+0000","last_fullsized":"2024-09-20T20:34:40.634877+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":631,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633749+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:40.633749+0000","last_peered":"2024-09-20T20:34:40.633749+0000","last_clean":"2024-09-20T20:34:40.633749+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:40.633749+0000","last_undegraded":"2024-09-20T20:34:40.633749+0000","last_fullsized":"2024-09-20T20:34:40.633749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633887+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:40.633887+0000","last_peered":"2024-09-20T20:34:40.633887+0000","last_clean":"2024-09-20T20:34:40.633887+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:40.633887+0000","last_undegraded":"2024-09-20T20:34:40.633887+0000","last_fullsized":"2024-09-20T20:34:40.633887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671371+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:42.671371+0000","last_peered":"2024-09-20T20:34:42.671371+0000","last_clean":"2024-09-20T20:34:42.671371+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:42.671371+0000","last_undegraded":"2024-09-20T20:34:42.671371+0000","last_fullsized":"2024-09-20T20:34:42.671371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":377,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672768+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:42.672768+0000","last_peered":"2024-09-20T20:34:42.672768+0000","last_clean":"2024-09-20T20:34:42.672768+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:42.672768+0000","last_undegraded":"2024-09-20T20:34:42.672768+0000","last_fullsized":"2024-09-20T20:34:42.672768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":603,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634343+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:40.634343+0000","last_peered":"2024-09-20T20:34:40.634343+0000","last_clean":"2024-09-20T20:34:40.634343+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:40.634343+0000","last_undegraded":"2024-09-20T20:34:40.634343+0000","last_fullsized":"2024-09-20T20:34:40.634343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":192,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632857+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:40.632857+0000","last_peered":"2024-09-20T20:34:40.632857+0000","last_clean":"2024-09-20T20:34:40.632857+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:40.632857+0000","last_undegraded":"2024-09-20T20:34:40.632857+0000","last_fullsized":"2024-09-20T20:34:40.632857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":574,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634581+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:40.634581+0000","last_peered":"2024-09-20T20:34:40.634581+0000","last_clean":"2024-09-20T20:34:40.634581+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:40.634581+0000","last_undegraded":"2024-09-20T20:34:40.634581+0000","last_fullsized":"2024-09-20T20:34:40.634581+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671097+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:42.671097+0000","last_peered":"2024-09-20T20:34:42.671097+0000","last_clean":"2024-09-20T20:34:42.671097+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:42.671097+0000","last_undegraded":"2024-09-20T20:34:42.671097+0000","last_fullsized":"2024-09-20T20:34:42.671097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":601,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635660+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:40.635660+0000","last_peered":"2024-09-20T20:34:40.635660+0000","last_clean":"2024-09-20T20:34:40.635660+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:40.635660+0000","last_undegraded":"2024-09-20T20:34:40.635660+0000","last_fullsized":"2024-09-20T20:34:40.635660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":649,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670459+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:42.670459+0000","last_peered":"2024-09-20T20:34:42.670459+0000","last_clean":"2024-09-20T20:34:42.670459+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:42.670459+0000","last_undegraded":"2024-09-20T20:34:42.670459+0000","last_fullsized":"2024-09-20T20:34:42.670459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":597,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672394+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:42.672394+0000","last_peered":"2024-09-20T20:34:42.672394+0000","last_clean":"2024-09-20T20:34:42.672394+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:42.672394+0000","last_undegraded":"2024-09-20T20:34:42.672394+0000","last_fullsized":"2024-09-20T20:34:42.672394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":349,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633294+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:40.633294+0000","last_peered":"2024-09-20T20:34:40.633294+0000","last_clean":"2024-09-20T20:34:40.633294+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:40.633294+0000","last_undegraded":"2024-09-20T20:34:40.633294+0000","last_fullsized":"2024-09-20T20:34:40.633294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":89,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632789+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:40.632789+0000","last_peered":"2024-09-20T20:34:40.632789+0000","last_clean":"2024-09-20T20:34:40.632789+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:40.632789+0000","last_undegraded":"2024-09-20T20:34:40.632789+0000","last_fullsized":"2024-09-20T20:34:40.632789+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":728,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672067+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:42.672067+0000","last_peered":"2024-09-20T20:34:42.672067+0000","last_clean":"2024-09-20T20:34:42.672067+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:42.672067+0000","last_undegraded":"2024-09-20T20:34:42.672067+0000","last_fullsized":"2024-09-20T20:34:42.672067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":592,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635003+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:40.635003+0000","last_peered":"2024-09-20T20:34:40.635003+0000","last_clean":"2024-09-20T20:34:40.635003+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:40.635003+0000","last_undegraded":"2024-09-20T20:34:40.635003+0000","last_fullsized":"2024-09-20T20:34:40.635003+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.634940+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:40.634940+0000","last_peered":"2024-09-20T20:34:40.634940+0000","last_clean":"2024-09-20T20:34:40.634940+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:40.634940+0000","last_undegraded":"2024-09-20T20:34:40.634940+0000","last_fullsized":"2024-09-20T20:34:40.634940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":372,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670895+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:42.670895+0000","last_peered":"2024-09-20T20:34:42.670895+0000","last_clean":"2024-09-20T20:34:42.670895+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:42.670895+0000","last_undegraded":"2024-09-20T20:34:42.670895+0000","last_fullsized":"2024-09-20T20:34:42.670895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672614+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:42.672614+0000","last_peered":"2024-09-20T20:34:42.672614+0000","last_clean":"2024-09-20T20:34:42.672614+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:42.672614+0000","last_undegraded":"2024-09-20T20:34:42.672614+0000","last_fullsized":"2024-09-20T20:34:42.672614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670548+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:42.670548+0000","last_peered":"2024-09-20T20:34:42.670548+0000","last_clean":"2024-09-20T20:34:42.670548+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:42.670548+0000","last_undegraded":"2024-09-20T20:34:42.670548+0000","last_fullsized":"2024-09-20T20:34:42.670548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672623+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:42.672623+0000","last_peered":"2024-09-20T20:34:42.672623+0000","last_clean":"2024-09-20T20:34:42.672623+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:42.672623+0000","last_undegraded":"2024-09-20T20:34:42.672623+0000","last_fullsized":"2024-09-20T20:34:42.672623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632438+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:40.632438+0000","last_peered":"2024-09-20T20:34:40.632438+0000","last_clean":"2024-09-20T20:34:40.632438+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:40.632438+0000","last_undegraded":"2024-09-20T20:34:40.632438+0000","last_fullsized":"2024-09-20T20:34:40.632438+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633112+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:40.633112+0000","last_peered":"2024-09-20T20:34:40.633112+0000","last_clean":"2024-09-20T20:34:40.633112+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:40.633112+0000","last_undegraded":"2024-09-20T20:34:40.633112+0000","last_fullsized":"2024-09-20T20:34:40.633112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672046+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:42.672046+0000","last_peered":"2024-09-20T20:34:42.672046+0000","last_clean":"2024-09-20T20:34:42.672046+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:42.672046+0000","last_undegraded":"2024-09-20T20:34:42.672046+0000","last_fullsized":"2024-09-20T20:34:42.672046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":323,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633075+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:40.633075+0000","last_peered":"2024-09-20T20:34:40.633075+0000","last_clean":"2024-09-20T20:34:40.633075+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:40.633075+0000","last_undegraded":"2024-09-20T20:34:40.633075+0000","last_fullsized":"2024-09-20T20:34:40.633075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672338+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:42.672338+0000","last_peered":"2024-09-20T20:34:42.672338+0000","last_clean":"2024-09-20T20:34:42.672338+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:42.672338+0000","last_undegraded":"2024-09-20T20:34:42.672338+0000","last_fullsized":"2024-09-20T20:34:42.672338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":842,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670969+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:42.670969+0000","last_peered":"2024-09-20T20:34:42.670969+0000","last_clean":"2024-09-20T20:34:42.670969+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:42.670969+0000","last_undegraded":"2024-09-20T20:34:42.670969+0000","last_fullsized":"2024-09-20T20:34:42.670969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672097+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:42.672097+0000","last_peered":"2024-09-20T20:34:42.672097+0000","last_clean":"2024-09-20T20:34:42.672097+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:42.672097+0000","last_undegraded":"2024-09-20T20:34:42.672097+0000","last_fullsized":"2024-09-20T20:34:42.672097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672545+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:42.672545+0000","last_peered":"2024-09-20T20:34:42.672545+0000","last_clean":"2024-09-20T20:34:42.672545+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:42.672545+0000","last_undegraded":"2024-09-20T20:34:42.672545+0000","last_fullsized":"2024-09-20T20:34:42.672545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":898,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671061+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:42.671061+0000","last_peered":"2024-09-20T20:34:42.671061+0000","last_clean":"2024-09-20T20:34:42.671061+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:42.671061+0000","last_undegraded":"2024-09-20T20:34:42.671061+0000","last_fullsized":"2024-09-20T20:34:42.671061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673319+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:42.673319+0000","last_peered":"2024-09-20T20:34:42.673319+0000","last_clean":"2024-09-20T20:34:42.673319+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:42.673319+0000","last_undegraded":"2024-09-20T20:34:42.673319+0000","last_fullsized":"2024-09-20T20:34:42.673319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672991+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:42.672991+0000","last_peered":"2024-09-20T20:34:42.672991+0000","last_clean":"2024-09-20T20:34:42.672991+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:42.672991+0000","last_undegraded":"2024-09-20T20:34:42.672991+0000","last_fullsized":"2024-09-20T20:34:42.672991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1061,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670650+0000","last_change":"2024-09-20T20:34:41.673197+0000","last_active":"2024-09-20T20:34:42.670650+0000","last_peered":"2024-09-20T20:34:42.670650+0000","last_clean":"2024-09-20T20:34:42.670650+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:34:42.670650+0000","last_undegraded":"2024-09-20T20:34:42.670650+0000","last_fullsized":"2024-09-20T20:34:42.670650+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672875+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:42.672875+0000","last_peered":"2024-09-20T20:34:42.672875+0000","last_clean":"2024-09-20T20:34:42.672875+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:42.672875+0000","last_undegraded":"2024-09-20T20:34:42.672875+0000","last_fullsized":"2024-09-20T20:34:42.672875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635079+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:40.635079+0000","last_peered":"2024-09-20T20:34:40.635079+0000","last_clean":"2024-09-20T20:34:40.635079+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:40.635079+0000","last_undegraded":"2024-09-20T20:34:40.635079+0000","last_fullsized":"2024-09-20T20:34:40.635079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670502+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:42.670502+0000","last_peered":"2024-09-20T20:34:42.670502+0000","last_clean":"2024-09-20T20:34:42.670502+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:42.670502+0000","last_undegraded":"2024-09-20T20:34:42.670502+0000","last_fullsized":"2024-09-20T20:34:42.670502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":570,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633892+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:40.633892+0000","last_peered":"2024-09-20T20:34:40.633892+0000","last_clean":"2024-09-20T20:34:40.633892+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:40.633892+0000","last_undegraded":"2024-09-20T20:34:40.633892+0000","last_fullsized":"2024-09-20T20:34:40.633892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":433,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.632877+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:40.632877+0000","last_peered":"2024-09-20T20:34:40.632877+0000","last_clean":"2024-09-20T20:34:40.632877+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:40.632877+0000","last_undegraded":"2024-09-20T20:34:40.632877+0000","last_fullsized":"2024-09-20T20:34:40.632877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":591,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670675+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:42.670675+0000","last_peered":"2024-09-20T20:34:42.670675+0000","last_clean":"2024-09-20T20:34:42.670675+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:42.670675+0000","last_undegraded":"2024-09-20T20:34:42.670675+0000","last_fullsized":"2024-09-20T20:34:42.670675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":268,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672378+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:42.672378+0000","last_peered":"2024-09-20T20:34:42.672378+0000","last_clean":"2024-09-20T20:34:42.672378+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:42.672378+0000","last_undegraded":"2024-09-20T20:34:42.672378+0000","last_fullsized":"2024-09-20T20:34:42.672378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":268,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635218+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:40.635218+0000","last_peered":"2024-09-20T20:34:40.635218+0000","last_clean":"2024-09-20T20:34:40.635218+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:40.635218+0000","last_undegraded":"2024-09-20T20:34:40.635218+0000","last_fullsized":"2024-09-20T20:34:40.635218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1088,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670557+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:42.670557+0000","last_peered":"2024-09-20T20:34:42.670557+0000","last_clean":"2024-09-20T20:34:42.670557+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:42.670557+0000","last_undegraded":"2024-09-20T20:34:42.670557+0000","last_fullsized":"2024-09-20T20:34:42.670557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673111+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:42.673111+0000","last_peered":"2024-09-20T20:34:42.673111+0000","last_clean":"2024-09-20T20:34:42.673111+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:42.673111+0000","last_undegraded":"2024-09-20T20:34:42.673111+0000","last_fullsized":"2024-09-20T20:34:42.673111+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":676,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670536+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:42.670536+0000","last_peered":"2024-09-20T20:34:42.670536+0000","last_clean":"2024-09-20T20:34:42.670536+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:42.670536+0000","last_undegraded":"2024-09-20T20:34:42.670536+0000","last_fullsized":"2024-09-20T20:34:42.670536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":846,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672855+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:42.672855+0000","last_peered":"2024-09-20T20:34:42.672855+0000","last_clean":"2024-09-20T20:34:42.672855+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:42.672855+0000","last_undegraded":"2024-09-20T20:34:42.672855+0000","last_fullsized":"2024-09-20T20:34:42.672855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":866,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670990+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:42.670990+0000","last_peered":"2024-09-20T20:34:42.670990+0000","last_clean":"2024-09-20T20:34:42.670990+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:42.670990+0000","last_undegraded":"2024-09-20T20:34:42.670990+0000","last_fullsized":"2024-09-20T20:34:42.670990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672283+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:42.672283+0000","last_peered":"2024-09-20T20:34:42.672283+0000","last_clean":"2024-09-20T20:34:42.672283+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:42.672283+0000","last_undegraded":"2024-09-20T20:34:42.672283+0000","last_fullsized":"2024-09-20T20:34:42.672283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":364,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670891+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:42.670891+0000","last_peered":"2024-09-20T20:34:42.670891+0000","last_clean":"2024-09-20T20:34:42.670891+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:42.670891+0000","last_undegraded":"2024-09-20T20:34:42.670891+0000","last_fullsized":"2024-09-20T20:34:42.670891+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671738+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:42.671738+0000","last_peered":"2024-09-20T20:34:42.671738+0000","last_clean":"2024-09-20T20:34:42.671738+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:42.671738+0000","last_undegraded":"2024-09-20T20:34:42.671738+0000","last_fullsized":"2024-09-20T20:34:42.671738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671260+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:42.671260+0000","last_peered":"2024-09-20T20:34:42.671260+0000","last_clean":"2024-09-20T20:34:42.671260+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:42.671260+0000","last_undegraded":"2024-09-20T20:34:42.671260+0000","last_fullsized":"2024-09-20T20:34:42.671260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":538,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671557+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:42.671557+0000","last_peered":"2024-09-20T20:34:42.671557+0000","last_clean":"2024-09-20T20:34:42.671557+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:42.671557+0000","last_undegraded":"2024-09-20T20:34:42.671557+0000","last_fullsized":"2024-09-20T20:34:42.671557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671334+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:42.671334+0000","last_peered":"2024-09-20T20:34:42.671334+0000","last_clean":"2024-09-20T20:34:42.671334+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:42.671334+0000","last_undegraded":"2024-09-20T20:34:42.671334+0000","last_fullsized":"2024-09-20T20:34:42.671334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":558,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.635840+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:40.635840+0000","last_peered":"2024-09-20T20:34:40.635840+0000","last_clean":"2024-09-20T20:34:40.635840+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:40.635840+0000","last_undegraded":"2024-09-20T20:34:40.635840+0000","last_fullsized":"2024-09-20T20:34:40.635840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":366,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633181+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:40.633181+0000","last_peered":"2024-09-20T20:34:40.633181+0000","last_clean":"2024-09-20T20:34:40.633181+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:40.633181+0000","last_undegraded":"2024-09-20T20:34:40.633181+0000","last_fullsized":"2024-09-20T20:34:40.633181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":574,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.633138+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:40.633138+0000","last_peered":"2024-09-20T20:34:40.633138+0000","last_clean":"2024-09-20T20:34:40.633138+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:40.633138+0000","last_undegraded":"2024-09-20T20:34:40.633138+0000","last_fullsized":"2024-09-20T20:34:40.633138+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672043+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:42.672043+0000","last_peered":"2024-09-20T20:34:42.672043+0000","last_clean":"2024-09-20T20:34:42.672043+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:42.672043+0000","last_undegraded":"2024-09-20T20:34:42.672043+0000","last_fullsized":"2024-09-20T20:34:42.672043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671503+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:42.671503+0000","last_peered":"2024-09-20T20:34:42.671503+0000","last_clean":"2024-09-20T20:34:42.671503+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:42.671503+0000","last_undegraded":"2024-09-20T20:34:42.671503+0000","last_fullsized":"2024-09-20T20:34:42.671503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672549+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:42.672549+0000","last_peered":"2024-09-20T20:34:42.672549+0000","last_clean":"2024-09-20T20:34:42.672549+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:42.672549+0000","last_undegraded":"2024-09-20T20:34:42.672549+0000","last_fullsized":"2024-09-20T20:34:42.672549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":581,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-20T20:34:40.642728+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:40.642728+0000","last_peered":"2024-09-20T20:34:40.642728+0000","last_clean":"2024-09-20T20:34:40.642728+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:40.642728+0000","last_undegraded":"2024-09-20T20:34:40.642728+0000","last_fullsized":"2024-09-20T20:34:40.642728+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672824+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:42.672824+0000","last_peered":"2024-09-20T20:34:42.672824+0000","last_clean":"2024-09-20T20:34:42.672824+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:42.672824+0000","last_undegraded":"2024-09-20T20:34:42.672824+0000","last_fullsized":"2024-09-20T20:34:42.672824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6358,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":739717,"data_compressed":113351,"data_compressed_allocated":135168,"data_compressed_original":319488,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":127,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99328,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272512,"statfs":{"total":96636764160,"available":96535052288,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104348,"kb_used_data":28808,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267492,"statfs":{"total":96636764160,"available":96529911808,"internally_reserved":0,"allocated":29499392,"data_stored":85105638,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58516,"kb_used_data":24824,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94313324,"statfs":{"total":96636764160,"available":96576843776,"internally_reserved":0,"allocated":25419776,"data_stored":93138811,"data_compressed":14065308,"data_compressed_allocated":17244160,"data_compressed_original":85942272,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":739717,"data_compressed":113351,"data_compressed_allocated":135168,"data_compressed_original":319488,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:50.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:50.492 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:50.494 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:50.511 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-20T20:34:49.725664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6689,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":261012,"kb_used_data":80404,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282854508,"statfs":{"total":289910292480,"available":289643016192,"internally_reserved":0,"allocated":82333696,"data_stored":257450488,"data_compressed":37624865,"data_compressed_allocated":48259072,"data_compressed_original":224894976,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":906,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.063578"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672420+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:42.672420+0000","last_peered":"2024-09-20T20:34:42.672420+0000","last_clean":"2024-09-20T20:34:42.672420+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:42.672420+0000","last_undegraded":"2024-09-20T20:34:42.672420+0000","last_fullsized":"2024-09-20T20:34:42.672420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":669,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672061+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:42.672061+0000","last_peered":"2024-09-20T20:34:42.672061+0000","last_clean":"2024-09-20T20:34:42.672061+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:42.672061+0000","last_undegraded":"2024-09-20T20:34:42.672061+0000","last_fullsized":"2024-09-20T20:34:42.672061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643927+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:42.643927+0000","last_peered":"2024-09-20T20:34:42.643927+0000","last_clean":"2024-09-20T20:34:42.643927+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:42.643927+0000","last_undegraded":"2024-09-20T20:34:42.643927+0000","last_fullsized":"2024-09-20T20:34:42.643927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":563,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642893+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:42.642893+0000","last_peered":"2024-09-20T20:34:42.642893+0000","last_clean":"2024-09-20T20:34:42.642893+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:42.642893+0000","last_undegraded":"2024-09-20T20:34:42.642893+0000","last_fullsized":"2024-09-20T20:34:42.642893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":519,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":581,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641951+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:42.641951+0000","last_peered":"2024-09-20T20:34:42.641951+0000","last_clean":"2024-09-20T20:34:42.641951+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:42.641951+0000","last_undegraded":"2024-09-20T20:34:42.641951+0000","last_fullsized":"2024-09-20T20:34:42.641951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641453+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:42.641453+0000","last_peered":"2024-09-20T20:34:42.641453+0000","last_clean":"2024-09-20T20:34:42.641453+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:42.641453+0000","last_undegraded":"2024-09-20T20:34:42.641453+0000","last_fullsized":"2024-09-20T20:34:42.641453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":584,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641806+0000","last_change":"2024-09-20T20:34:41.640769+0000","last_active":"2024-09-20T20:34:42.641806+0000","last_peered":"2024-09-20T20:34:42.641806+0000","last_clean":"2024-09-20T20:34:42.641806+0000","last_became_active":"2024-09-20T20:34:41.636093+0000","last_became_peered":"2024-09-20T20:34:41.636093+0000","last_unstale":"2024-09-20T20:34:42.641806+0000","last_undegraded":"2024-09-20T20:34:42.641806+0000","last_fullsized":"2024-09-20T20:34:42.641806+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:33.620852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672250+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:42.672250+0000","last_peered":"2024-09-20T20:34:42.672250+0000","last_clean":"2024-09-20T20:34:42.672250+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:42.672250+0000","last_undegraded":"2024-09-20T20:34:42.672250+0000","last_fullsized":"2024-09-20T20:34:42.672250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":573,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672463+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:42.672463+0000","last_peered":"2024-09-20T20:34:42.672463+0000","last_clean":"2024-09-20T20:34:42.672463+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:42.672463+0000","last_undegraded":"2024-09-20T20:34:42.672463+0000","last_fullsized":"2024-09-20T20:34:42.672463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643823+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:42.643823+0000","last_peered":"2024-09-20T20:34:42.643823+0000","last_clean":"2024-09-20T20:34:42.643823+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:42.643823+0000","last_undegraded":"2024-09-20T20:34:42.643823+0000","last_fullsized":"2024-09-20T20:34:42.643823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":818,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671401+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:42.671401+0000","last_peered":"2024-09-20T20:34:42.671401+0000","last_clean":"2024-09-20T20:34:42.671401+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:42.671401+0000","last_undegraded":"2024-09-20T20:34:42.671401+0000","last_fullsized":"2024-09-20T20:34:42.671401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670951+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:42.670951+0000","last_peered":"2024-09-20T20:34:42.670951+0000","last_clean":"2024-09-20T20:34:42.670951+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:42.670951+0000","last_undegraded":"2024-09-20T20:34:42.670951+0000","last_fullsized":"2024-09-20T20:34:42.670951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":603,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641827+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:42.641827+0000","last_peered":"2024-09-20T20:34:42.641827+0000","last_clean":"2024-09-20T20:34:42.641827+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:42.641827+0000","last_undegraded":"2024-09-20T20:34:42.641827+0000","last_fullsized":"2024-09-20T20:34:42.641827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":698,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641333+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:42.641333+0000","last_peered":"2024-09-20T20:34:42.641333+0000","last_clean":"2024-09-20T20:34:42.641333+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:42.641333+0000","last_undegraded":"2024-09-20T20:34:42.641333+0000","last_fullsized":"2024-09-20T20:34:42.641333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642189+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:42.642189+0000","last_peered":"2024-09-20T20:34:42.642189+0000","last_clean":"2024-09-20T20:34:42.642189+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:42.642189+0000","last_undegraded":"2024-09-20T20:34:42.642189+0000","last_fullsized":"2024-09-20T20:34:42.642189+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673148+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:42.673148+0000","last_peered":"2024-09-20T20:34:42.673148+0000","last_clean":"2024-09-20T20:34:42.673148+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:42.673148+0000","last_undegraded":"2024-09-20T20:34:42.673148+0000","last_fullsized":"2024-09-20T20:34:42.673148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672427+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:42.672427+0000","last_peered":"2024-09-20T20:34:42.672427+0000","last_clean":"2024-09-20T20:34:42.672427+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:42.672427+0000","last_undegraded":"2024-09-20T20:34:42.672427+0000","last_fullsized":"2024-09-20T20:34:42.672427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":646,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671368+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:42.671368+0000","last_peered":"2024-09-20T20:34:42.671368+0000","last_clean":"2024-09-20T20:34:42.671368+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:42.671368+0000","last_undegraded":"2024-09-20T20:34:42.671368+0000","last_fullsized":"2024-09-20T20:34:42.671368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643226+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:42.643226+0000","last_peered":"2024-09-20T20:34:42.643226+0000","last_clean":"2024-09-20T20:34:42.643226+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:42.643226+0000","last_undegraded":"2024-09-20T20:34:42.643226+0000","last_fullsized":"2024-09-20T20:34:42.643226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642735+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:42.642735+0000","last_peered":"2024-09-20T20:34:42.642735+0000","last_clean":"2024-09-20T20:34:42.642735+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:42.642735+0000","last_undegraded":"2024-09-20T20:34:42.642735+0000","last_fullsized":"2024-09-20T20:34:42.642735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":966,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670666+0000","last_change":"2024-09-20T20:34:39.664844+0000","last_active":"2024-09-20T20:34:42.670666+0000","last_peered":"2024-09-20T20:34:42.670666+0000","last_clean":"2024-09-20T20:34:42.670666+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:34:42.670666+0000","last_undegraded":"2024-09-20T20:34:42.670666+0000","last_fullsized":"2024-09-20T20:34:42.670666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1010,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670184+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:42.670184+0000","last_peered":"2024-09-20T20:34:42.670184+0000","last_clean":"2024-09-20T20:34:42.670184+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:42.670184+0000","last_undegraded":"2024-09-20T20:34:42.670184+0000","last_fullsized":"2024-09-20T20:34:42.670184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":694,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670222+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:42.670222+0000","last_peered":"2024-09-20T20:34:42.670222+0000","last_clean":"2024-09-20T20:34:42.670222+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:42.670222+0000","last_undegraded":"2024-09-20T20:34:42.670222+0000","last_fullsized":"2024-09-20T20:34:42.670222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672720+0000","last_change":"2024-09-20T20:34:38.665667+0000","last_active":"2024-09-20T20:34:42.672720+0000","last_peered":"2024-09-20T20:34:42.672720+0000","last_clean":"2024-09-20T20:34:42.672720+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:34:42.672720+0000","last_undegraded":"2024-09-20T20:34:42.672720+0000","last_fullsized":"2024-09-20T20:34:42.672720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:54.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1085,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672227+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:42.672227+0000","last_peered":"2024-09-20T20:34:42.672227+0000","last_clean":"2024-09-20T20:34:42.672227+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:42.672227+0000","last_undegraded":"2024-09-20T20:34:42.672227+0000","last_fullsized":"2024-09-20T20:34:42.672227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":628,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643749+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:42.643749+0000","last_peered":"2024-09-20T20:34:42.643749+0000","last_clean":"2024-09-20T20:34:42.643749+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:42.643749+0000","last_undegraded":"2024-09-20T20:34:42.643749+0000","last_fullsized":"2024-09-20T20:34:42.643749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671857+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:42.671857+0000","last_peered":"2024-09-20T20:34:42.671857+0000","last_clean":"2024-09-20T20:34:42.671857+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:42.671857+0000","last_undegraded":"2024-09-20T20:34:42.671857+0000","last_fullsized":"2024-09-20T20:34:42.671857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671485+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:42.671485+0000","last_peered":"2024-09-20T20:34:42.671485+0000","last_clean":"2024-09-20T20:34:42.671485+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:42.671485+0000","last_undegraded":"2024-09-20T20:34:42.671485+0000","last_fullsized":"2024-09-20T20:34:42.671485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1021,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671161+0000","last_change":"2024-09-20T20:34:40.670826+0000","last_active":"2024-09-20T20:34:42.671161+0000","last_peered":"2024-09-20T20:34:42.671161+0000","last_clean":"2024-09-20T20:34:42.671161+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:34:42.671161+0000","last_undegraded":"2024-09-20T20:34:42.671161+0000","last_fullsized":"2024-09-20T20:34:42.671161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:58.351454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":620,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670205+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:42.670205+0000","last_peered":"2024-09-20T20:34:42.670205+0000","last_clean":"2024-09-20T20:34:42.670205+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:42.670205+0000","last_undegraded":"2024-09-20T20:34:42.670205+0000","last_fullsized":"2024-09-20T20:34:42.670205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.648962+0000","last_change":"2024-09-20T20:34:42.648962+0000","last_active":"2024-09-20T20:34:42.648962+0000","last_peered":"2024-09-20T20:34:42.648962+0000","last_clean":"2024-09-20T20:34:42.648962+0000","last_became_active":"2024-09-20T20:34:42.644350+0000","last_became_peered":"2024-09-20T20:34:42.644350+0000","last_unstale":"2024-09-20T20:34:42.648962+0000","last_undegraded":"2024-09-20T20:34:42.648962+0000","last_fullsized":"2024-09-20T20:34:42.648962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:04.662945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":497,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":567,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641959+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:42.641959+0000","last_peered":"2024-09-20T20:34:42.641959+0000","last_clean":"2024-09-20T20:34:42.641959+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:42.641959+0000","last_undegraded":"2024-09-20T20:34:42.641959+0000","last_fullsized":"2024-09-20T20:34:42.641959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":535,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671908+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:42.671908+0000","last_peered":"2024-09-20T20:34:42.671908+0000","last_clean":"2024-09-20T20:34:42.671908+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:42.671908+0000","last_undegraded":"2024-09-20T20:34:42.671908+0000","last_fullsized":"2024-09-20T20:34:42.671908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1003,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672857+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:42.672857+0000","last_peered":"2024-09-20T20:34:42.672857+0000","last_clean":"2024-09-20T20:34:42.672857+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:42.672857+0000","last_undegraded":"2024-09-20T20:34:42.672857+0000","last_fullsized":"2024-09-20T20:34:42.672857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670825+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:42.670825+0000","last_peered":"2024-09-20T20:34:42.670825+0000","last_clean":"2024-09-20T20:34:42.670825+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:42.670825+0000","last_undegraded":"2024-09-20T20:34:42.670825+0000","last_fullsized":"2024-09-20T20:34:42.670825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.680079+0000","last_change":"2024-09-20T20:34:42.679159+0000","last_active":"2024-09-20T20:34:42.680079+0000","last_peered":"2024-09-20T20:34:42.680079+0000","last_clean":"2024-09-20T20:34:42.680079+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:34:42.680079+0000","last_undegraded":"2024-09-20T20:34:42.680079+0000","last_fullsized":"2024-09-20T20:34:42.680079+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641095+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:42.641095+0000","last_peered":"2024-09-20T20:34:42.641095+0000","last_clean":"2024-09-20T20:34:42.641095+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:42.641095+0000","last_undegraded":"2024-09-20T20:34:42.641095+0000","last_fullsized":"2024-09-20T20:34:42.641095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.644300+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:42.644300+0000","last_peered":"2024-09-20T20:34:42.644300+0000","last_clean":"2024-09-20T20:34:42.644300+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:42.644300+0000","last_undegraded":"2024-09-20T20:34:42.644300+0000","last_fullsized":"2024-09-20T20:34:42.644300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":908,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670248+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:42.670248+0000","last_peered":"2024-09-20T20:34:42.670248+0000","last_clean":"2024-09-20T20:34:42.670248+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:42.670248+0000","last_undegraded":"2024-09-20T20:34:42.670248+0000","last_fullsized":"2024-09-20T20:34:42.670248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672716+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:42.672716+0000","last_peered":"2024-09-20T20:34:42.672716+0000","last_clean":"2024-09-20T20:34:42.672716+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:42.672716+0000","last_undegraded":"2024-09-20T20:34:42.672716+0000","last_fullsized":"2024-09-20T20:34:42.672716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670493+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:42.670493+0000","last_peered":"2024-09-20T20:34:42.670493+0000","last_clean":"2024-09-20T20:34:42.670493+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:42.670493+0000","last_undegraded":"2024-09-20T20:34:42.670493+0000","last_fullsized":"2024-09-20T20:34:42.670493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643435+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:42.643435+0000","last_peered":"2024-09-20T20:34:42.643435+0000","last_clean":"2024-09-20T20:34:42.643435+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:42.643435+0000","last_undegraded":"2024-09-20T20:34:42.643435+0000","last_fullsized":"2024-09-20T20:34:42.643435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642118+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:42.642118+0000","last_peered":"2024-09-20T20:34:42.642118+0000","last_clean":"2024-09-20T20:34:42.642118+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:42.642118+0000","last_undegraded":"2024-09-20T20:34:42.642118+0000","last_fullsized":"2024-09-20T20:34:42.642118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642945+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:42.642945+0000","last_peered":"2024-09-20T20:34:42.642945+0000","last_clean":"2024-09-20T20:34:42.642945+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:42.642945+0000","last_undegraded":"2024-09-20T20:34:42.642945+0000","last_fullsized":"2024-09-20T20:34:42.642945+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671371+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:42.671371+0000","last_peered":"2024-09-20T20:34:42.671371+0000","last_clean":"2024-09-20T20:34:42.671371+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:42.671371+0000","last_undegraded":"2024-09-20T20:34:42.671371+0000","last_fullsized":"2024-09-20T20:34:42.671371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":377,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672768+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:42.672768+0000","last_peered":"2024-09-20T20:34:42.672768+0000","last_clean":"2024-09-20T20:34:42.672768+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:42.672768+0000","last_undegraded":"2024-09-20T20:34:42.672768+0000","last_fullsized":"2024-09-20T20:34:42.672768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643508+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:42.643508+0000","last_peered":"2024-09-20T20:34:42.643508+0000","last_clean":"2024-09-20T20:34:42.643508+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:42.643508+0000","last_undegraded":"2024-09-20T20:34:42.643508+0000","last_fullsized":"2024-09-20T20:34:42.643508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641377+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:42.641377+0000","last_peered":"2024-09-20T20:34:42.641377+0000","last_clean":"2024-09-20T20:34:42.641377+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:42.641377+0000","last_undegraded":"2024-09-20T20:34:42.641377+0000","last_fullsized":"2024-09-20T20:34:42.641377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643266+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:42.643266+0000","last_peered":"2024-09-20T20:34:42.643266+0000","last_clean":"2024-09-20T20:34:42.643266+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:42.643266+0000","last_undegraded":"2024-09-20T20:34:42.643266+0000","last_fullsized":"2024-09-20T20:34:42.643266+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671097+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:42.671097+0000","last_peered":"2024-09-20T20:34:42.671097+0000","last_clean":"2024-09-20T20:34:42.671097+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:42.671097+0000","last_undegraded":"2024-09-20T20:34:42.671097+0000","last_fullsized":"2024-09-20T20:34:42.671097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":605,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643737+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:42.643737+0000","last_peered":"2024-09-20T20:34:42.643737+0000","last_clean":"2024-09-20T20:34:42.643737+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:42.643737+0000","last_undegraded":"2024-09-20T20:34:42.643737+0000","last_fullsized":"2024-09-20T20:34:42.643737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":649,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670459+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:42.670459+0000","last_peered":"2024-09-20T20:34:42.670459+0000","last_clean":"2024-09-20T20:34:42.670459+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:42.670459+0000","last_undegraded":"2024-09-20T20:34:42.670459+0000","last_fullsized":"2024-09-20T20:34:42.670459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":597,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672394+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:42.672394+0000","last_peered":"2024-09-20T20:34:42.672394+0000","last_clean":"2024-09-20T20:34:42.672394+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:42.672394+0000","last_undegraded":"2024-09-20T20:34:42.672394+0000","last_fullsized":"2024-09-20T20:34:42.672394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":353,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640514+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:42.640514+0000","last_peered":"2024-09-20T20:34:42.640514+0000","last_clean":"2024-09-20T20:34:42.640514+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:42.640514+0000","last_undegraded":"2024-09-20T20:34:42.640514+0000","last_fullsized":"2024-09-20T20:34:42.640514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":93,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641106+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:42.641106+0000","last_peered":"2024-09-20T20:34:42.641106+0000","last_clean":"2024-09-20T20:34:42.641106+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:42.641106+0000","last_undegraded":"2024-09-20T20:34:42.641106+0000","last_fullsized":"2024-09-20T20:34:42.641106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":728,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672067+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:42.672067+0000","last_peered":"2024-09-20T20:34:42.672067+0000","last_clean":"2024-09-20T20:34:42.672067+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:42.672067+0000","last_undegraded":"2024-09-20T20:34:42.672067+0000","last_fullsized":"2024-09-20T20:34:42.672067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643546+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:42.643546+0000","last_peered":"2024-09-20T20:34:42.643546+0000","last_clean":"2024-09-20T20:34:42.643546+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:42.643546+0000","last_undegraded":"2024-09-20T20:34:42.643546+0000","last_fullsized":"2024-09-20T20:34:42.643546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641946+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:42.641946+0000","last_peered":"2024-09-20T20:34:42.641946+0000","last_clean":"2024-09-20T20:34:42.641946+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:42.641946+0000","last_undegraded":"2024-09-20T20:34:42.641946+0000","last_fullsized":"2024-09-20T20:34:42.641946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":372,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670895+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:42.670895+0000","last_peered":"2024-09-20T20:34:42.670895+0000","last_clean":"2024-09-20T20:34:42.670895+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:42.670895+0000","last_undegraded":"2024-09-20T20:34:42.670895+0000","last_fullsized":"2024-09-20T20:34:42.670895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672614+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:42.672614+0000","last_peered":"2024-09-20T20:34:42.672614+0000","last_clean":"2024-09-20T20:34:42.672614+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:42.672614+0000","last_undegraded":"2024-09-20T20:34:42.672614+0000","last_fullsized":"2024-09-20T20:34:42.672614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670548+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:42.670548+0000","last_peered":"2024-09-20T20:34:42.670548+0000","last_clean":"2024-09-20T20:34:42.670548+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:42.670548+0000","last_undegraded":"2024-09-20T20:34:42.670548+0000","last_fullsized":"2024-09-20T20:34:42.670548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672623+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:42.672623+0000","last_peered":"2024-09-20T20:34:42.672623+0000","last_clean":"2024-09-20T20:34:42.672623+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:42.672623+0000","last_undegraded":"2024-09-20T20:34:42.672623+0000","last_fullsized":"2024-09-20T20:34:42.672623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640901+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:42.640901+0000","last_peered":"2024-09-20T20:34:42.640901+0000","last_clean":"2024-09-20T20:34:42.640901+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:42.640901+0000","last_undegraded":"2024-09-20T20:34:42.640901+0000","last_fullsized":"2024-09-20T20:34:42.640901+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641845+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:42.641845+0000","last_peered":"2024-09-20T20:34:42.641845+0000","last_clean":"2024-09-20T20:34:42.641845+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:42.641845+0000","last_undegraded":"2024-09-20T20:34:42.641845+0000","last_fullsized":"2024-09-20T20:34:42.641845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672046+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:42.672046+0000","last_peered":"2024-09-20T20:34:42.672046+0000","last_clean":"2024-09-20T20:34:42.672046+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:42.672046+0000","last_undegraded":"2024-09-20T20:34:42.672046+0000","last_fullsized":"2024-09-20T20:34:42.672046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":327,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642890+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:42.642890+0000","last_peered":"2024-09-20T20:34:42.642890+0000","last_clean":"2024-09-20T20:34:42.642890+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:42.642890+0000","last_undegraded":"2024-09-20T20:34:42.642890+0000","last_fullsized":"2024-09-20T20:34:42.642890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672338+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:42.672338+0000","last_peered":"2024-09-20T20:34:42.672338+0000","last_clean":"2024-09-20T20:34:42.672338+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:42.672338+0000","last_undegraded":"2024-09-20T20:34:42.672338+0000","last_fullsized":"2024-09-20T20:34:42.672338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":842,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670969+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:42.670969+0000","last_peered":"2024-09-20T20:34:42.670969+0000","last_clean":"2024-09-20T20:34:42.670969+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:42.670969+0000","last_undegraded":"2024-09-20T20:34:42.670969+0000","last_fullsized":"2024-09-20T20:34:42.670969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672097+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:42.672097+0000","last_peered":"2024-09-20T20:34:42.672097+0000","last_clean":"2024-09-20T20:34:42.672097+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:42.672097+0000","last_undegraded":"2024-09-20T20:34:42.672097+0000","last_fullsized":"2024-09-20T20:34:42.672097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672545+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:42.672545+0000","last_peered":"2024-09-20T20:34:42.672545+0000","last_clean":"2024-09-20T20:34:42.672545+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:42.672545+0000","last_undegraded":"2024-09-20T20:34:42.672545+0000","last_fullsized":"2024-09-20T20:34:42.672545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":898,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671061+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:42.671061+0000","last_peered":"2024-09-20T20:34:42.671061+0000","last_clean":"2024-09-20T20:34:42.671061+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:42.671061+0000","last_undegraded":"2024-09-20T20:34:42.671061+0000","last_fullsized":"2024-09-20T20:34:42.671061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673319+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:42.673319+0000","last_peered":"2024-09-20T20:34:42.673319+0000","last_clean":"2024-09-20T20:34:42.673319+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:42.673319+0000","last_undegraded":"2024-09-20T20:34:42.673319+0000","last_fullsized":"2024-09-20T20:34:42.673319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672991+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:42.672991+0000","last_peered":"2024-09-20T20:34:42.672991+0000","last_clean":"2024-09-20T20:34:42.672991+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:42.672991+0000","last_undegraded":"2024-09-20T20:34:42.672991+0000","last_fullsized":"2024-09-20T20:34:42.672991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1061,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670650+0000","last_change":"2024-09-20T20:34:41.673197+0000","last_active":"2024-09-20T20:34:42.670650+0000","last_peered":"2024-09-20T20:34:42.670650+0000","last_clean":"2024-09-20T20:34:42.670650+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:34:42.670650+0000","last_undegraded":"2024-09-20T20:34:42.670650+0000","last_fullsized":"2024-09-20T20:34:42.670650+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672875+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:42.672875+0000","last_peered":"2024-09-20T20:34:42.672875+0000","last_clean":"2024-09-20T20:34:42.672875+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:42.672875+0000","last_undegraded":"2024-09-20T20:34:42.672875+0000","last_fullsized":"2024-09-20T20:34:42.672875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643828+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:42.643828+0000","last_peered":"2024-09-20T20:34:42.643828+0000","last_clean":"2024-09-20T20:34:42.643828+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:42.643828+0000","last_undegraded":"2024-09-20T20:34:42.643828+0000","last_fullsized":"2024-09-20T20:34:42.643828+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670502+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:42.670502+0000","last_peered":"2024-09-20T20:34:42.670502+0000","last_clean":"2024-09-20T20:34:42.670502+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:42.670502+0000","last_undegraded":"2024-09-20T20:34:42.670502+0000","last_fullsized":"2024-09-20T20:34:42.670502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":574,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642465+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:42.642465+0000","last_peered":"2024-09-20T20:34:42.642465+0000","last_clean":"2024-09-20T20:34:42.642465+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:42.642465+0000","last_undegraded":"2024-09-20T20:34:42.642465+0000","last_fullsized":"2024-09-20T20:34:42.642465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":437,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642608+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:42.642608+0000","last_peered":"2024-09-20T20:34:42.642608+0000","last_clean":"2024-09-20T20:34:42.642608+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:42.642608+0000","last_undegraded":"2024-09-20T20:34:42.642608+0000","last_fullsized":"2024-09-20T20:34:42.642608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":591,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670675+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:42.670675+0000","last_peered":"2024-09-20T20:34:42.670675+0000","last_clean":"2024-09-20T20:34:42.670675+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:42.670675+0000","last_undegraded":"2024-09-20T20:34:42.670675+0000","last_fullsized":"2024-09-20T20:34:42.670675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672453+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:42.672453+0000","last_peered":"2024-09-20T20:34:42.672453+0000","last_clean":"2024-09-20T20:34:42.672453+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:42.672453+0000","last_undegraded":"2024-09-20T20:34:42.672453+0000","last_fullsized":"2024-09-20T20:34:42.672453+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643594+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:42.643594+0000","last_peered":"2024-09-20T20:34:42.643594+0000","last_clean":"2024-09-20T20:34:42.643594+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:42.643594+0000","last_undegraded":"2024-09-20T20:34:42.643594+0000","last_fullsized":"2024-09-20T20:34:42.643594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1088,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670557+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:42.670557+0000","last_peered":"2024-09-20T20:34:42.670557+0000","last_clean":"2024-09-20T20:34:42.670557+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:42.670557+0000","last_undegraded":"2024-09-20T20:34:42.670557+0000","last_fullsized":"2024-09-20T20:34:42.670557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673245+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:42.673245+0000","last_peered":"2024-09-20T20:34:42.673245+0000","last_clean":"2024-09-20T20:34:42.673245+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:42.673245+0000","last_undegraded":"2024-09-20T20:34:42.673245+0000","last_fullsized":"2024-09-20T20:34:42.673245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":676,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670536+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:42.670536+0000","last_peered":"2024-09-20T20:34:42.670536+0000","last_clean":"2024-09-20T20:34:42.670536+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:42.670536+0000","last_undegraded":"2024-09-20T20:34:42.670536+0000","last_fullsized":"2024-09-20T20:34:42.670536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":846,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672855+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:42.672855+0000","last_peered":"2024-09-20T20:34:42.672855+0000","last_clean":"2024-09-20T20:34:42.672855+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:42.672855+0000","last_undegraded":"2024-09-20T20:34:42.672855+0000","last_fullsized":"2024-09-20T20:34:42.672855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":867,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671086+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:42.671086+0000","last_peered":"2024-09-20T20:34:42.671086+0000","last_clean":"2024-09-20T20:34:42.671086+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:42.671086+0000","last_undegraded":"2024-09-20T20:34:42.671086+0000","last_fullsized":"2024-09-20T20:34:42.671086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672283+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:42.672283+0000","last_peered":"2024-09-20T20:34:42.672283+0000","last_clean":"2024-09-20T20:34:42.672283+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:42.672283+0000","last_undegraded":"2024-09-20T20:34:42.672283+0000","last_fullsized":"2024-09-20T20:34:42.672283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":365,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671060+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:42.671060+0000","last_peered":"2024-09-20T20:34:42.671060+0000","last_clean":"2024-09-20T20:34:42.671060+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:42.671060+0000","last_undegraded":"2024-09-20T20:34:42.671060+0000","last_fullsized":"2024-09-20T20:34:42.671060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671738+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:42.671738+0000","last_peered":"2024-09-20T20:34:42.671738+0000","last_clean":"2024-09-20T20:34:42.671738+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:42.671738+0000","last_undegraded":"2024-09-20T20:34:42.671738+0000","last_fullsized":"2024-09-20T20:34:42.671738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671260+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:42.671260+0000","last_peered":"2024-09-20T20:34:42.671260+0000","last_clean":"2024-09-20T20:34:42.671260+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:42.671260+0000","last_undegraded":"2024-09-20T20:34:42.671260+0000","last_fullsized":"2024-09-20T20:34:42.671260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":538,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671557+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:42.671557+0000","last_peered":"2024-09-20T20:34:42.671557+0000","last_clean":"2024-09-20T20:34:42.671557+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:42.671557+0000","last_undegraded":"2024-09-20T20:34:42.671557+0000","last_fullsized":"2024-09-20T20:34:42.671557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671334+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:42.671334+0000","last_peered":"2024-09-20T20:34:42.671334+0000","last_clean":"2024-09-20T20:34:42.671334+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:42.671334+0000","last_undegraded":"2024-09-20T20:34:42.671334+0000","last_fullsized":"2024-09-20T20:34:42.671334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642236+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:42.642236+0000","last_peered":"2024-09-20T20:34:42.642236+0000","last_clean":"2024-09-20T20:34:42.642236+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:42.642236+0000","last_undegraded":"2024-09-20T20:34:42.642236+0000","last_fullsized":"2024-09-20T20:34:42.642236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":370,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642667+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:42.642667+0000","last_peered":"2024-09-20T20:34:42.642667+0000","last_clean":"2024-09-20T20:34:42.642667+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:42.642667+0000","last_undegraded":"2024-09-20T20:34:42.642667+0000","last_fullsized":"2024-09-20T20:34:42.642667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641490+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:42.641490+0000","last_peered":"2024-09-20T20:34:42.641490+0000","last_clean":"2024-09-20T20:34:42.641490+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:42.641490+0000","last_undegraded":"2024-09-20T20:34:42.641490+0000","last_fullsized":"2024-09-20T20:34:42.641490+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672043+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:42.672043+0000","last_peered":"2024-09-20T20:34:42.672043+0000","last_clean":"2024-09-20T20:34:42.672043+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:42.672043+0000","last_undegraded":"2024-09-20T20:34:42.672043+0000","last_fullsized":"2024-09-20T20:34:42.672043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671503+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:42.671503+0000","last_peered":"2024-09-20T20:34:42.671503+0000","last_clean":"2024-09-20T20:34:42.671503+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:42.671503+0000","last_undegraded":"2024-09-20T20:34:42.671503+0000","last_fullsized":"2024-09-20T20:34:42.671503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672549+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:42.672549+0000","last_peered":"2024-09-20T20:34:42.672549+0000","last_clean":"2024-09-20T20:34:42.672549+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:42.672549+0000","last_undegraded":"2024-09-20T20:34:42.672549+0000","last_fullsized":"2024-09-20T20:34:42.672549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642073+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:42.642073+0000","last_peered":"2024-09-20T20:34:42.642073+0000","last_clean":"2024-09-20T20:34:42.642073+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:42.642073+0000","last_undegraded":"2024-09-20T20:34:42.642073+0000","last_fullsized":"2024-09-20T20:34:42.642073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672824+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:42.672824+0000","last_peered":"2024-09-20T20:34:42.672824+0000","last_clean":"2024-09-20T20:34:42.672824+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:42.672824+0000","last_undegraded":"2024-09-20T20:34:42.672824+0000","last_fullsized":"2024-09-20T20:34:42.672824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6675,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99328,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272512,"statfs":{"total":96636764160,"available":96535052288,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104360,"kb_used_data":28816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267480,"statfs":{"total":96636764160,"available":96529899520,"internally_reserved":0,"allocated":29507584,"data_stored":85109907,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57324,"kb_used_data":23640,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94314516,"statfs":{"total":96636764160,"available":96578064384,"internally_reserved":0,"allocated":24207360,"data_stored":90774901,"data_compressed":13901890,"data_compressed_allocated":16965632,"data_compressed_original":84058112,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:50.518 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-20T20:34:50.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-20T20:34:50.879 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-20T20:34:50.888 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-20T20:34:50.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:51.187 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:51.205 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-20T20:34:49.725664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6689,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":261012,"kb_used_data":80404,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282854508,"statfs":{"total":289910292480,"available":289643016192,"internally_reserved":0,"allocated":82333696,"data_stored":257450488,"data_compressed":37624865,"data_compressed_allocated":48259072,"data_compressed_original":224894976,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":906,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.063578"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672420+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:42.672420+0000","last_peered":"2024-09-20T20:34:42.672420+0000","last_clean":"2024-09-20T20:34:42.672420+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:42.672420+0000","last_undegraded":"2024-09-20T20:34:42.672420+0000","last_fullsized":"2024-09-20T20:34:42.672420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":669,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672061+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:42.672061+0000","last_peered":"2024-09-20T20:34:42.672061+0000","last_clean":"2024-09-20T20:34:42.672061+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:42.672061+0000","last_undegraded":"2024-09-20T20:34:42.672061+0000","last_fullsized":"2024-09-20T20:34:42.672061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643927+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:42.643927+0000","last_peered":"2024-09-20T20:34:42.643927+0000","last_clean":"2024-09-20T20:34:42.643927+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:42.643927+0000","last_undegraded":"2024-09-20T20:34:42.643927+0000","last_fullsized":"2024-09-20T20:34:42.643927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":563,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642893+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:42.642893+0000","last_peered":"2024-09-20T20:34:42.642893+0000","last_clean":"2024-09-20T20:34:42.642893+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:42.642893+0000","last_undegraded":"2024-09-20T20:34:42.642893+0000","last_fullsized":"2024-09-20T20:34:42.642893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":519,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":581,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641951+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:42.641951+0000","last_peered":"2024-09-20T20:34:42.641951+0000","last_clean":"2024-09-20T20:34:42.641951+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:42.641951+0000","last_undegraded":"2024-09-20T20:34:42.641951+0000","last_fullsized":"2024-09-20T20:34:42.641951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641453+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:42.641453+0000","last_peered":"2024-09-20T20:34:42.641453+0000","last_clean":"2024-09-20T20:34:42.641453+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:42.641453+0000","last_undegraded":"2024-09-20T20:34:42.641453+0000","last_fullsized":"2024-09-20T20:34:42.641453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":584,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641806+0000","last_change":"2024-09-20T20:34:41.640769+0000","last_active":"2024-09-20T20:34:42.641806+0000","last_peered":"2024-09-20T20:34:42.641806+0000","last_clean":"2024-09-20T20:34:42.641806+0000","last_became_active":"2024-09-20T20:34:41.636093+0000","last_became_peered":"2024-09-20T20:34:41.636093+0000","last_unstale":"2024-09-20T20:34:42.641806+0000","last_undegraded":"2024-09-20T20:34:42.641806+0000","last_fullsized":"2024-09-20T20:34:42.641806+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:33.620852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672250+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:42.672250+0000","last_peered":"2024-09-20T20:34:42.672250+0000","last_clean":"2024-09-20T20:34:42.672250+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:42.672250+0000","last_undegraded":"2024-09-20T20:34:42.672250+0000","last_fullsized":"2024-09-20T20:34:42.672250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":573,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672463+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:42.672463+0000","last_peered":"2024-09-20T20:34:42.672463+0000","last_clean":"2024-09-20T20:34:42.672463+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:42.672463+0000","last_undegraded":"2024-09-20T20:34:42.672463+0000","last_fullsized":"2024-09-20T20:34:42.672463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643823+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:42.643823+0000","last_peered":"2024-09-20T20:34:42.643823+0000","last_clean":"2024-09-20T20:34:42.643823+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:42.643823+0000","last_undegraded":"2024-09-20T20:34:42.643823+0000","last_fullsized":"2024-09-20T20:34:42.643823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":818,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671401+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:42.671401+0000","last_peered":"2024-09-20T20:34:42.671401+0000","last_clean":"2024-09-20T20:34:42.671401+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:42.671401+0000","last_undegraded":"2024-09-20T20:34:42.671401+0000","last_fullsized":"2024-09-20T20:34:42.671401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670951+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:42.670951+0000","last_peered":"2024-09-20T20:34:42.670951+0000","last_clean":"2024-09-20T20:34:42.670951+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:42.670951+0000","last_undegraded":"2024-09-20T20:34:42.670951+0000","last_fullsized":"2024-09-20T20:34:42.670951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":603,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641827+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:42.641827+0000","last_peered":"2024-09-20T20:34:42.641827+0000","last_clean":"2024-09-20T20:34:42.641827+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:42.641827+0000","last_undegraded":"2024-09-20T20:34:42.641827+0000","last_fullsized":"2024-09-20T20:34:42.641827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":698,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641333+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:42.641333+0000","last_peered":"2024-09-20T20:34:42.641333+0000","last_clean":"2024-09-20T20:34:42.641333+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:42.641333+0000","last_undegraded":"2024-09-20T20:34:42.641333+0000","last_fullsized":"2024-09-20T20:34:42.641333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642189+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:42.642189+0000","last_peered":"2024-09-20T20:34:42.642189+0000","last_clean":"2024-09-20T20:34:42.642189+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:42.642189+0000","last_undegraded":"2024-09-20T20:34:42.642189+0000","last_fullsized":"2024-09-20T20:34:42.642189+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673148+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:42.673148+0000","last_peered":"2024-09-20T20:34:42.673148+0000","last_clean":"2024-09-20T20:34:42.673148+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:42.673148+0000","last_undegraded":"2024-09-20T20:34:42.673148+0000","last_fullsized":"2024-09-20T20:34:42.673148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672427+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:42.672427+0000","last_peered":"2024-09-20T20:34:42.672427+0000","last_clean":"2024-09-20T20:34:42.672427+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:42.672427+0000","last_undegraded":"2024-09-20T20:34:42.672427+0000","last_fullsized":"2024-09-20T20:34:42.672427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":646,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671368+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:42.671368+0000","last_peered":"2024-09-20T20:34:42.671368+0000","last_clean":"2024-09-20T20:34:42.671368+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:42.671368+0000","last_undegraded":"2024-09-20T20:34:42.671368+0000","last_fullsized":"2024-09-20T20:34:42.671368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643226+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:42.643226+0000","last_peered":"2024-09-20T20:34:42.643226+0000","last_clean":"2024-09-20T20:34:42.643226+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:42.643226+0000","last_undegraded":"2024-09-20T20:34:42.643226+0000","last_fullsized":"2024-09-20T20:34:42.643226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642735+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:42.642735+0000","last_peered":"2024-09-20T20:34:42.642735+0000","last_clean":"2024-09-20T20:34:42.642735+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:42.642735+0000","last_undegraded":"2024-09-20T20:34:42.642735+0000","last_fullsized":"2024-09-20T20:34:42.642735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":966,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670666+0000","last_change":"2024-09-20T20:34:39.664844+0000","last_active":"2024-09-20T20:34:42.670666+0000","last_peered":"2024-09-20T20:34:42.670666+0000","last_clean":"2024-09-20T20:34:42.670666+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:34:42.670666+0000","last_undegraded":"2024-09-20T20:34:42.670666+0000","last_fullsized":"2024-09-20T20:34:42.670666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1010,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670184+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:42.670184+0000","last_peered":"2024-09-20T20:34:42.670184+0000","last_clean":"2024-09-20T20:34:42.670184+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:42.670184+0000","last_undegraded":"2024-09-20T20:34:42.670184+0000","last_fullsized":"2024-09-20T20:34:42.670184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":694,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670222+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:42.670222+0000","last_peered":"2024-09-20T20:34:42.670222+0000","last_clean":"2024-09-20T20:34:42.670222+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:42.670222+0000","last_undegraded":"2024-09-20T20:34:42.670222+0000","last_fullsized":"2024-09-20T20:34:42.670222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672720+0000","last_change":"2024-09-20T20:34:38.665667+0000","last_active":"2024-09-20T20:34:42.672720+0000","last_peered":"2024-09-20T20:34:42.672720+0000","last_clean":"2024-09-20T20:34:42.672720+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:34:42.672720+0000","last_undegraded":"2024-09-20T20:34:42.672720+0000","last_fullsized":"2024-09-20T20:34:42.672720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:54.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1085,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672227+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:42.672227+0000","last_peered":"2024-09-20T20:34:42.672227+0000","last_clean":"2024-09-20T20:34:42.672227+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:42.672227+0000","last_undegraded":"2024-09-20T20:34:42.672227+0000","last_fullsized":"2024-09-20T20:34:42.672227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":628,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643749+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:42.643749+0000","last_peered":"2024-09-20T20:34:42.643749+0000","last_clean":"2024-09-20T20:34:42.643749+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:42.643749+0000","last_undegraded":"2024-09-20T20:34:42.643749+0000","last_fullsized":"2024-09-20T20:34:42.643749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671857+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:42.671857+0000","last_peered":"2024-09-20T20:34:42.671857+0000","last_clean":"2024-09-20T20:34:42.671857+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:42.671857+0000","last_undegraded":"2024-09-20T20:34:42.671857+0000","last_fullsized":"2024-09-20T20:34:42.671857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671485+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:42.671485+0000","last_peered":"2024-09-20T20:34:42.671485+0000","last_clean":"2024-09-20T20:34:42.671485+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:42.671485+0000","last_undegraded":"2024-09-20T20:34:42.671485+0000","last_fullsized":"2024-09-20T20:34:42.671485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1021,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671161+0000","last_change":"2024-09-20T20:34:40.670826+0000","last_active":"2024-09-20T20:34:42.671161+0000","last_peered":"2024-09-20T20:34:42.671161+0000","last_clean":"2024-09-20T20:34:42.671161+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:34:42.671161+0000","last_undegraded":"2024-09-20T20:34:42.671161+0000","last_fullsized":"2024-09-20T20:34:42.671161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:58.351454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":620,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670205+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:42.670205+0000","last_peered":"2024-09-20T20:34:42.670205+0000","last_clean":"2024-09-20T20:34:42.670205+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:42.670205+0000","last_undegraded":"2024-09-20T20:34:42.670205+0000","last_fullsized":"2024-09-20T20:34:42.670205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.648962+0000","last_change":"2024-09-20T20:34:42.648962+0000","last_active":"2024-09-20T20:34:42.648962+0000","last_peered":"2024-09-20T20:34:42.648962+0000","last_clean":"2024-09-20T20:34:42.648962+0000","last_became_active":"2024-09-20T20:34:42.644350+0000","last_became_peered":"2024-09-20T20:34:42.644350+0000","last_unstale":"2024-09-20T20:34:42.648962+0000","last_undegraded":"2024-09-20T20:34:42.648962+0000","last_fullsized":"2024-09-20T20:34:42.648962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:04.662945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":497,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":567,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641959+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:42.641959+0000","last_peered":"2024-09-20T20:34:42.641959+0000","last_clean":"2024-09-20T20:34:42.641959+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:42.641959+0000","last_undegraded":"2024-09-20T20:34:42.641959+0000","last_fullsized":"2024-09-20T20:34:42.641959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":535,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671908+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:42.671908+0000","last_peered":"2024-09-20T20:34:42.671908+0000","last_clean":"2024-09-20T20:34:42.671908+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:42.671908+0000","last_undegraded":"2024-09-20T20:34:42.671908+0000","last_fullsized":"2024-09-20T20:34:42.671908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1003,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672857+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:42.672857+0000","last_peered":"2024-09-20T20:34:42.672857+0000","last_clean":"2024-09-20T20:34:42.672857+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:42.672857+0000","last_undegraded":"2024-09-20T20:34:42.672857+0000","last_fullsized":"2024-09-20T20:34:42.672857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670825+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:42.670825+0000","last_peered":"2024-09-20T20:34:42.670825+0000","last_clean":"2024-09-20T20:34:42.670825+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:42.670825+0000","last_undegraded":"2024-09-20T20:34:42.670825+0000","last_fullsized":"2024-09-20T20:34:42.670825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.680079+0000","last_change":"2024-09-20T20:34:42.679159+0000","last_active":"2024-09-20T20:34:42.680079+0000","last_peered":"2024-09-20T20:34:42.680079+0000","last_clean":"2024-09-20T20:34:42.680079+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:34:42.680079+0000","last_undegraded":"2024-09-20T20:34:42.680079+0000","last_fullsized":"2024-09-20T20:34:42.680079+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641095+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:42.641095+0000","last_peered":"2024-09-20T20:34:42.641095+0000","last_clean":"2024-09-20T20:34:42.641095+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:42.641095+0000","last_undegraded":"2024-09-20T20:34:42.641095+0000","last_fullsized":"2024-09-20T20:34:42.641095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.644300+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:42.644300+0000","last_peered":"2024-09-20T20:34:42.644300+0000","last_clean":"2024-09-20T20:34:42.644300+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:42.644300+0000","last_undegraded":"2024-09-20T20:34:42.644300+0000","last_fullsized":"2024-09-20T20:34:42.644300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":908,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670248+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:42.670248+0000","last_peered":"2024-09-20T20:34:42.670248+0000","last_clean":"2024-09-20T20:34:42.670248+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:42.670248+0000","last_undegraded":"2024-09-20T20:34:42.670248+0000","last_fullsized":"2024-09-20T20:34:42.670248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672716+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:42.672716+0000","last_peered":"2024-09-20T20:34:42.672716+0000","last_clean":"2024-09-20T20:34:42.672716+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:42.672716+0000","last_undegraded":"2024-09-20T20:34:42.672716+0000","last_fullsized":"2024-09-20T20:34:42.672716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670493+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:42.670493+0000","last_peered":"2024-09-20T20:34:42.670493+0000","last_clean":"2024-09-20T20:34:42.670493+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:42.670493+0000","last_undegraded":"2024-09-20T20:34:42.670493+0000","last_fullsized":"2024-09-20T20:34:42.670493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643435+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:42.643435+0000","last_peered":"2024-09-20T20:34:42.643435+0000","last_clean":"2024-09-20T20:34:42.643435+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:42.643435+0000","last_undegraded":"2024-09-20T20:34:42.643435+0000","last_fullsized":"2024-09-20T20:34:42.643435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642118+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:42.642118+0000","last_peered":"2024-09-20T20:34:42.642118+0000","last_clean":"2024-09-20T20:34:42.642118+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:42.642118+0000","last_undegraded":"2024-09-20T20:34:42.642118+0000","last_fullsized":"2024-09-20T20:34:42.642118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642945+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:42.642945+0000","last_peered":"2024-09-20T20:34:42.642945+0000","last_clean":"2024-09-20T20:34:42.642945+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:42.642945+0000","last_undegraded":"2024-09-20T20:34:42.642945+0000","last_fullsized":"2024-09-20T20:34:42.642945+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671371+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:42.671371+0000","last_peered":"2024-09-20T20:34:42.671371+0000","last_clean":"2024-09-20T20:34:42.671371+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:42.671371+0000","last_undegraded":"2024-09-20T20:34:42.671371+0000","last_fullsized":"2024-09-20T20:34:42.671371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":377,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672768+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:42.672768+0000","last_peered":"2024-09-20T20:34:42.672768+0000","last_clean":"2024-09-20T20:34:42.672768+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:42.672768+0000","last_undegraded":"2024-09-20T20:34:42.672768+0000","last_fullsized":"2024-09-20T20:34:42.672768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643508+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:42.643508+0000","last_peered":"2024-09-20T20:34:42.643508+0000","last_clean":"2024-09-20T20:34:42.643508+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:42.643508+0000","last_undegraded":"2024-09-20T20:34:42.643508+0000","last_fullsized":"2024-09-20T20:34:42.643508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641377+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:42.641377+0000","last_peered":"2024-09-20T20:34:42.641377+0000","last_clean":"2024-09-20T20:34:42.641377+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:42.641377+0000","last_undegraded":"2024-09-20T20:34:42.641377+0000","last_fullsized":"2024-09-20T20:34:42.641377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643266+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:42.643266+0000","last_peered":"2024-09-20T20:34:42.643266+0000","last_clean":"2024-09-20T20:34:42.643266+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:42.643266+0000","last_undegraded":"2024-09-20T20:34:42.643266+0000","last_fullsized":"2024-09-20T20:34:42.643266+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671097+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:42.671097+0000","last_peered":"2024-09-20T20:34:42.671097+0000","last_clean":"2024-09-20T20:34:42.671097+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:42.671097+0000","last_undegraded":"2024-09-20T20:34:42.671097+0000","last_fullsized":"2024-09-20T20:34:42.671097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":605,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643737+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:42.643737+0000","last_peered":"2024-09-20T20:34:42.643737+0000","last_clean":"2024-09-20T20:34:42.643737+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:42.643737+0000","last_undegraded":"2024-09-20T20:34:42.643737+0000","last_fullsized":"2024-09-20T20:34:42.643737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":649,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670459+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:42.670459+0000","last_peered":"2024-09-20T20:34:42.670459+0000","last_clean":"2024-09-20T20:34:42.670459+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:42.670459+0000","last_undegraded":"2024-09-20T20:34:42.670459+0000","last_fullsized":"2024-09-20T20:34:42.670459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":597,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672394+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:42.672394+0000","last_peered":"2024-09-20T20:34:42.672394+0000","last_clean":"2024-09-20T20:34:42.672394+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:42.672394+0000","last_undegraded":"2024-09-20T20:34:42.672394+0000","last_fullsized":"2024-09-20T20:34:42.672394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":353,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640514+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:42.640514+0000","last_peered":"2024-09-20T20:34:42.640514+0000","last_clean":"2024-09-20T20:34:42.640514+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:42.640514+0000","last_undegraded":"2024-09-20T20:34:42.640514+0000","last_fullsized":"2024-09-20T20:34:42.640514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":93,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641106+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:42.641106+0000","last_peered":"2024-09-20T20:34:42.641106+0000","last_clean":"2024-09-20T20:34:42.641106+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:42.641106+0000","last_undegraded":"2024-09-20T20:34:42.641106+0000","last_fullsized":"2024-09-20T20:34:42.641106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":728,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672067+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:42.672067+0000","last_peered":"2024-09-20T20:34:42.672067+0000","last_clean":"2024-09-20T20:34:42.672067+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:42.672067+0000","last_undegraded":"2024-09-20T20:34:42.672067+0000","last_fullsized":"2024-09-20T20:34:42.672067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643546+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:42.643546+0000","last_peered":"2024-09-20T20:34:42.643546+0000","last_clean":"2024-09-20T20:34:42.643546+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:42.643546+0000","last_undegraded":"2024-09-20T20:34:42.643546+0000","last_fullsized":"2024-09-20T20:34:42.643546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641946+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:42.641946+0000","last_peered":"2024-09-20T20:34:42.641946+0000","last_clean":"2024-09-20T20:34:42.641946+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:42.641946+0000","last_undegraded":"2024-09-20T20:34:42.641946+0000","last_fullsized":"2024-09-20T20:34:42.641946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":372,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670895+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:42.670895+0000","last_peered":"2024-09-20T20:34:42.670895+0000","last_clean":"2024-09-20T20:34:42.670895+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:42.670895+0000","last_undegraded":"2024-09-20T20:34:42.670895+0000","last_fullsized":"2024-09-20T20:34:42.670895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672614+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:42.672614+0000","last_peered":"2024-09-20T20:34:42.672614+0000","last_clean":"2024-09-20T20:34:42.672614+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:42.672614+0000","last_undegraded":"2024-09-20T20:34:42.672614+0000","last_fullsized":"2024-09-20T20:34:42.672614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670548+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:42.670548+0000","last_peered":"2024-09-20T20:34:42.670548+0000","last_clean":"2024-09-20T20:34:42.670548+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:42.670548+0000","last_undegraded":"2024-09-20T20:34:42.670548+0000","last_fullsized":"2024-09-20T20:34:42.670548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672623+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:42.672623+0000","last_peered":"2024-09-20T20:34:42.672623+0000","last_clean":"2024-09-20T20:34:42.672623+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:42.672623+0000","last_undegraded":"2024-09-20T20:34:42.672623+0000","last_fullsized":"2024-09-20T20:34:42.672623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640901+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:42.640901+0000","last_peered":"2024-09-20T20:34:42.640901+0000","last_clean":"2024-09-20T20:34:42.640901+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:42.640901+0000","last_undegraded":"2024-09-20T20:34:42.640901+0000","last_fullsized":"2024-09-20T20:34:42.640901+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641845+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:42.641845+0000","last_peered":"2024-09-20T20:34:42.641845+0000","last_clean":"2024-09-20T20:34:42.641845+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:42.641845+0000","last_undegraded":"2024-09-20T20:34:42.641845+0000","last_fullsized":"2024-09-20T20:34:42.641845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672046+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:42.672046+0000","last_peered":"2024-09-20T20:34:42.672046+0000","last_clean":"2024-09-20T20:34:42.672046+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:42.672046+0000","last_undegraded":"2024-09-20T20:34:42.672046+0000","last_fullsized":"2024-09-20T20:34:42.672046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":327,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642890+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:42.642890+0000","last_peered":"2024-09-20T20:34:42.642890+0000","last_clean":"2024-09-20T20:34:42.642890+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:42.642890+0000","last_undegraded":"2024-09-20T20:34:42.642890+0000","last_fullsized":"2024-09-20T20:34:42.642890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672338+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:42.672338+0000","last_peered":"2024-09-20T20:34:42.672338+0000","last_clean":"2024-09-20T20:34:42.672338+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:42.672338+0000","last_undegraded":"2024-09-20T20:34:42.672338+0000","last_fullsized":"2024-09-20T20:34:42.672338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":842,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670969+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:42.670969+0000","last_peered":"2024-09-20T20:34:42.670969+0000","last_clean":"2024-09-20T20:34:42.670969+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:42.670969+0000","last_undegraded":"2024-09-20T20:34:42.670969+0000","last_fullsized":"2024-09-20T20:34:42.670969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672097+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:42.672097+0000","last_peered":"2024-09-20T20:34:42.672097+0000","last_clean":"2024-09-20T20:34:42.672097+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:42.672097+0000","last_undegraded":"2024-09-20T20:34:42.672097+0000","last_fullsized":"2024-09-20T20:34:42.672097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672545+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:42.672545+0000","last_peered":"2024-09-20T20:34:42.672545+0000","last_clean":"2024-09-20T20:34:42.672545+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:42.672545+0000","last_undegraded":"2024-09-20T20:34:42.672545+0000","last_fullsized":"2024-09-20T20:34:42.672545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":898,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671061+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:42.671061+0000","last_peered":"2024-09-20T20:34:42.671061+0000","last_clean":"2024-09-20T20:34:42.671061+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:42.671061+0000","last_undegraded":"2024-09-20T20:34:42.671061+0000","last_fullsized":"2024-09-20T20:34:42.671061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673319+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:42.673319+0000","last_peered":"2024-09-20T20:34:42.673319+0000","last_clean":"2024-09-20T20:34:42.673319+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:42.673319+0000","last_undegraded":"2024-09-20T20:34:42.673319+0000","last_fullsized":"2024-09-20T20:34:42.673319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672991+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:42.672991+0000","last_peered":"2024-09-20T20:34:42.672991+0000","last_clean":"2024-09-20T20:34:42.672991+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:42.672991+0000","last_undegraded":"2024-09-20T20:34:42.672991+0000","last_fullsized":"2024-09-20T20:34:42.672991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1061,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670650+0000","last_change":"2024-09-20T20:34:41.673197+0000","last_active":"2024-09-20T20:34:42.670650+0000","last_peered":"2024-09-20T20:34:42.670650+0000","last_clean":"2024-09-20T20:34:42.670650+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:34:42.670650+0000","last_undegraded":"2024-09-20T20:34:42.670650+0000","last_fullsized":"2024-09-20T20:34:42.670650+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672875+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:42.672875+0000","last_peered":"2024-09-20T20:34:42.672875+0000","last_clean":"2024-09-20T20:34:42.672875+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:42.672875+0000","last_undegraded":"2024-09-20T20:34:42.672875+0000","last_fullsized":"2024-09-20T20:34:42.672875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643828+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:42.643828+0000","last_peered":"2024-09-20T20:34:42.643828+0000","last_clean":"2024-09-20T20:34:42.643828+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:42.643828+0000","last_undegraded":"2024-09-20T20:34:42.643828+0000","last_fullsized":"2024-09-20T20:34:42.643828+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670502+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:42.670502+0000","last_peered":"2024-09-20T20:34:42.670502+0000","last_clean":"2024-09-20T20:34:42.670502+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:42.670502+0000","last_undegraded":"2024-09-20T20:34:42.670502+0000","last_fullsized":"2024-09-20T20:34:42.670502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":574,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642465+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:42.642465+0000","last_peered":"2024-09-20T20:34:42.642465+0000","last_clean":"2024-09-20T20:34:42.642465+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:42.642465+0000","last_undegraded":"2024-09-20T20:34:42.642465+0000","last_fullsized":"2024-09-20T20:34:42.642465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":437,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642608+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:42.642608+0000","last_peered":"2024-09-20T20:34:42.642608+0000","last_clean":"2024-09-20T20:34:42.642608+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:42.642608+0000","last_undegraded":"2024-09-20T20:34:42.642608+0000","last_fullsized":"2024-09-20T20:34:42.642608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":591,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670675+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:42.670675+0000","last_peered":"2024-09-20T20:34:42.670675+0000","last_clean":"2024-09-20T20:34:42.670675+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:42.670675+0000","last_undegraded":"2024-09-20T20:34:42.670675+0000","last_fullsized":"2024-09-20T20:34:42.670675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672453+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:42.672453+0000","last_peered":"2024-09-20T20:34:42.672453+0000","last_clean":"2024-09-20T20:34:42.672453+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:42.672453+0000","last_undegraded":"2024-09-20T20:34:42.672453+0000","last_fullsized":"2024-09-20T20:34:42.672453+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643594+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:42.643594+0000","last_peered":"2024-09-20T20:34:42.643594+0000","last_clean":"2024-09-20T20:34:42.643594+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:42.643594+0000","last_undegraded":"2024-09-20T20:34:42.643594+0000","last_fullsized":"2024-09-20T20:34:42.643594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1088,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670557+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:42.670557+0000","last_peered":"2024-09-20T20:34:42.670557+0000","last_clean":"2024-09-20T20:34:42.670557+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:42.670557+0000","last_undegraded":"2024-09-20T20:34:42.670557+0000","last_fullsized":"2024-09-20T20:34:42.670557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673245+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:42.673245+0000","last_peered":"2024-09-20T20:34:42.673245+0000","last_clean":"2024-09-20T20:34:42.673245+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:42.673245+0000","last_undegraded":"2024-09-20T20:34:42.673245+0000","last_fullsized":"2024-09-20T20:34:42.673245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":676,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670536+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:42.670536+0000","last_peered":"2024-09-20T20:34:42.670536+0000","last_clean":"2024-09-20T20:34:42.670536+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:42.670536+0000","last_undegraded":"2024-09-20T20:34:42.670536+0000","last_fullsized":"2024-09-20T20:34:42.670536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":846,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672855+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:42.672855+0000","last_peered":"2024-09-20T20:34:42.672855+0000","last_clean":"2024-09-20T20:34:42.672855+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:42.672855+0000","last_undegraded":"2024-09-20T20:34:42.672855+0000","last_fullsized":"2024-09-20T20:34:42.672855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":867,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671086+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:42.671086+0000","last_peered":"2024-09-20T20:34:42.671086+0000","last_clean":"2024-09-20T20:34:42.671086+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:42.671086+0000","last_undegraded":"2024-09-20T20:34:42.671086+0000","last_fullsized":"2024-09-20T20:34:42.671086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672283+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:42.672283+0000","last_peered":"2024-09-20T20:34:42.672283+0000","last_clean":"2024-09-20T20:34:42.672283+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:42.672283+0000","last_undegraded":"2024-09-20T20:34:42.672283+0000","last_fullsized":"2024-09-20T20:34:42.672283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":365,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671060+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:42.671060+0000","last_peered":"2024-09-20T20:34:42.671060+0000","last_clean":"2024-09-20T20:34:42.671060+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:42.671060+0000","last_undegraded":"2024-09-20T20:34:42.671060+0000","last_fullsized":"2024-09-20T20:34:42.671060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671738+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:42.671738+0000","last_peered":"2024-09-20T20:34:42.671738+0000","last_clean":"2024-09-20T20:34:42.671738+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:42.671738+0000","last_undegraded":"2024-09-20T20:34:42.671738+0000","last_fullsized":"2024-09-20T20:34:42.671738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671260+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:42.671260+0000","last_peered":"2024-09-20T20:34:42.671260+0000","last_clean":"2024-09-20T20:34:42.671260+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:42.671260+0000","last_undegraded":"2024-09-20T20:34:42.671260+0000","last_fullsized":"2024-09-20T20:34:42.671260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":538,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671557+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:42.671557+0000","last_peered":"2024-09-20T20:34:42.671557+0000","last_clean":"2024-09-20T20:34:42.671557+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:42.671557+0000","last_undegraded":"2024-09-20T20:34:42.671557+0000","last_fullsized":"2024-09-20T20:34:42.671557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671334+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:42.671334+0000","last_peered":"2024-09-20T20:34:42.671334+0000","last_clean":"2024-09-20T20:34:42.671334+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:42.671334+0000","last_undegraded":"2024-09-20T20:34:42.671334+0000","last_fullsized":"2024-09-20T20:34:42.671334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642236+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:42.642236+0000","last_peered":"2024-09-20T20:34:42.642236+0000","last_clean":"2024-09-20T20:34:42.642236+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:42.642236+0000","last_undegraded":"2024-09-20T20:34:42.642236+0000","last_fullsized":"2024-09-20T20:34:42.642236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":370,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642667+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:42.642667+0000","last_peered":"2024-09-20T20:34:42.642667+0000","last_clean":"2024-09-20T20:34:42.642667+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:42.642667+0000","last_undegraded":"2024-09-20T20:34:42.642667+0000","last_fullsized":"2024-09-20T20:34:42.642667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641490+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:42.641490+0000","last_peered":"2024-09-20T20:34:42.641490+0000","last_clean":"2024-09-20T20:34:42.641490+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:42.641490+0000","last_undegraded":"2024-09-20T20:34:42.641490+0000","last_fullsized":"2024-09-20T20:34:42.641490+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672043+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:42.672043+0000","last_peered":"2024-09-20T20:34:42.672043+0000","last_clean":"2024-09-20T20:34:42.672043+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:42.672043+0000","last_undegraded":"2024-09-20T20:34:42.672043+0000","last_fullsized":"2024-09-20T20:34:42.672043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671503+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:42.671503+0000","last_peered":"2024-09-20T20:34:42.671503+0000","last_clean":"2024-09-20T20:34:42.671503+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:42.671503+0000","last_undegraded":"2024-09-20T20:34:42.671503+0000","last_fullsized":"2024-09-20T20:34:42.671503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672549+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:42.672549+0000","last_peered":"2024-09-20T20:34:42.672549+0000","last_clean":"2024-09-20T20:34:42.672549+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:42.672549+0000","last_undegraded":"2024-09-20T20:34:42.672549+0000","last_fullsized":"2024-09-20T20:34:42.672549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642073+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:42.642073+0000","last_peered":"2024-09-20T20:34:42.642073+0000","last_clean":"2024-09-20T20:34:42.642073+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:42.642073+0000","last_undegraded":"2024-09-20T20:34:42.642073+0000","last_fullsized":"2024-09-20T20:34:42.642073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672824+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:42.672824+0000","last_peered":"2024-09-20T20:34:42.672824+0000","last_clean":"2024-09-20T20:34:42.672824+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:42.672824+0000","last_undegraded":"2024-09-20T20:34:42.672824+0000","last_fullsized":"2024-09-20T20:34:42.672824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6675,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99328,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272512,"statfs":{"total":96636764160,"available":96535052288,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104360,"kb_used_data":28816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267480,"statfs":{"total":96636764160,"available":96529899520,"internally_reserved":0,"allocated":29507584,"data_stored":85109907,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57324,"kb_used_data":23640,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94314516,"statfs":{"total":96636764160,"available":96578064384,"internally_reserved":0,"allocated":24207360,"data_stored":90774901,"data_compressed":13901890,"data_compressed_allocated":16965632,"data_compressed_original":84058112,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:51.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:51.546 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:51.564 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-20T20:34:49.725664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6689,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":261012,"kb_used_data":80404,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282854508,"statfs":{"total":289910292480,"available":289643016192,"internally_reserved":0,"allocated":82333696,"data_stored":257450488,"data_compressed":37624865,"data_compressed_allocated":48259072,"data_compressed_original":224894976,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":906,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.063578"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672420+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:42.672420+0000","last_peered":"2024-09-20T20:34:42.672420+0000","last_clean":"2024-09-20T20:34:42.672420+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:42.672420+0000","last_undegraded":"2024-09-20T20:34:42.672420+0000","last_fullsized":"2024-09-20T20:34:42.672420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":669,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672061+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:42.672061+0000","last_peered":"2024-09-20T20:34:42.672061+0000","last_clean":"2024-09-20T20:34:42.672061+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:42.672061+0000","last_undegraded":"2024-09-20T20:34:42.672061+0000","last_fullsized":"2024-09-20T20:34:42.672061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643927+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:42.643927+0000","last_peered":"2024-09-20T20:34:42.643927+0000","last_clean":"2024-09-20T20:34:42.643927+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:42.643927+0000","last_undegraded":"2024-09-20T20:34:42.643927+0000","last_fullsized":"2024-09-20T20:34:42.643927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":563,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642893+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:42.642893+0000","last_peered":"2024-09-20T20:34:42.642893+0000","last_clean":"2024-09-20T20:34:42.642893+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:42.642893+0000","last_undegraded":"2024-09-20T20:34:42.642893+0000","last_fullsized":"2024-09-20T20:34:42.642893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":519,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":581,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641951+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:42.641951+0000","last_peered":"2024-09-20T20:34:42.641951+0000","last_clean":"2024-09-20T20:34:42.641951+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:42.641951+0000","last_undegraded":"2024-09-20T20:34:42.641951+0000","last_fullsized":"2024-09-20T20:34:42.641951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641453+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:42.641453+0000","last_peered":"2024-09-20T20:34:42.641453+0000","last_clean":"2024-09-20T20:34:42.641453+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:42.641453+0000","last_undegraded":"2024-09-20T20:34:42.641453+0000","last_fullsized":"2024-09-20T20:34:42.641453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":584,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641806+0000","last_change":"2024-09-20T20:34:41.640769+0000","last_active":"2024-09-20T20:34:42.641806+0000","last_peered":"2024-09-20T20:34:42.641806+0000","last_clean":"2024-09-20T20:34:42.641806+0000","last_became_active":"2024-09-20T20:34:41.636093+0000","last_became_peered":"2024-09-20T20:34:41.636093+0000","last_unstale":"2024-09-20T20:34:42.641806+0000","last_undegraded":"2024-09-20T20:34:42.641806+0000","last_fullsized":"2024-09-20T20:34:42.641806+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:33.620852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672250+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:42.672250+0000","last_peered":"2024-09-20T20:34:42.672250+0000","last_clean":"2024-09-20T20:34:42.672250+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:42.672250+0000","last_undegraded":"2024-09-20T20:34:42.672250+0000","last_fullsized":"2024-09-20T20:34:42.672250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":573,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672463+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:42.672463+0000","last_peered":"2024-09-20T20:34:42.672463+0000","last_clean":"2024-09-20T20:34:42.672463+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:42.672463+0000","last_undegraded":"2024-09-20T20:34:42.672463+0000","last_fullsized":"2024-09-20T20:34:42.672463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643823+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:42.643823+0000","last_peered":"2024-09-20T20:34:42.643823+0000","last_clean":"2024-09-20T20:34:42.643823+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:42.643823+0000","last_undegraded":"2024-09-20T20:34:42.643823+0000","last_fullsized":"2024-09-20T20:34:42.643823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":818,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671401+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:42.671401+0000","last_peered":"2024-09-20T20:34:42.671401+0000","last_clean":"2024-09-20T20:34:42.671401+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:42.671401+0000","last_undegraded":"2024-09-20T20:34:42.671401+0000","last_fullsized":"2024-09-20T20:34:42.671401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670951+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:42.670951+0000","last_peered":"2024-09-20T20:34:42.670951+0000","last_clean":"2024-09-20T20:34:42.670951+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:42.670951+0000","last_undegraded":"2024-09-20T20:34:42.670951+0000","last_fullsized":"2024-09-20T20:34:42.670951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":603,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641827+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:42.641827+0000","last_peered":"2024-09-20T20:34:42.641827+0000","last_clean":"2024-09-20T20:34:42.641827+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:42.641827+0000","last_undegraded":"2024-09-20T20:34:42.641827+0000","last_fullsized":"2024-09-20T20:34:42.641827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":698,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641333+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:42.641333+0000","last_peered":"2024-09-20T20:34:42.641333+0000","last_clean":"2024-09-20T20:34:42.641333+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:42.641333+0000","last_undegraded":"2024-09-20T20:34:42.641333+0000","last_fullsized":"2024-09-20T20:34:42.641333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642189+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:42.642189+0000","last_peered":"2024-09-20T20:34:42.642189+0000","last_clean":"2024-09-20T20:34:42.642189+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:42.642189+0000","last_undegraded":"2024-09-20T20:34:42.642189+0000","last_fullsized":"2024-09-20T20:34:42.642189+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673148+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:42.673148+0000","last_peered":"2024-09-20T20:34:42.673148+0000","last_clean":"2024-09-20T20:34:42.673148+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:42.673148+0000","last_undegraded":"2024-09-20T20:34:42.673148+0000","last_fullsized":"2024-09-20T20:34:42.673148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672427+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:42.672427+0000","last_peered":"2024-09-20T20:34:42.672427+0000","last_clean":"2024-09-20T20:34:42.672427+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:42.672427+0000","last_undegraded":"2024-09-20T20:34:42.672427+0000","last_fullsized":"2024-09-20T20:34:42.672427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":646,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671368+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:42.671368+0000","last_peered":"2024-09-20T20:34:42.671368+0000","last_clean":"2024-09-20T20:34:42.671368+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:42.671368+0000","last_undegraded":"2024-09-20T20:34:42.671368+0000","last_fullsized":"2024-09-20T20:34:42.671368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643226+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:42.643226+0000","last_peered":"2024-09-20T20:34:42.643226+0000","last_clean":"2024-09-20T20:34:42.643226+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:42.643226+0000","last_undegraded":"2024-09-20T20:34:42.643226+0000","last_fullsized":"2024-09-20T20:34:42.643226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642735+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:42.642735+0000","last_peered":"2024-09-20T20:34:42.642735+0000","last_clean":"2024-09-20T20:34:42.642735+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:42.642735+0000","last_undegraded":"2024-09-20T20:34:42.642735+0000","last_fullsized":"2024-09-20T20:34:42.642735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":966,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670666+0000","last_change":"2024-09-20T20:34:39.664844+0000","last_active":"2024-09-20T20:34:42.670666+0000","last_peered":"2024-09-20T20:34:42.670666+0000","last_clean":"2024-09-20T20:34:42.670666+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:34:42.670666+0000","last_undegraded":"2024-09-20T20:34:42.670666+0000","last_fullsized":"2024-09-20T20:34:42.670666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1010,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670184+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:42.670184+0000","last_peered":"2024-09-20T20:34:42.670184+0000","last_clean":"2024-09-20T20:34:42.670184+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:42.670184+0000","last_undegraded":"2024-09-20T20:34:42.670184+0000","last_fullsized":"2024-09-20T20:34:42.670184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":694,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670222+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:42.670222+0000","last_peered":"2024-09-20T20:34:42.670222+0000","last_clean":"2024-09-20T20:34:42.670222+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:42.670222+0000","last_undegraded":"2024-09-20T20:34:42.670222+0000","last_fullsized":"2024-09-20T20:34:42.670222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672720+0000","last_change":"2024-09-20T20:34:38.665667+0000","last_active":"2024-09-20T20:34:42.672720+0000","last_peered":"2024-09-20T20:34:42.672720+0000","last_clean":"2024-09-20T20:34:42.672720+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:34:42.672720+0000","last_undegraded":"2024-09-20T20:34:42.672720+0000","last_fullsized":"2024-09-20T20:34:42.672720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:54.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1085,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672227+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:42.672227+0000","last_peered":"2024-09-20T20:34:42.672227+0000","last_clean":"2024-09-20T20:34:42.672227+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:42.672227+0000","last_undegraded":"2024-09-20T20:34:42.672227+0000","last_fullsized":"2024-09-20T20:34:42.672227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":628,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643749+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:42.643749+0000","last_peered":"2024-09-20T20:34:42.643749+0000","last_clean":"2024-09-20T20:34:42.643749+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:42.643749+0000","last_undegraded":"2024-09-20T20:34:42.643749+0000","last_fullsized":"2024-09-20T20:34:42.643749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671857+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:42.671857+0000","last_peered":"2024-09-20T20:34:42.671857+0000","last_clean":"2024-09-20T20:34:42.671857+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:42.671857+0000","last_undegraded":"2024-09-20T20:34:42.671857+0000","last_fullsized":"2024-09-20T20:34:42.671857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671485+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:42.671485+0000","last_peered":"2024-09-20T20:34:42.671485+0000","last_clean":"2024-09-20T20:34:42.671485+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:42.671485+0000","last_undegraded":"2024-09-20T20:34:42.671485+0000","last_fullsized":"2024-09-20T20:34:42.671485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1021,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671161+0000","last_change":"2024-09-20T20:34:40.670826+0000","last_active":"2024-09-20T20:34:42.671161+0000","last_peered":"2024-09-20T20:34:42.671161+0000","last_clean":"2024-09-20T20:34:42.671161+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:34:42.671161+0000","last_undegraded":"2024-09-20T20:34:42.671161+0000","last_fullsized":"2024-09-20T20:34:42.671161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:58.351454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":620,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670205+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:42.670205+0000","last_peered":"2024-09-20T20:34:42.670205+0000","last_clean":"2024-09-20T20:34:42.670205+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:42.670205+0000","last_undegraded":"2024-09-20T20:34:42.670205+0000","last_fullsized":"2024-09-20T20:34:42.670205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.648962+0000","last_change":"2024-09-20T20:34:42.648962+0000","last_active":"2024-09-20T20:34:42.648962+0000","last_peered":"2024-09-20T20:34:42.648962+0000","last_clean":"2024-09-20T20:34:42.648962+0000","last_became_active":"2024-09-20T20:34:42.644350+0000","last_became_peered":"2024-09-20T20:34:42.644350+0000","last_unstale":"2024-09-20T20:34:42.648962+0000","last_undegraded":"2024-09-20T20:34:42.648962+0000","last_fullsized":"2024-09-20T20:34:42.648962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:04.662945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":497,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":567,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641959+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:42.641959+0000","last_peered":"2024-09-20T20:34:42.641959+0000","last_clean":"2024-09-20T20:34:42.641959+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:42.641959+0000","last_undegraded":"2024-09-20T20:34:42.641959+0000","last_fullsized":"2024-09-20T20:34:42.641959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":535,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671908+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:42.671908+0000","last_peered":"2024-09-20T20:34:42.671908+0000","last_clean":"2024-09-20T20:34:42.671908+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:42.671908+0000","last_undegraded":"2024-09-20T20:34:42.671908+0000","last_fullsized":"2024-09-20T20:34:42.671908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1003,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672857+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:42.672857+0000","last_peered":"2024-09-20T20:34:42.672857+0000","last_clean":"2024-09-20T20:34:42.672857+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:42.672857+0000","last_undegraded":"2024-09-20T20:34:42.672857+0000","last_fullsized":"2024-09-20T20:34:42.672857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670825+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:42.670825+0000","last_peered":"2024-09-20T20:34:42.670825+0000","last_clean":"2024-09-20T20:34:42.670825+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:42.670825+0000","last_undegraded":"2024-09-20T20:34:42.670825+0000","last_fullsized":"2024-09-20T20:34:42.670825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.680079+0000","last_change":"2024-09-20T20:34:42.679159+0000","last_active":"2024-09-20T20:34:42.680079+0000","last_peered":"2024-09-20T20:34:42.680079+0000","last_clean":"2024-09-20T20:34:42.680079+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:34:42.680079+0000","last_undegraded":"2024-09-20T20:34:42.680079+0000","last_fullsized":"2024-09-20T20:34:42.680079+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641095+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:42.641095+0000","last_peered":"2024-09-20T20:34:42.641095+0000","last_clean":"2024-09-20T20:34:42.641095+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:42.641095+0000","last_undegraded":"2024-09-20T20:34:42.641095+0000","last_fullsized":"2024-09-20T20:34:42.641095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.644300+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:42.644300+0000","last_peered":"2024-09-20T20:34:42.644300+0000","last_clean":"2024-09-20T20:34:42.644300+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:42.644300+0000","last_undegraded":"2024-09-20T20:34:42.644300+0000","last_fullsized":"2024-09-20T20:34:42.644300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":908,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670248+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:42.670248+0000","last_peered":"2024-09-20T20:34:42.670248+0000","last_clean":"2024-09-20T20:34:42.670248+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:42.670248+0000","last_undegraded":"2024-09-20T20:34:42.670248+0000","last_fullsized":"2024-09-20T20:34:42.670248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672716+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:42.672716+0000","last_peered":"2024-09-20T20:34:42.672716+0000","last_clean":"2024-09-20T20:34:42.672716+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:42.672716+0000","last_undegraded":"2024-09-20T20:34:42.672716+0000","last_fullsized":"2024-09-20T20:34:42.672716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670493+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:42.670493+0000","last_peered":"2024-09-20T20:34:42.670493+0000","last_clean":"2024-09-20T20:34:42.670493+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:42.670493+0000","last_undegraded":"2024-09-20T20:34:42.670493+0000","last_fullsized":"2024-09-20T20:34:42.670493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643435+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:42.643435+0000","last_peered":"2024-09-20T20:34:42.643435+0000","last_clean":"2024-09-20T20:34:42.643435+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:42.643435+0000","last_undegraded":"2024-09-20T20:34:42.643435+0000","last_fullsized":"2024-09-20T20:34:42.643435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642118+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:42.642118+0000","last_peered":"2024-09-20T20:34:42.642118+0000","last_clean":"2024-09-20T20:34:42.642118+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:42.642118+0000","last_undegraded":"2024-09-20T20:34:42.642118+0000","last_fullsized":"2024-09-20T20:34:42.642118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642945+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:42.642945+0000","last_peered":"2024-09-20T20:34:42.642945+0000","last_clean":"2024-09-20T20:34:42.642945+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:42.642945+0000","last_undegraded":"2024-09-20T20:34:42.642945+0000","last_fullsized":"2024-09-20T20:34:42.642945+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671371+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:42.671371+0000","last_peered":"2024-09-20T20:34:42.671371+0000","last_clean":"2024-09-20T20:34:42.671371+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:42.671371+0000","last_undegraded":"2024-09-20T20:34:42.671371+0000","last_fullsized":"2024-09-20T20:34:42.671371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":377,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672768+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:42.672768+0000","last_peered":"2024-09-20T20:34:42.672768+0000","last_clean":"2024-09-20T20:34:42.672768+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:42.672768+0000","last_undegraded":"2024-09-20T20:34:42.672768+0000","last_fullsized":"2024-09-20T20:34:42.672768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643508+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:42.643508+0000","last_peered":"2024-09-20T20:34:42.643508+0000","last_clean":"2024-09-20T20:34:42.643508+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:42.643508+0000","last_undegraded":"2024-09-20T20:34:42.643508+0000","last_fullsized":"2024-09-20T20:34:42.643508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641377+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:42.641377+0000","last_peered":"2024-09-20T20:34:42.641377+0000","last_clean":"2024-09-20T20:34:42.641377+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:42.641377+0000","last_undegraded":"2024-09-20T20:34:42.641377+0000","last_fullsized":"2024-09-20T20:34:42.641377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643266+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:42.643266+0000","last_peered":"2024-09-20T20:34:42.643266+0000","last_clean":"2024-09-20T20:34:42.643266+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:42.643266+0000","last_undegraded":"2024-09-20T20:34:42.643266+0000","last_fullsized":"2024-09-20T20:34:42.643266+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671097+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:42.671097+0000","last_peered":"2024-09-20T20:34:42.671097+0000","last_clean":"2024-09-20T20:34:42.671097+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:42.671097+0000","last_undegraded":"2024-09-20T20:34:42.671097+0000","last_fullsized":"2024-09-20T20:34:42.671097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":605,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643737+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:42.643737+0000","last_peered":"2024-09-20T20:34:42.643737+0000","last_clean":"2024-09-20T20:34:42.643737+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:42.643737+0000","last_undegraded":"2024-09-20T20:34:42.643737+0000","last_fullsized":"2024-09-20T20:34:42.643737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":649,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670459+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:42.670459+0000","last_peered":"2024-09-20T20:34:42.670459+0000","last_clean":"2024-09-20T20:34:42.670459+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:42.670459+0000","last_undegraded":"2024-09-20T20:34:42.670459+0000","last_fullsized":"2024-09-20T20:34:42.670459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":597,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672394+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:42.672394+0000","last_peered":"2024-09-20T20:34:42.672394+0000","last_clean":"2024-09-20T20:34:42.672394+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:42.672394+0000","last_undegraded":"2024-09-20T20:34:42.672394+0000","last_fullsized":"2024-09-20T20:34:42.672394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":353,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640514+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:42.640514+0000","last_peered":"2024-09-20T20:34:42.640514+0000","last_clean":"2024-09-20T20:34:42.640514+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:42.640514+0000","last_undegraded":"2024-09-20T20:34:42.640514+0000","last_fullsized":"2024-09-20T20:34:42.640514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":93,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641106+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:42.641106+0000","last_peered":"2024-09-20T20:34:42.641106+0000","last_clean":"2024-09-20T20:34:42.641106+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:42.641106+0000","last_undegraded":"2024-09-20T20:34:42.641106+0000","last_fullsized":"2024-09-20T20:34:42.641106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":728,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672067+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:42.672067+0000","last_peered":"2024-09-20T20:34:42.672067+0000","last_clean":"2024-09-20T20:34:42.672067+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:42.672067+0000","last_undegraded":"2024-09-20T20:34:42.672067+0000","last_fullsized":"2024-09-20T20:34:42.672067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643546+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:42.643546+0000","last_peered":"2024-09-20T20:34:42.643546+0000","last_clean":"2024-09-20T20:34:42.643546+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:42.643546+0000","last_undegraded":"2024-09-20T20:34:42.643546+0000","last_fullsized":"2024-09-20T20:34:42.643546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641946+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:42.641946+0000","last_peered":"2024-09-20T20:34:42.641946+0000","last_clean":"2024-09-20T20:34:42.641946+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:42.641946+0000","last_undegraded":"2024-09-20T20:34:42.641946+0000","last_fullsized":"2024-09-20T20:34:42.641946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":372,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670895+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:42.670895+0000","last_peered":"2024-09-20T20:34:42.670895+0000","last_clean":"2024-09-20T20:34:42.670895+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:42.670895+0000","last_undegraded":"2024-09-20T20:34:42.670895+0000","last_fullsized":"2024-09-20T20:34:42.670895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672614+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:42.672614+0000","last_peered":"2024-09-20T20:34:42.672614+0000","last_clean":"2024-09-20T20:34:42.672614+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:42.672614+0000","last_undegraded":"2024-09-20T20:34:42.672614+0000","last_fullsized":"2024-09-20T20:34:42.672614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670548+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:42.670548+0000","last_peered":"2024-09-20T20:34:42.670548+0000","last_clean":"2024-09-20T20:34:42.670548+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:42.670548+0000","last_undegraded":"2024-09-20T20:34:42.670548+0000","last_fullsized":"2024-09-20T20:34:42.670548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672623+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:42.672623+0000","last_peered":"2024-09-20T20:34:42.672623+0000","last_clean":"2024-09-20T20:34:42.672623+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:42.672623+0000","last_undegraded":"2024-09-20T20:34:42.672623+0000","last_fullsized":"2024-09-20T20:34:42.672623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640901+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:42.640901+0000","last_peered":"2024-09-20T20:34:42.640901+0000","last_clean":"2024-09-20T20:34:42.640901+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:42.640901+0000","last_undegraded":"2024-09-20T20:34:42.640901+0000","last_fullsized":"2024-09-20T20:34:42.640901+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641845+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:42.641845+0000","last_peered":"2024-09-20T20:34:42.641845+0000","last_clean":"2024-09-20T20:34:42.641845+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:42.641845+0000","last_undegraded":"2024-09-20T20:34:42.641845+0000","last_fullsized":"2024-09-20T20:34:42.641845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672046+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:42.672046+0000","last_peered":"2024-09-20T20:34:42.672046+0000","last_clean":"2024-09-20T20:34:42.672046+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:42.672046+0000","last_undegraded":"2024-09-20T20:34:42.672046+0000","last_fullsized":"2024-09-20T20:34:42.672046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":327,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642890+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:42.642890+0000","last_peered":"2024-09-20T20:34:42.642890+0000","last_clean":"2024-09-20T20:34:42.642890+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:42.642890+0000","last_undegraded":"2024-09-20T20:34:42.642890+0000","last_fullsized":"2024-09-20T20:34:42.642890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672338+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:42.672338+0000","last_peered":"2024-09-20T20:34:42.672338+0000","last_clean":"2024-09-20T20:34:42.672338+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:42.672338+0000","last_undegraded":"2024-09-20T20:34:42.672338+0000","last_fullsized":"2024-09-20T20:34:42.672338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":842,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670969+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:42.670969+0000","last_peered":"2024-09-20T20:34:42.670969+0000","last_clean":"2024-09-20T20:34:42.670969+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:42.670969+0000","last_undegraded":"2024-09-20T20:34:42.670969+0000","last_fullsized":"2024-09-20T20:34:42.670969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672097+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:42.672097+0000","last_peered":"2024-09-20T20:34:42.672097+0000","last_clean":"2024-09-20T20:34:42.672097+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:42.672097+0000","last_undegraded":"2024-09-20T20:34:42.672097+0000","last_fullsized":"2024-09-20T20:34:42.672097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672545+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:42.672545+0000","last_peered":"2024-09-20T20:34:42.672545+0000","last_clean":"2024-09-20T20:34:42.672545+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:42.672545+0000","last_undegraded":"2024-09-20T20:34:42.672545+0000","last_fullsized":"2024-09-20T20:34:42.672545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":898,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671061+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:42.671061+0000","last_peered":"2024-09-20T20:34:42.671061+0000","last_clean":"2024-09-20T20:34:42.671061+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:42.671061+0000","last_undegraded":"2024-09-20T20:34:42.671061+0000","last_fullsized":"2024-09-20T20:34:42.671061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673319+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:42.673319+0000","last_peered":"2024-09-20T20:34:42.673319+0000","last_clean":"2024-09-20T20:34:42.673319+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:42.673319+0000","last_undegraded":"2024-09-20T20:34:42.673319+0000","last_fullsized":"2024-09-20T20:34:42.673319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672991+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:42.672991+0000","last_peered":"2024-09-20T20:34:42.672991+0000","last_clean":"2024-09-20T20:34:42.672991+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:42.672991+0000","last_undegraded":"2024-09-20T20:34:42.672991+0000","last_fullsized":"2024-09-20T20:34:42.672991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1061,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670650+0000","last_change":"2024-09-20T20:34:41.673197+0000","last_active":"2024-09-20T20:34:42.670650+0000","last_peered":"2024-09-20T20:34:42.670650+0000","last_clean":"2024-09-20T20:34:42.670650+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:34:42.670650+0000","last_undegraded":"2024-09-20T20:34:42.670650+0000","last_fullsized":"2024-09-20T20:34:42.670650+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672875+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:42.672875+0000","last_peered":"2024-09-20T20:34:42.672875+0000","last_clean":"2024-09-20T20:34:42.672875+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:42.672875+0000","last_undegraded":"2024-09-20T20:34:42.672875+0000","last_fullsized":"2024-09-20T20:34:42.672875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643828+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:42.643828+0000","last_peered":"2024-09-20T20:34:42.643828+0000","last_clean":"2024-09-20T20:34:42.643828+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:42.643828+0000","last_undegraded":"2024-09-20T20:34:42.643828+0000","last_fullsized":"2024-09-20T20:34:42.643828+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670502+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:42.670502+0000","last_peered":"2024-09-20T20:34:42.670502+0000","last_clean":"2024-09-20T20:34:42.670502+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:42.670502+0000","last_undegraded":"2024-09-20T20:34:42.670502+0000","last_fullsized":"2024-09-20T20:34:42.670502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":574,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642465+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:42.642465+0000","last_peered":"2024-09-20T20:34:42.642465+0000","last_clean":"2024-09-20T20:34:42.642465+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:42.642465+0000","last_undegraded":"2024-09-20T20:34:42.642465+0000","last_fullsized":"2024-09-20T20:34:42.642465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":437,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642608+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:42.642608+0000","last_peered":"2024-09-20T20:34:42.642608+0000","last_clean":"2024-09-20T20:34:42.642608+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:42.642608+0000","last_undegraded":"2024-09-20T20:34:42.642608+0000","last_fullsized":"2024-09-20T20:34:42.642608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":591,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670675+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:42.670675+0000","last_peered":"2024-09-20T20:34:42.670675+0000","last_clean":"2024-09-20T20:34:42.670675+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:42.670675+0000","last_undegraded":"2024-09-20T20:34:42.670675+0000","last_fullsized":"2024-09-20T20:34:42.670675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672453+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:42.672453+0000","last_peered":"2024-09-20T20:34:42.672453+0000","last_clean":"2024-09-20T20:34:42.672453+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:42.672453+0000","last_undegraded":"2024-09-20T20:34:42.672453+0000","last_fullsized":"2024-09-20T20:34:42.672453+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643594+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:42.643594+0000","last_peered":"2024-09-20T20:34:42.643594+0000","last_clean":"2024-09-20T20:34:42.643594+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:42.643594+0000","last_undegraded":"2024-09-20T20:34:42.643594+0000","last_fullsized":"2024-09-20T20:34:42.643594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1088,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670557+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:42.670557+0000","last_peered":"2024-09-20T20:34:42.670557+0000","last_clean":"2024-09-20T20:34:42.670557+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:42.670557+0000","last_undegraded":"2024-09-20T20:34:42.670557+0000","last_fullsized":"2024-09-20T20:34:42.670557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673245+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:42.673245+0000","last_peered":"2024-09-20T20:34:42.673245+0000","last_clean":"2024-09-20T20:34:42.673245+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:42.673245+0000","last_undegraded":"2024-09-20T20:34:42.673245+0000","last_fullsized":"2024-09-20T20:34:42.673245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":676,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670536+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:42.670536+0000","last_peered":"2024-09-20T20:34:42.670536+0000","last_clean":"2024-09-20T20:34:42.670536+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:42.670536+0000","last_undegraded":"2024-09-20T20:34:42.670536+0000","last_fullsized":"2024-09-20T20:34:42.670536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":846,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672855+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:42.672855+0000","last_peered":"2024-09-20T20:34:42.672855+0000","last_clean":"2024-09-20T20:34:42.672855+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:42.672855+0000","last_undegraded":"2024-09-20T20:34:42.672855+0000","last_fullsized":"2024-09-20T20:34:42.672855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":867,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671086+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:42.671086+0000","last_peered":"2024-09-20T20:34:42.671086+0000","last_clean":"2024-09-20T20:34:42.671086+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:42.671086+0000","last_undegraded":"2024-09-20T20:34:42.671086+0000","last_fullsized":"2024-09-20T20:34:42.671086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672283+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:42.672283+0000","last_peered":"2024-09-20T20:34:42.672283+0000","last_clean":"2024-09-20T20:34:42.672283+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:42.672283+0000","last_undegraded":"2024-09-20T20:34:42.672283+0000","last_fullsized":"2024-09-20T20:34:42.672283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":365,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671060+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:42.671060+0000","last_peered":"2024-09-20T20:34:42.671060+0000","last_clean":"2024-09-20T20:34:42.671060+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:42.671060+0000","last_undegraded":"2024-09-20T20:34:42.671060+0000","last_fullsized":"2024-09-20T20:34:42.671060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671738+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:42.671738+0000","last_peered":"2024-09-20T20:34:42.671738+0000","last_clean":"2024-09-20T20:34:42.671738+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:42.671738+0000","last_undegraded":"2024-09-20T20:34:42.671738+0000","last_fullsized":"2024-09-20T20:34:42.671738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671260+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:42.671260+0000","last_peered":"2024-09-20T20:34:42.671260+0000","last_clean":"2024-09-20T20:34:42.671260+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:42.671260+0000","last_undegraded":"2024-09-20T20:34:42.671260+0000","last_fullsized":"2024-09-20T20:34:42.671260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":538,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671557+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:42.671557+0000","last_peered":"2024-09-20T20:34:42.671557+0000","last_clean":"2024-09-20T20:34:42.671557+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:42.671557+0000","last_undegraded":"2024-09-20T20:34:42.671557+0000","last_fullsized":"2024-09-20T20:34:42.671557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671334+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:42.671334+0000","last_peered":"2024-09-20T20:34:42.671334+0000","last_clean":"2024-09-20T20:34:42.671334+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:42.671334+0000","last_undegraded":"2024-09-20T20:34:42.671334+0000","last_fullsized":"2024-09-20T20:34:42.671334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642236+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:42.642236+0000","last_peered":"2024-09-20T20:34:42.642236+0000","last_clean":"2024-09-20T20:34:42.642236+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:42.642236+0000","last_undegraded":"2024-09-20T20:34:42.642236+0000","last_fullsized":"2024-09-20T20:34:42.642236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":370,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642667+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:42.642667+0000","last_peered":"2024-09-20T20:34:42.642667+0000","last_clean":"2024-09-20T20:34:42.642667+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:42.642667+0000","last_undegraded":"2024-09-20T20:34:42.642667+0000","last_fullsized":"2024-09-20T20:34:42.642667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641490+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:42.641490+0000","last_peered":"2024-09-20T20:34:42.641490+0000","last_clean":"2024-09-20T20:34:42.641490+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:42.641490+0000","last_undegraded":"2024-09-20T20:34:42.641490+0000","last_fullsized":"2024-09-20T20:34:42.641490+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672043+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:42.672043+0000","last_peered":"2024-09-20T20:34:42.672043+0000","last_clean":"2024-09-20T20:34:42.672043+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:42.672043+0000","last_undegraded":"2024-09-20T20:34:42.672043+0000","last_fullsized":"2024-09-20T20:34:42.672043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671503+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:42.671503+0000","last_peered":"2024-09-20T20:34:42.671503+0000","last_clean":"2024-09-20T20:34:42.671503+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:42.671503+0000","last_undegraded":"2024-09-20T20:34:42.671503+0000","last_fullsized":"2024-09-20T20:34:42.671503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672549+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:42.672549+0000","last_peered":"2024-09-20T20:34:42.672549+0000","last_clean":"2024-09-20T20:34:42.672549+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:42.672549+0000","last_undegraded":"2024-09-20T20:34:42.672549+0000","last_fullsized":"2024-09-20T20:34:42.672549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642073+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:42.642073+0000","last_peered":"2024-09-20T20:34:42.642073+0000","last_clean":"2024-09-20T20:34:42.642073+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:42.642073+0000","last_undegraded":"2024-09-20T20:34:42.642073+0000","last_fullsized":"2024-09-20T20:34:42.642073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672824+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:42.672824+0000","last_peered":"2024-09-20T20:34:42.672824+0000","last_clean":"2024-09-20T20:34:42.672824+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:42.672824+0000","last_undegraded":"2024-09-20T20:34:42.672824+0000","last_fullsized":"2024-09-20T20:34:42.672824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6675,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99328,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272512,"statfs":{"total":96636764160,"available":96535052288,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104360,"kb_used_data":28816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267480,"statfs":{"total":96636764160,"available":96529899520,"internally_reserved":0,"allocated":29507584,"data_stored":85109907,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57324,"kb_used_data":23640,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94314516,"statfs":{"total":96636764160,"available":96578064384,"internally_reserved":0,"allocated":24207360,"data_stored":90774901,"data_compressed":13901890,"data_compressed_allocated":16965632,"data_compressed_original":84058112,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:51.568 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-20T20:34:51.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:51.905 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:51.906 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:51.922 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-20T20:34:51.726444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6689,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":261012,"kb_used_data":80404,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282854508,"statfs":{"total":289910292480,"available":289643016192,"internally_reserved":0,"allocated":82333696,"data_stored":257450488,"data_compressed":37624865,"data_compressed_allocated":48259072,"data_compressed_original":224894976,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":906,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003671"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672420+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:42.672420+0000","last_peered":"2024-09-20T20:34:42.672420+0000","last_clean":"2024-09-20T20:34:42.672420+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:42.672420+0000","last_undegraded":"2024-09-20T20:34:42.672420+0000","last_fullsized":"2024-09-20T20:34:42.672420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":669,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672061+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:42.672061+0000","last_peered":"2024-09-20T20:34:42.672061+0000","last_clean":"2024-09-20T20:34:42.672061+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:42.672061+0000","last_undegraded":"2024-09-20T20:34:42.672061+0000","last_fullsized":"2024-09-20T20:34:42.672061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643927+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:42.643927+0000","last_peered":"2024-09-20T20:34:42.643927+0000","last_clean":"2024-09-20T20:34:42.643927+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:42.643927+0000","last_undegraded":"2024-09-20T20:34:42.643927+0000","last_fullsized":"2024-09-20T20:34:42.643927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":563,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642893+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:42.642893+0000","last_peered":"2024-09-20T20:34:42.642893+0000","last_clean":"2024-09-20T20:34:42.642893+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:42.642893+0000","last_undegraded":"2024-09-20T20:34:42.642893+0000","last_fullsized":"2024-09-20T20:34:42.642893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":519,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":581,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641951+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:42.641951+0000","last_peered":"2024-09-20T20:34:42.641951+0000","last_clean":"2024-09-20T20:34:42.641951+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:42.641951+0000","last_undegraded":"2024-09-20T20:34:42.641951+0000","last_fullsized":"2024-09-20T20:34:42.641951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641453+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:42.641453+0000","last_peered":"2024-09-20T20:34:42.641453+0000","last_clean":"2024-09-20T20:34:42.641453+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:42.641453+0000","last_undegraded":"2024-09-20T20:34:42.641453+0000","last_fullsized":"2024-09-20T20:34:42.641453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":584,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641806+0000","last_change":"2024-09-20T20:34:41.640769+0000","last_active":"2024-09-20T20:34:42.641806+0000","last_peered":"2024-09-20T20:34:42.641806+0000","last_clean":"2024-09-20T20:34:42.641806+0000","last_became_active":"2024-09-20T20:34:41.636093+0000","last_became_peered":"2024-09-20T20:34:41.636093+0000","last_unstale":"2024-09-20T20:34:42.641806+0000","last_undegraded":"2024-09-20T20:34:42.641806+0000","last_fullsized":"2024-09-20T20:34:42.641806+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:33.620852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672250+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:42.672250+0000","last_peered":"2024-09-20T20:34:42.672250+0000","last_clean":"2024-09-20T20:34:42.672250+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:42.672250+0000","last_undegraded":"2024-09-20T20:34:42.672250+0000","last_fullsized":"2024-09-20T20:34:42.672250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":573,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672463+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:42.672463+0000","last_peered":"2024-09-20T20:34:42.672463+0000","last_clean":"2024-09-20T20:34:42.672463+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:42.672463+0000","last_undegraded":"2024-09-20T20:34:42.672463+0000","last_fullsized":"2024-09-20T20:34:42.672463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643823+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:42.643823+0000","last_peered":"2024-09-20T20:34:42.643823+0000","last_clean":"2024-09-20T20:34:42.643823+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:42.643823+0000","last_undegraded":"2024-09-20T20:34:42.643823+0000","last_fullsized":"2024-09-20T20:34:42.643823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":818,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671401+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:42.671401+0000","last_peered":"2024-09-20T20:34:42.671401+0000","last_clean":"2024-09-20T20:34:42.671401+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:42.671401+0000","last_undegraded":"2024-09-20T20:34:42.671401+0000","last_fullsized":"2024-09-20T20:34:42.671401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670951+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:42.670951+0000","last_peered":"2024-09-20T20:34:42.670951+0000","last_clean":"2024-09-20T20:34:42.670951+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:42.670951+0000","last_undegraded":"2024-09-20T20:34:42.670951+0000","last_fullsized":"2024-09-20T20:34:42.670951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":603,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641827+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:42.641827+0000","last_peered":"2024-09-20T20:34:42.641827+0000","last_clean":"2024-09-20T20:34:42.641827+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:42.641827+0000","last_undegraded":"2024-09-20T20:34:42.641827+0000","last_fullsized":"2024-09-20T20:34:42.641827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":698,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641333+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:42.641333+0000","last_peered":"2024-09-20T20:34:42.641333+0000","last_clean":"2024-09-20T20:34:42.641333+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:42.641333+0000","last_undegraded":"2024-09-20T20:34:42.641333+0000","last_fullsized":"2024-09-20T20:34:42.641333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642189+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:42.642189+0000","last_peered":"2024-09-20T20:34:42.642189+0000","last_clean":"2024-09-20T20:34:42.642189+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:42.642189+0000","last_undegraded":"2024-09-20T20:34:42.642189+0000","last_fullsized":"2024-09-20T20:34:42.642189+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673148+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:42.673148+0000","last_peered":"2024-09-20T20:34:42.673148+0000","last_clean":"2024-09-20T20:34:42.673148+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:42.673148+0000","last_undegraded":"2024-09-20T20:34:42.673148+0000","last_fullsized":"2024-09-20T20:34:42.673148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672427+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:42.672427+0000","last_peered":"2024-09-20T20:34:42.672427+0000","last_clean":"2024-09-20T20:34:42.672427+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:42.672427+0000","last_undegraded":"2024-09-20T20:34:42.672427+0000","last_fullsized":"2024-09-20T20:34:42.672427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":646,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671368+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:42.671368+0000","last_peered":"2024-09-20T20:34:42.671368+0000","last_clean":"2024-09-20T20:34:42.671368+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:42.671368+0000","last_undegraded":"2024-09-20T20:34:42.671368+0000","last_fullsized":"2024-09-20T20:34:42.671368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643226+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:42.643226+0000","last_peered":"2024-09-20T20:34:42.643226+0000","last_clean":"2024-09-20T20:34:42.643226+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:42.643226+0000","last_undegraded":"2024-09-20T20:34:42.643226+0000","last_fullsized":"2024-09-20T20:34:42.643226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642735+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:42.642735+0000","last_peered":"2024-09-20T20:34:42.642735+0000","last_clean":"2024-09-20T20:34:42.642735+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:42.642735+0000","last_undegraded":"2024-09-20T20:34:42.642735+0000","last_fullsized":"2024-09-20T20:34:42.642735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":966,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670666+0000","last_change":"2024-09-20T20:34:39.664844+0000","last_active":"2024-09-20T20:34:42.670666+0000","last_peered":"2024-09-20T20:34:42.670666+0000","last_clean":"2024-09-20T20:34:42.670666+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:34:42.670666+0000","last_undegraded":"2024-09-20T20:34:42.670666+0000","last_fullsized":"2024-09-20T20:34:42.670666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1010,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670184+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:42.670184+0000","last_peered":"2024-09-20T20:34:42.670184+0000","last_clean":"2024-09-20T20:34:42.670184+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:42.670184+0000","last_undegraded":"2024-09-20T20:34:42.670184+0000","last_fullsized":"2024-09-20T20:34:42.670184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":694,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670222+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:42.670222+0000","last_peered":"2024-09-20T20:34:42.670222+0000","last_clean":"2024-09-20T20:34:42.670222+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:42.670222+0000","last_undegraded":"2024-09-20T20:34:42.670222+0000","last_fullsized":"2024-09-20T20:34:42.670222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672720+0000","last_change":"2024-09-20T20:34:38.665667+0000","last_active":"2024-09-20T20:34:42.672720+0000","last_peered":"2024-09-20T20:34:42.672720+0000","last_clean":"2024-09-20T20:34:42.672720+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:34:42.672720+0000","last_undegraded":"2024-09-20T20:34:42.672720+0000","last_fullsized":"2024-09-20T20:34:42.672720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:54.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1085,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672227+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:42.672227+0000","last_peered":"2024-09-20T20:34:42.672227+0000","last_clean":"2024-09-20T20:34:42.672227+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:42.672227+0000","last_undegraded":"2024-09-20T20:34:42.672227+0000","last_fullsized":"2024-09-20T20:34:42.672227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":628,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643749+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:42.643749+0000","last_peered":"2024-09-20T20:34:42.643749+0000","last_clean":"2024-09-20T20:34:42.643749+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:42.643749+0000","last_undegraded":"2024-09-20T20:34:42.643749+0000","last_fullsized":"2024-09-20T20:34:42.643749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671857+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:42.671857+0000","last_peered":"2024-09-20T20:34:42.671857+0000","last_clean":"2024-09-20T20:34:42.671857+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:42.671857+0000","last_undegraded":"2024-09-20T20:34:42.671857+0000","last_fullsized":"2024-09-20T20:34:42.671857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671485+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:42.671485+0000","last_peered":"2024-09-20T20:34:42.671485+0000","last_clean":"2024-09-20T20:34:42.671485+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:42.671485+0000","last_undegraded":"2024-09-20T20:34:42.671485+0000","last_fullsized":"2024-09-20T20:34:42.671485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1021,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671161+0000","last_change":"2024-09-20T20:34:40.670826+0000","last_active":"2024-09-20T20:34:42.671161+0000","last_peered":"2024-09-20T20:34:42.671161+0000","last_clean":"2024-09-20T20:34:42.671161+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:34:42.671161+0000","last_undegraded":"2024-09-20T20:34:42.671161+0000","last_fullsized":"2024-09-20T20:34:42.671161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:58.351454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":620,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670205+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:42.670205+0000","last_peered":"2024-09-20T20:34:42.670205+0000","last_clean":"2024-09-20T20:34:42.670205+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:42.670205+0000","last_undegraded":"2024-09-20T20:34:42.670205+0000","last_fullsized":"2024-09-20T20:34:42.670205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.648962+0000","last_change":"2024-09-20T20:34:42.648962+0000","last_active":"2024-09-20T20:34:42.648962+0000","last_peered":"2024-09-20T20:34:42.648962+0000","last_clean":"2024-09-20T20:34:42.648962+0000","last_became_active":"2024-09-20T20:34:42.644350+0000","last_became_peered":"2024-09-20T20:34:42.644350+0000","last_unstale":"2024-09-20T20:34:42.648962+0000","last_undegraded":"2024-09-20T20:34:42.648962+0000","last_fullsized":"2024-09-20T20:34:42.648962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:04.662945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":497,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":567,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641959+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:42.641959+0000","last_peered":"2024-09-20T20:34:42.641959+0000","last_clean":"2024-09-20T20:34:42.641959+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:42.641959+0000","last_undegraded":"2024-09-20T20:34:42.641959+0000","last_fullsized":"2024-09-20T20:34:42.641959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":535,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671908+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:42.671908+0000","last_peered":"2024-09-20T20:34:42.671908+0000","last_clean":"2024-09-20T20:34:42.671908+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:42.671908+0000","last_undegraded":"2024-09-20T20:34:42.671908+0000","last_fullsized":"2024-09-20T20:34:42.671908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1003,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672857+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:42.672857+0000","last_peered":"2024-09-20T20:34:42.672857+0000","last_clean":"2024-09-20T20:34:42.672857+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:42.672857+0000","last_undegraded":"2024-09-20T20:34:42.672857+0000","last_fullsized":"2024-09-20T20:34:42.672857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670825+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:42.670825+0000","last_peered":"2024-09-20T20:34:42.670825+0000","last_clean":"2024-09-20T20:34:42.670825+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:42.670825+0000","last_undegraded":"2024-09-20T20:34:42.670825+0000","last_fullsized":"2024-09-20T20:34:42.670825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.680079+0000","last_change":"2024-09-20T20:34:42.679159+0000","last_active":"2024-09-20T20:34:42.680079+0000","last_peered":"2024-09-20T20:34:42.680079+0000","last_clean":"2024-09-20T20:34:42.680079+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:34:42.680079+0000","last_undegraded":"2024-09-20T20:34:42.680079+0000","last_fullsized":"2024-09-20T20:34:42.680079+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641095+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:42.641095+0000","last_peered":"2024-09-20T20:34:42.641095+0000","last_clean":"2024-09-20T20:34:42.641095+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:42.641095+0000","last_undegraded":"2024-09-20T20:34:42.641095+0000","last_fullsized":"2024-09-20T20:34:42.641095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.644300+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:42.644300+0000","last_peered":"2024-09-20T20:34:42.644300+0000","last_clean":"2024-09-20T20:34:42.644300+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:42.644300+0000","last_undegraded":"2024-09-20T20:34:42.644300+0000","last_fullsized":"2024-09-20T20:34:42.644300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":908,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670248+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:42.670248+0000","last_peered":"2024-09-20T20:34:42.670248+0000","last_clean":"2024-09-20T20:34:42.670248+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:42.670248+0000","last_undegraded":"2024-09-20T20:34:42.670248+0000","last_fullsized":"2024-09-20T20:34:42.670248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672716+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:42.672716+0000","last_peered":"2024-09-20T20:34:42.672716+0000","last_clean":"2024-09-20T20:34:42.672716+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:42.672716+0000","last_undegraded":"2024-09-20T20:34:42.672716+0000","last_fullsized":"2024-09-20T20:34:42.672716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670493+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:42.670493+0000","last_peered":"2024-09-20T20:34:42.670493+0000","last_clean":"2024-09-20T20:34:42.670493+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:42.670493+0000","last_undegraded":"2024-09-20T20:34:42.670493+0000","last_fullsized":"2024-09-20T20:34:42.670493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643435+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:42.643435+0000","last_peered":"2024-09-20T20:34:42.643435+0000","last_clean":"2024-09-20T20:34:42.643435+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:42.643435+0000","last_undegraded":"2024-09-20T20:34:42.643435+0000","last_fullsized":"2024-09-20T20:34:42.643435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642118+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:42.642118+0000","last_peered":"2024-09-20T20:34:42.642118+0000","last_clean":"2024-09-20T20:34:42.642118+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:42.642118+0000","last_undegraded":"2024-09-20T20:34:42.642118+0000","last_fullsized":"2024-09-20T20:34:42.642118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642945+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:42.642945+0000","last_peered":"2024-09-20T20:34:42.642945+0000","last_clean":"2024-09-20T20:34:42.642945+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:42.642945+0000","last_undegraded":"2024-09-20T20:34:42.642945+0000","last_fullsized":"2024-09-20T20:34:42.642945+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671371+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:42.671371+0000","last_peered":"2024-09-20T20:34:42.671371+0000","last_clean":"2024-09-20T20:34:42.671371+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:42.671371+0000","last_undegraded":"2024-09-20T20:34:42.671371+0000","last_fullsized":"2024-09-20T20:34:42.671371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":377,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672768+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:42.672768+0000","last_peered":"2024-09-20T20:34:42.672768+0000","last_clean":"2024-09-20T20:34:42.672768+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:42.672768+0000","last_undegraded":"2024-09-20T20:34:42.672768+0000","last_fullsized":"2024-09-20T20:34:42.672768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643508+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:42.643508+0000","last_peered":"2024-09-20T20:34:42.643508+0000","last_clean":"2024-09-20T20:34:42.643508+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:42.643508+0000","last_undegraded":"2024-09-20T20:34:42.643508+0000","last_fullsized":"2024-09-20T20:34:42.643508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641377+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:42.641377+0000","last_peered":"2024-09-20T20:34:42.641377+0000","last_clean":"2024-09-20T20:34:42.641377+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:42.641377+0000","last_undegraded":"2024-09-20T20:34:42.641377+0000","last_fullsized":"2024-09-20T20:34:42.641377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643266+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:42.643266+0000","last_peered":"2024-09-20T20:34:42.643266+0000","last_clean":"2024-09-20T20:34:42.643266+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:42.643266+0000","last_undegraded":"2024-09-20T20:34:42.643266+0000","last_fullsized":"2024-09-20T20:34:42.643266+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671097+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:42.671097+0000","last_peered":"2024-09-20T20:34:42.671097+0000","last_clean":"2024-09-20T20:34:42.671097+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:42.671097+0000","last_undegraded":"2024-09-20T20:34:42.671097+0000","last_fullsized":"2024-09-20T20:34:42.671097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":605,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643737+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:42.643737+0000","last_peered":"2024-09-20T20:34:42.643737+0000","last_clean":"2024-09-20T20:34:42.643737+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:42.643737+0000","last_undegraded":"2024-09-20T20:34:42.643737+0000","last_fullsized":"2024-09-20T20:34:42.643737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":649,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670459+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:42.670459+0000","last_peered":"2024-09-20T20:34:42.670459+0000","last_clean":"2024-09-20T20:34:42.670459+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:42.670459+0000","last_undegraded":"2024-09-20T20:34:42.670459+0000","last_fullsized":"2024-09-20T20:34:42.670459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":597,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672394+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:42.672394+0000","last_peered":"2024-09-20T20:34:42.672394+0000","last_clean":"2024-09-20T20:34:42.672394+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:42.672394+0000","last_undegraded":"2024-09-20T20:34:42.672394+0000","last_fullsized":"2024-09-20T20:34:42.672394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":353,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640514+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:42.640514+0000","last_peered":"2024-09-20T20:34:42.640514+0000","last_clean":"2024-09-20T20:34:42.640514+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:42.640514+0000","last_undegraded":"2024-09-20T20:34:42.640514+0000","last_fullsized":"2024-09-20T20:34:42.640514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":93,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641106+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:42.641106+0000","last_peered":"2024-09-20T20:34:42.641106+0000","last_clean":"2024-09-20T20:34:42.641106+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:42.641106+0000","last_undegraded":"2024-09-20T20:34:42.641106+0000","last_fullsized":"2024-09-20T20:34:42.641106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":728,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672067+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:42.672067+0000","last_peered":"2024-09-20T20:34:42.672067+0000","last_clean":"2024-09-20T20:34:42.672067+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:42.672067+0000","last_undegraded":"2024-09-20T20:34:42.672067+0000","last_fullsized":"2024-09-20T20:34:42.672067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643546+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:42.643546+0000","last_peered":"2024-09-20T20:34:42.643546+0000","last_clean":"2024-09-20T20:34:42.643546+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:42.643546+0000","last_undegraded":"2024-09-20T20:34:42.643546+0000","last_fullsized":"2024-09-20T20:34:42.643546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641946+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:42.641946+0000","last_peered":"2024-09-20T20:34:42.641946+0000","last_clean":"2024-09-20T20:34:42.641946+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:42.641946+0000","last_undegraded":"2024-09-20T20:34:42.641946+0000","last_fullsized":"2024-09-20T20:34:42.641946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":372,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670895+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:42.670895+0000","last_peered":"2024-09-20T20:34:42.670895+0000","last_clean":"2024-09-20T20:34:42.670895+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:42.670895+0000","last_undegraded":"2024-09-20T20:34:42.670895+0000","last_fullsized":"2024-09-20T20:34:42.670895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672614+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:42.672614+0000","last_peered":"2024-09-20T20:34:42.672614+0000","last_clean":"2024-09-20T20:34:42.672614+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:42.672614+0000","last_undegraded":"2024-09-20T20:34:42.672614+0000","last_fullsized":"2024-09-20T20:34:42.672614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670548+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:42.670548+0000","last_peered":"2024-09-20T20:34:42.670548+0000","last_clean":"2024-09-20T20:34:42.670548+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:42.670548+0000","last_undegraded":"2024-09-20T20:34:42.670548+0000","last_fullsized":"2024-09-20T20:34:42.670548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672623+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:42.672623+0000","last_peered":"2024-09-20T20:34:42.672623+0000","last_clean":"2024-09-20T20:34:42.672623+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:42.672623+0000","last_undegraded":"2024-09-20T20:34:42.672623+0000","last_fullsized":"2024-09-20T20:34:42.672623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640901+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:42.640901+0000","last_peered":"2024-09-20T20:34:42.640901+0000","last_clean":"2024-09-20T20:34:42.640901+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:42.640901+0000","last_undegraded":"2024-09-20T20:34:42.640901+0000","last_fullsized":"2024-09-20T20:34:42.640901+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641845+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:42.641845+0000","last_peered":"2024-09-20T20:34:42.641845+0000","last_clean":"2024-09-20T20:34:42.641845+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:42.641845+0000","last_undegraded":"2024-09-20T20:34:42.641845+0000","last_fullsized":"2024-09-20T20:34:42.641845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672046+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:42.672046+0000","last_peered":"2024-09-20T20:34:42.672046+0000","last_clean":"2024-09-20T20:34:42.672046+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:42.672046+0000","last_undegraded":"2024-09-20T20:34:42.672046+0000","last_fullsized":"2024-09-20T20:34:42.672046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":327,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642890+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:42.642890+0000","last_peered":"2024-09-20T20:34:42.642890+0000","last_clean":"2024-09-20T20:34:42.642890+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:42.642890+0000","last_undegraded":"2024-09-20T20:34:42.642890+0000","last_fullsized":"2024-09-20T20:34:42.642890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672338+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:42.672338+0000","last_peered":"2024-09-20T20:34:42.672338+0000","last_clean":"2024-09-20T20:34:42.672338+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:42.672338+0000","last_undegraded":"2024-09-20T20:34:42.672338+0000","last_fullsized":"2024-09-20T20:34:42.672338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":842,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670969+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:42.670969+0000","last_peered":"2024-09-20T20:34:42.670969+0000","last_clean":"2024-09-20T20:34:42.670969+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:42.670969+0000","last_undegraded":"2024-09-20T20:34:42.670969+0000","last_fullsized":"2024-09-20T20:34:42.670969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672097+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:42.672097+0000","last_peered":"2024-09-20T20:34:42.672097+0000","last_clean":"2024-09-20T20:34:42.672097+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:42.672097+0000","last_undegraded":"2024-09-20T20:34:42.672097+0000","last_fullsized":"2024-09-20T20:34:42.672097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672545+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:42.672545+0000","last_peered":"2024-09-20T20:34:42.672545+0000","last_clean":"2024-09-20T20:34:42.672545+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:42.672545+0000","last_undegraded":"2024-09-20T20:34:42.672545+0000","last_fullsized":"2024-09-20T20:34:42.672545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":898,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671061+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:42.671061+0000","last_peered":"2024-09-20T20:34:42.671061+0000","last_clean":"2024-09-20T20:34:42.671061+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:42.671061+0000","last_undegraded":"2024-09-20T20:34:42.671061+0000","last_fullsized":"2024-09-20T20:34:42.671061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673319+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:42.673319+0000","last_peered":"2024-09-20T20:34:42.673319+0000","last_clean":"2024-09-20T20:34:42.673319+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:42.673319+0000","last_undegraded":"2024-09-20T20:34:42.673319+0000","last_fullsized":"2024-09-20T20:34:42.673319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672991+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:42.672991+0000","last_peered":"2024-09-20T20:34:42.672991+0000","last_clean":"2024-09-20T20:34:42.672991+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:42.672991+0000","last_undegraded":"2024-09-20T20:34:42.672991+0000","last_fullsized":"2024-09-20T20:34:42.672991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1061,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670650+0000","last_change":"2024-09-20T20:34:41.673197+0000","last_active":"2024-09-20T20:34:42.670650+0000","last_peered":"2024-09-20T20:34:42.670650+0000","last_clean":"2024-09-20T20:34:42.670650+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:34:42.670650+0000","last_undegraded":"2024-09-20T20:34:42.670650+0000","last_fullsized":"2024-09-20T20:34:42.670650+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672875+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:42.672875+0000","last_peered":"2024-09-20T20:34:42.672875+0000","last_clean":"2024-09-20T20:34:42.672875+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:42.672875+0000","last_undegraded":"2024-09-20T20:34:42.672875+0000","last_fullsized":"2024-09-20T20:34:42.672875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643828+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:42.643828+0000","last_peered":"2024-09-20T20:34:42.643828+0000","last_clean":"2024-09-20T20:34:42.643828+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:42.643828+0000","last_undegraded":"2024-09-20T20:34:42.643828+0000","last_fullsized":"2024-09-20T20:34:42.643828+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670502+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:42.670502+0000","last_peered":"2024-09-20T20:34:42.670502+0000","last_clean":"2024-09-20T20:34:42.670502+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:42.670502+0000","last_undegraded":"2024-09-20T20:34:42.670502+0000","last_fullsized":"2024-09-20T20:34:42.670502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":574,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642465+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:42.642465+0000","last_peered":"2024-09-20T20:34:42.642465+0000","last_clean":"2024-09-20T20:34:42.642465+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:42.642465+0000","last_undegraded":"2024-09-20T20:34:42.642465+0000","last_fullsized":"2024-09-20T20:34:42.642465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":437,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642608+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:42.642608+0000","last_peered":"2024-09-20T20:34:42.642608+0000","last_clean":"2024-09-20T20:34:42.642608+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:42.642608+0000","last_undegraded":"2024-09-20T20:34:42.642608+0000","last_fullsized":"2024-09-20T20:34:42.642608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":591,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670675+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:42.670675+0000","last_peered":"2024-09-20T20:34:42.670675+0000","last_clean":"2024-09-20T20:34:42.670675+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:42.670675+0000","last_undegraded":"2024-09-20T20:34:42.670675+0000","last_fullsized":"2024-09-20T20:34:42.670675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672453+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:42.672453+0000","last_peered":"2024-09-20T20:34:42.672453+0000","last_clean":"2024-09-20T20:34:42.672453+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:42.672453+0000","last_undegraded":"2024-09-20T20:34:42.672453+0000","last_fullsized":"2024-09-20T20:34:42.672453+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643594+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:42.643594+0000","last_peered":"2024-09-20T20:34:42.643594+0000","last_clean":"2024-09-20T20:34:42.643594+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:42.643594+0000","last_undegraded":"2024-09-20T20:34:42.643594+0000","last_fullsized":"2024-09-20T20:34:42.643594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1088,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670557+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:42.670557+0000","last_peered":"2024-09-20T20:34:42.670557+0000","last_clean":"2024-09-20T20:34:42.670557+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:42.670557+0000","last_undegraded":"2024-09-20T20:34:42.670557+0000","last_fullsized":"2024-09-20T20:34:42.670557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673245+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:42.673245+0000","last_peered":"2024-09-20T20:34:42.673245+0000","last_clean":"2024-09-20T20:34:42.673245+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:42.673245+0000","last_undegraded":"2024-09-20T20:34:42.673245+0000","last_fullsized":"2024-09-20T20:34:42.673245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":676,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670536+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:42.670536+0000","last_peered":"2024-09-20T20:34:42.670536+0000","last_clean":"2024-09-20T20:34:42.670536+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:42.670536+0000","last_undegraded":"2024-09-20T20:34:42.670536+0000","last_fullsized":"2024-09-20T20:34:42.670536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":846,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672855+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:42.672855+0000","last_peered":"2024-09-20T20:34:42.672855+0000","last_clean":"2024-09-20T20:34:42.672855+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:42.672855+0000","last_undegraded":"2024-09-20T20:34:42.672855+0000","last_fullsized":"2024-09-20T20:34:42.672855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":867,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671086+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:42.671086+0000","last_peered":"2024-09-20T20:34:42.671086+0000","last_clean":"2024-09-20T20:34:42.671086+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:42.671086+0000","last_undegraded":"2024-09-20T20:34:42.671086+0000","last_fullsized":"2024-09-20T20:34:42.671086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672283+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:42.672283+0000","last_peered":"2024-09-20T20:34:42.672283+0000","last_clean":"2024-09-20T20:34:42.672283+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:42.672283+0000","last_undegraded":"2024-09-20T20:34:42.672283+0000","last_fullsized":"2024-09-20T20:34:42.672283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":365,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671060+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:42.671060+0000","last_peered":"2024-09-20T20:34:42.671060+0000","last_clean":"2024-09-20T20:34:42.671060+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:42.671060+0000","last_undegraded":"2024-09-20T20:34:42.671060+0000","last_fullsized":"2024-09-20T20:34:42.671060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671738+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:42.671738+0000","last_peered":"2024-09-20T20:34:42.671738+0000","last_clean":"2024-09-20T20:34:42.671738+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:42.671738+0000","last_undegraded":"2024-09-20T20:34:42.671738+0000","last_fullsized":"2024-09-20T20:34:42.671738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671260+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:42.671260+0000","last_peered":"2024-09-20T20:34:42.671260+0000","last_clean":"2024-09-20T20:34:42.671260+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:42.671260+0000","last_undegraded":"2024-09-20T20:34:42.671260+0000","last_fullsized":"2024-09-20T20:34:42.671260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":538,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671557+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:42.671557+0000","last_peered":"2024-09-20T20:34:42.671557+0000","last_clean":"2024-09-20T20:34:42.671557+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:42.671557+0000","last_undegraded":"2024-09-20T20:34:42.671557+0000","last_fullsized":"2024-09-20T20:34:42.671557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671334+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:42.671334+0000","last_peered":"2024-09-20T20:34:42.671334+0000","last_clean":"2024-09-20T20:34:42.671334+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:42.671334+0000","last_undegraded":"2024-09-20T20:34:42.671334+0000","last_fullsized":"2024-09-20T20:34:42.671334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642236+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:42.642236+0000","last_peered":"2024-09-20T20:34:42.642236+0000","last_clean":"2024-09-20T20:34:42.642236+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:42.642236+0000","last_undegraded":"2024-09-20T20:34:42.642236+0000","last_fullsized":"2024-09-20T20:34:42.642236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":370,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642667+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:42.642667+0000","last_peered":"2024-09-20T20:34:42.642667+0000","last_clean":"2024-09-20T20:34:42.642667+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:42.642667+0000","last_undegraded":"2024-09-20T20:34:42.642667+0000","last_fullsized":"2024-09-20T20:34:42.642667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641490+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:42.641490+0000","last_peered":"2024-09-20T20:34:42.641490+0000","last_clean":"2024-09-20T20:34:42.641490+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:42.641490+0000","last_undegraded":"2024-09-20T20:34:42.641490+0000","last_fullsized":"2024-09-20T20:34:42.641490+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672043+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:42.672043+0000","last_peered":"2024-09-20T20:34:42.672043+0000","last_clean":"2024-09-20T20:34:42.672043+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:42.672043+0000","last_undegraded":"2024-09-20T20:34:42.672043+0000","last_fullsized":"2024-09-20T20:34:42.672043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671503+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:42.671503+0000","last_peered":"2024-09-20T20:34:42.671503+0000","last_clean":"2024-09-20T20:34:42.671503+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:42.671503+0000","last_undegraded":"2024-09-20T20:34:42.671503+0000","last_fullsized":"2024-09-20T20:34:42.671503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672549+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:42.672549+0000","last_peered":"2024-09-20T20:34:42.672549+0000","last_clean":"2024-09-20T20:34:42.672549+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:42.672549+0000","last_undegraded":"2024-09-20T20:34:42.672549+0000","last_fullsized":"2024-09-20T20:34:42.672549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642073+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:42.642073+0000","last_peered":"2024-09-20T20:34:42.642073+0000","last_clean":"2024-09-20T20:34:42.642073+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:42.642073+0000","last_undegraded":"2024-09-20T20:34:42.642073+0000","last_fullsized":"2024-09-20T20:34:42.642073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672824+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:42.672824+0000","last_peered":"2024-09-20T20:34:42.672824+0000","last_clean":"2024-09-20T20:34:42.672824+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:42.672824+0000","last_undegraded":"2024-09-20T20:34:42.672824+0000","last_fullsized":"2024-09-20T20:34:42.672824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6675,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99328,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272512,"statfs":{"total":96636764160,"available":96535052288,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104360,"kb_used_data":28816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267480,"statfs":{"total":96636764160,"available":96529899520,"internally_reserved":0,"allocated":29507584,"data_stored":85109907,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57324,"kb_used_data":23640,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94314516,"statfs":{"total":96636764160,"available":96578064384,"internally_reserved":0,"allocated":24207360,"data_stored":90774901,"data_compressed":13901890,"data_compressed_allocated":16965632,"data_compressed_original":84058112,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:51.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:34:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:52.246 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":95,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:34:42.660804+0000","last_up_change":"2024-09-20T20:34:16.788033+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":57,"up_from":69,"up_thru":94,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6801","nonce":575774322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6803","nonce":575774322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6807","nonce":575774322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6805","nonce":575774322}]},"public_addr":"172.21.15.79:6801/575774322","cluster_addr":"172.21.15.79:6803/575774322","heartbeat_back_addr":"172.21.15.79:6807/575774322","heartbeat_front_addr":"172.21.15.79:6805/575774322","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":57},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.2d","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:34:53.264 INFO:tasks.ceph:Scrubbing osd.0 2024-09-20T20:34:53.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-20T20:34:53.421 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:34:53.421 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-20T20:34:53.421 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:34:53.437 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-20T20:34:53.720 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2024-09-20T20:34:53.738 INFO:tasks.ceph:Scrubbing osd.1 2024-09-20T20:34:53.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-20T20:34:53.883 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:34:53.884 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-20T20:34:53.884 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:34:53.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-20T20:34:54.178 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2024-09-20T20:34:54.196 INFO:tasks.ceph:Scrubbing osd.2 2024-09-20T20:34:54.196 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-20T20:34:54.334 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-20T20:34:54.335 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-20T20:34:54.335 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-20T20:34:54.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-20T20:34:54.629 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2024-09-20T20:34:54.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:34:54.936 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:34:54.938 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:34:54.952 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-20T20:34:53.726906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6689,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33184,"ondisk_log_size":33184,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":261012,"kb_used_data":80404,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282854508,"statfs":{"total":289910292480,"available":289643016192,"internally_reserved":0,"allocated":82333696,"data_stored":257450488,"data_compressed":37624865,"data_compressed_allocated":48259072,"data_compressed_original":224894976,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-684,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":906,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.058284"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672420+0000","last_change":"2024-09-20T20:34:26.696369+0000","last_active":"2024-09-20T20:34:42.672420+0000","last_peered":"2024-09-20T20:34:42.672420+0000","last_clean":"2024-09-20T20:34:42.672420+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:34:42.672420+0000","last_undegraded":"2024-09-20T20:34:42.672420+0000","last_fullsized":"2024-09-20T20:34:42.672420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:42.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":669,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672061+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:42.672061+0000","last_peered":"2024-09-20T20:34:42.672061+0000","last_clean":"2024-09-20T20:34:42.672061+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:42.672061+0000","last_undegraded":"2024-09-20T20:34:42.672061+0000","last_fullsized":"2024-09-20T20:34:42.672061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:00:51.958858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":595,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643927+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:42.643927+0000","last_peered":"2024-09-20T20:34:42.643927+0000","last_clean":"2024-09-20T20:34:42.643927+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:42.643927+0000","last_undegraded":"2024-09-20T20:34:42.643927+0000","last_fullsized":"2024-09-20T20:34:42.643927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:39:57.921184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":563,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642893+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:42.642893+0000","last_peered":"2024-09-20T20:34:42.642893+0000","last_clean":"2024-09-20T20:34:42.642893+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:42.642893+0000","last_undegraded":"2024-09-20T20:34:42.642893+0000","last_fullsized":"2024-09-20T20:34:42.642893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:30.243365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":519,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:34:26.691526+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:21.691364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":581,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641951+0000","last_change":"2024-09-20T20:34:30.633458+0000","last_active":"2024-09-20T20:34:42.641951+0000","last_peered":"2024-09-20T20:34:42.641951+0000","last_clean":"2024-09-20T20:34:42.641951+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:42.641951+0000","last_undegraded":"2024-09-20T20:34:42.641951+0000","last_fullsized":"2024-09-20T20:34:42.641951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:57.825309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":626,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641453+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:42.641453+0000","last_peered":"2024-09-20T20:34:42.641453+0000","last_clean":"2024-09-20T20:34:42.641453+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:42.641453+0000","last_undegraded":"2024-09-20T20:34:42.641453+0000","last_fullsized":"2024-09-20T20:34:42.641453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:28:10.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":584,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641806+0000","last_change":"2024-09-20T20:34:41.640769+0000","last_active":"2024-09-20T20:34:42.641806+0000","last_peered":"2024-09-20T20:34:42.641806+0000","last_clean":"2024-09-20T20:34:42.641806+0000","last_became_active":"2024-09-20T20:34:41.636093+0000","last_became_peered":"2024-09-20T20:34:41.636093+0000","last_unstale":"2024-09-20T20:34:42.641806+0000","last_undegraded":"2024-09-20T20:34:42.641806+0000","last_fullsized":"2024-09-20T20:34:42.641806+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:33.620852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672250+0000","last_change":"2024-09-20T20:29:54.997671+0000","last_active":"2024-09-20T20:34:42.672250+0000","last_peered":"2024-09-20T20:34:42.672250+0000","last_clean":"2024-09-20T20:34:42.672250+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:34:42.672250+0000","last_undegraded":"2024-09-20T20:34:42.672250+0000","last_fullsized":"2024-09-20T20:34:42.672250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:12.966501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":573,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672463+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:42.672463+0000","last_peered":"2024-09-20T20:34:42.672463+0000","last_clean":"2024-09-20T20:34:42.672463+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:42.672463+0000","last_undegraded":"2024-09-20T20:34:42.672463+0000","last_fullsized":"2024-09-20T20:34:42.672463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.029744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643823+0000","last_change":"2024-09-20T20:34:25.642338+0000","last_active":"2024-09-20T20:34:42.643823+0000","last_peered":"2024-09-20T20:34:42.643823+0000","last_clean":"2024-09-20T20:34:42.643823+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:34:42.643823+0000","last_undegraded":"2024-09-20T20:34:42.643823+0000","last_fullsized":"2024-09-20T20:34:42.643823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:40.129296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":818,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671401+0000","last_change":"2024-09-20T20:34:26.703918+0000","last_active":"2024-09-20T20:34:42.671401+0000","last_peered":"2024-09-20T20:34:42.671401+0000","last_clean":"2024-09-20T20:34:42.671401+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:42.671401+0000","last_undegraded":"2024-09-20T20:34:42.671401+0000","last_fullsized":"2024-09-20T20:34:42.671401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670951+0000","last_change":"2024-09-20T20:34:26.698291+0000","last_active":"2024-09-20T20:34:42.670951+0000","last_peered":"2024-09-20T20:34:42.670951+0000","last_clean":"2024-09-20T20:34:42.670951+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:34:42.670951+0000","last_undegraded":"2024-09-20T20:34:42.670951+0000","last_fullsized":"2024-09-20T20:34:42.670951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:06.228198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":603,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641827+0000","last_change":"2024-09-20T20:34:31.640243+0000","last_active":"2024-09-20T20:34:42.641827+0000","last_peered":"2024-09-20T20:34:42.641827+0000","last_clean":"2024-09-20T20:34:42.641827+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:42.641827+0000","last_undegraded":"2024-09-20T20:34:42.641827+0000","last_fullsized":"2024-09-20T20:34:42.641827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:11:53.408942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":698,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641333+0000","last_change":"2024-09-20T20:34:29.638955+0000","last_active":"2024-09-20T20:34:42.641333+0000","last_peered":"2024-09-20T20:34:42.641333+0000","last_clean":"2024-09-20T20:34:42.641333+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:42.641333+0000","last_undegraded":"2024-09-20T20:34:42.641333+0000","last_fullsized":"2024-09-20T20:34:42.641333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:53:25.877725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642189+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:42.642189+0000","last_peered":"2024-09-20T20:34:42.642189+0000","last_clean":"2024-09-20T20:34:42.642189+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:42.642189+0000","last_undegraded":"2024-09-20T20:34:42.642189+0000","last_fullsized":"2024-09-20T20:34:42.642189+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:41:50.653453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673148+0000","last_change":"2024-09-20T20:29:55.015236+0000","last_active":"2024-09-20T20:34:42.673148+0000","last_peered":"2024-09-20T20:34:42.673148+0000","last_clean":"2024-09-20T20:34:42.673148+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:42.673148+0000","last_undegraded":"2024-09-20T20:34:42.673148+0000","last_fullsized":"2024-09-20T20:34:42.673148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:36:15.946905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":633,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672427+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:42.672427+0000","last_peered":"2024-09-20T20:34:42.672427+0000","last_clean":"2024-09-20T20:34:42.672427+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:42.672427+0000","last_undegraded":"2024-09-20T20:34:42.672427+0000","last_fullsized":"2024-09-20T20:34:42.672427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":646,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671368+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:42.671368+0000","last_peered":"2024-09-20T20:34:42.671368+0000","last_clean":"2024-09-20T20:34:42.671368+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:42.671368+0000","last_undegraded":"2024-09-20T20:34:42.671368+0000","last_fullsized":"2024-09-20T20:34:42.671368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:54.818655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":615,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643226+0000","last_change":"2024-09-20T20:34:26.659716+0000","last_active":"2024-09-20T20:34:42.643226+0000","last_peered":"2024-09-20T20:34:42.643226+0000","last_clean":"2024-09-20T20:34:42.643226+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:34:42.643226+0000","last_undegraded":"2024-09-20T20:34:42.643226+0000","last_fullsized":"2024-09-20T20:34:42.643226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:47.756295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642735+0000","last_change":"2024-09-20T20:34:24.633395+0000","last_active":"2024-09-20T20:34:42.642735+0000","last_peered":"2024-09-20T20:34:42.642735+0000","last_clean":"2024-09-20T20:34:42.642735+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:34:42.642735+0000","last_undegraded":"2024-09-20T20:34:42.642735+0000","last_fullsized":"2024-09-20T20:34:42.642735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:19.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":966,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670666+0000","last_change":"2024-09-20T20:34:39.664844+0000","last_active":"2024-09-20T20:34:42.670666+0000","last_peered":"2024-09-20T20:34:42.670666+0000","last_clean":"2024-09-20T20:34:42.670666+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:34:42.670666+0000","last_undegraded":"2024-09-20T20:34:42.670666+0000","last_fullsized":"2024-09-20T20:34:42.670666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1010,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670184+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:42.670184+0000","last_peered":"2024-09-20T20:34:42.670184+0000","last_clean":"2024-09-20T20:34:42.670184+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:42.670184+0000","last_undegraded":"2024-09-20T20:34:42.670184+0000","last_fullsized":"2024-09-20T20:34:42.670184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":694,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670222+0000","last_change":"2024-09-20T20:34:26.688685+0000","last_active":"2024-09-20T20:34:42.670222+0000","last_peered":"2024-09-20T20:34:42.670222+0000","last_clean":"2024-09-20T20:34:42.670222+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:34:42.670222+0000","last_undegraded":"2024-09-20T20:34:42.670222+0000","last_fullsized":"2024-09-20T20:34:42.670222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:58.775508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672720+0000","last_change":"2024-09-20T20:34:38.665667+0000","last_active":"2024-09-20T20:34:42.672720+0000","last_peered":"2024-09-20T20:34:42.672720+0000","last_clean":"2024-09-20T20:34:42.672720+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:34:42.672720+0000","last_undegraded":"2024-09-20T20:34:42.672720+0000","last_fullsized":"2024-09-20T20:34:42.672720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:00:54.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1085,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672227+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:42.672227+0000","last_peered":"2024-09-20T20:34:42.672227+0000","last_clean":"2024-09-20T20:34:42.672227+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:42.672227+0000","last_undegraded":"2024-09-20T20:34:42.672227+0000","last_fullsized":"2024-09-20T20:34:42.672227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:09.827160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":628,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643749+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:42.643749+0000","last_peered":"2024-09-20T20:34:42.643749+0000","last_clean":"2024-09-20T20:34:42.643749+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:42.643749+0000","last_undegraded":"2024-09-20T20:34:42.643749+0000","last_fullsized":"2024-09-20T20:34:42.643749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:28.155473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":935,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671857+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:42.671857+0000","last_peered":"2024-09-20T20:34:42.671857+0000","last_clean":"2024-09-20T20:34:42.671857+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:42.671857+0000","last_undegraded":"2024-09-20T20:34:42.671857+0000","last_fullsized":"2024-09-20T20:34:42.671857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:43.524511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671485+0000","last_change":"2024-09-20T20:29:54.997796+0000","last_active":"2024-09-20T20:34:42.671485+0000","last_peered":"2024-09-20T20:34:42.671485+0000","last_clean":"2024-09-20T20:34:42.671485+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:34:42.671485+0000","last_undegraded":"2024-09-20T20:34:42.671485+0000","last_fullsized":"2024-09-20T20:34:42.671485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:57.071570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1021,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671161+0000","last_change":"2024-09-20T20:34:40.670826+0000","last_active":"2024-09-20T20:34:42.671161+0000","last_peered":"2024-09-20T20:34:42.671161+0000","last_clean":"2024-09-20T20:34:42.671161+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:34:42.671161+0000","last_undegraded":"2024-09-20T20:34:42.671161+0000","last_fullsized":"2024-09-20T20:34:42.671161+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:58.351454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":620,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670205+0000","last_change":"2024-09-20T20:29:54.999237+0000","last_active":"2024-09-20T20:34:42.670205+0000","last_peered":"2024-09-20T20:34:42.670205+0000","last_clean":"2024-09-20T20:34:42.670205+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:42.670205+0000","last_undegraded":"2024-09-20T20:34:42.670205+0000","last_fullsized":"2024-09-20T20:34:42.670205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:18:39.640265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.648962+0000","last_change":"2024-09-20T20:34:42.648962+0000","last_active":"2024-09-20T20:34:42.648962+0000","last_peered":"2024-09-20T20:34:42.648962+0000","last_clean":"2024-09-20T20:34:42.648962+0000","last_became_active":"2024-09-20T20:34:42.644350+0000","last_became_peered":"2024-09-20T20:34:42.644350+0000","last_unstale":"2024-09-20T20:34:42.648962+0000","last_undegraded":"2024-09-20T20:34:42.648962+0000","last_fullsized":"2024-09-20T20:34:42.648962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:04.662945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":497,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:26.704039+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:02.817476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":567,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641959+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:42.641959+0000","last_peered":"2024-09-20T20:34:42.641959+0000","last_clean":"2024-09-20T20:34:42.641959+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:42.641959+0000","last_undegraded":"2024-09-20T20:34:42.641959+0000","last_fullsized":"2024-09-20T20:34:42.641959+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:12:35.279339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":535,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671908+0000","last_change":"2024-09-20T20:34:26.698138+0000","last_active":"2024-09-20T20:34:42.671908+0000","last_peered":"2024-09-20T20:34:42.671908+0000","last_clean":"2024-09-20T20:34:42.671908+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:34:42.671908+0000","last_undegraded":"2024-09-20T20:34:42.671908+0000","last_fullsized":"2024-09-20T20:34:42.671908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:24.777094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671750+0000","last_change":"2024-09-20T20:34:17.688278+0000","last_active":"2024-09-20T20:34:42.671750+0000","last_peered":"2024-09-20T20:34:42.671750+0000","last_clean":"2024-09-20T20:34:42.671750+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:42.671750+0000","last_undegraded":"2024-09-20T20:34:42.671750+0000","last_fullsized":"2024-09-20T20:34:42.671750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:22:03.614647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1003,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672857+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:42.672857+0000","last_peered":"2024-09-20T20:34:42.672857+0000","last_clean":"2024-09-20T20:34:42.672857+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:42.672857+0000","last_undegraded":"2024-09-20T20:34:42.672857+0000","last_fullsized":"2024-09-20T20:34:42.672857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670825+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:42.670825+0000","last_peered":"2024-09-20T20:34:42.670825+0000","last_clean":"2024-09-20T20:34:42.670825+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:42.670825+0000","last_undegraded":"2024-09-20T20:34:42.670825+0000","last_fullsized":"2024-09-20T20:34:42.670825+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:00:06.202668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.680079+0000","last_change":"2024-09-20T20:34:42.679159+0000","last_active":"2024-09-20T20:34:42.680079+0000","last_peered":"2024-09-20T20:34:42.680079+0000","last_clean":"2024-09-20T20:34:42.680079+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:34:42.680079+0000","last_undegraded":"2024-09-20T20:34:42.680079+0000","last_fullsized":"2024-09-20T20:34:42.680079+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:27:33.941853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641095+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:42.641095+0000","last_peered":"2024-09-20T20:34:42.641095+0000","last_clean":"2024-09-20T20:34:42.641095+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:42.641095+0000","last_undegraded":"2024-09-20T20:34:42.641095+0000","last_fullsized":"2024-09-20T20:34:42.641095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:13:48.547997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"63'139","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.644300+0000","last_change":"2024-09-20T20:34:20.799350+0000","last_active":"2024-09-20T20:34:42.644300+0000","last_peered":"2024-09-20T20:34:42.644300+0000","last_clean":"2024-09-20T20:34:42.644300+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:34:42.644300+0000","last_undegraded":"2024-09-20T20:34:42.644300+0000","last_fullsized":"2024-09-20T20:34:42.644300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:55.783708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":908,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670248+0000","last_change":"2024-09-20T20:34:25.679927+0000","last_active":"2024-09-20T20:34:42.670248+0000","last_peered":"2024-09-20T20:34:42.670248+0000","last_clean":"2024-09-20T20:34:42.670248+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:34:42.670248+0000","last_undegraded":"2024-09-20T20:34:42.670248+0000","last_fullsized":"2024-09-20T20:34:42.670248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:11.968877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":439,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672716+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:42.672716+0000","last_peered":"2024-09-20T20:34:42.672716+0000","last_clean":"2024-09-20T20:34:42.672716+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:42.672716+0000","last_undegraded":"2024-09-20T20:34:42.672716+0000","last_fullsized":"2024-09-20T20:34:42.672716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:22.579845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":553,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670493+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:42.670493+0000","last_peered":"2024-09-20T20:34:42.670493+0000","last_clean":"2024-09-20T20:34:42.670493+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:42.670493+0000","last_undegraded":"2024-09-20T20:34:42.670493+0000","last_fullsized":"2024-09-20T20:34:42.670493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:36.699340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643435+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:42.643435+0000","last_peered":"2024-09-20T20:34:42.643435+0000","last_clean":"2024-09-20T20:34:42.643435+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:42.643435+0000","last_undegraded":"2024-09-20T20:34:42.643435+0000","last_fullsized":"2024-09-20T20:34:42.643435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:15.853159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642118+0000","last_change":"2024-09-20T20:34:32.630207+0000","last_active":"2024-09-20T20:34:42.642118+0000","last_peered":"2024-09-20T20:34:42.642118+0000","last_clean":"2024-09-20T20:34:42.642118+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:42.642118+0000","last_undegraded":"2024-09-20T20:34:42.642118+0000","last_fullsized":"2024-09-20T20:34:42.642118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:21.390738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642945+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:42.642945+0000","last_peered":"2024-09-20T20:34:42.642945+0000","last_clean":"2024-09-20T20:34:42.642945+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:42.642945+0000","last_undegraded":"2024-09-20T20:34:42.642945+0000","last_fullsized":"2024-09-20T20:34:42.642945+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:44.937193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671371+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:42.671371+0000","last_peered":"2024-09-20T20:34:42.671371+0000","last_clean":"2024-09-20T20:34:42.671371+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:42.671371+0000","last_undegraded":"2024-09-20T20:34:42.671371+0000","last_fullsized":"2024-09-20T20:34:42.671371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"63'195","reported_seq":377,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672768+0000","last_change":"2024-09-20T20:34:20.831119+0000","last_active":"2024-09-20T20:34:42.672768+0000","last_peered":"2024-09-20T20:34:42.672768+0000","last_clean":"2024-09-20T20:34:42.672768+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:34:42.672768+0000","last_undegraded":"2024-09-20T20:34:42.672768+0000","last_fullsized":"2024-09-20T20:34:42.672768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:20:23.773898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643508+0000","last_change":"2024-09-20T20:34:22.625482+0000","last_active":"2024-09-20T20:34:42.643508+0000","last_peered":"2024-09-20T20:34:42.643508+0000","last_clean":"2024-09-20T20:34:42.643508+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:42.643508+0000","last_undegraded":"2024-09-20T20:34:42.643508+0000","last_fullsized":"2024-09-20T20:34:42.643508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:34:02.346819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"63'136","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641377+0000","last_change":"2024-09-20T20:34:20.798813+0000","last_active":"2024-09-20T20:34:42.641377+0000","last_peered":"2024-09-20T20:34:42.641377+0000","last_clean":"2024-09-20T20:34:42.641377+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:34:42.641377+0000","last_undegraded":"2024-09-20T20:34:42.641377+0000","last_fullsized":"2024-09-20T20:34:42.641377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:03:35.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643266+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:42.643266+0000","last_peered":"2024-09-20T20:34:42.643266+0000","last_clean":"2024-09-20T20:34:42.643266+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:42.643266+0000","last_undegraded":"2024-09-20T20:34:42.643266+0000","last_fullsized":"2024-09-20T20:34:42.643266+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:26.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671097+0000","last_change":"2024-09-20T20:34:26.697577+0000","last_active":"2024-09-20T20:34:42.671097+0000","last_peered":"2024-09-20T20:34:42.671097+0000","last_clean":"2024-09-20T20:34:42.671097+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:34:42.671097+0000","last_undegraded":"2024-09-20T20:34:42.671097+0000","last_fullsized":"2024-09-20T20:34:42.671097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:49:49.447567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":605,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643737+0000","last_change":"2024-09-20T20:34:23.630078+0000","last_active":"2024-09-20T20:34:42.643737+0000","last_peered":"2024-09-20T20:34:42.643737+0000","last_clean":"2024-09-20T20:34:42.643737+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:34:42.643737+0000","last_undegraded":"2024-09-20T20:34:42.643737+0000","last_fullsized":"2024-09-20T20:34:42.643737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:52.272765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":649,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670459+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:42.670459+0000","last_peered":"2024-09-20T20:34:42.670459+0000","last_clean":"2024-09-20T20:34:42.670459+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:42.670459+0000","last_undegraded":"2024-09-20T20:34:42.670459+0000","last_fullsized":"2024-09-20T20:34:42.670459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:50:17.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":597,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672394+0000","last_change":"2024-09-20T20:29:55.012056+0000","last_active":"2024-09-20T20:34:42.672394+0000","last_peered":"2024-09-20T20:34:42.672394+0000","last_clean":"2024-09-20T20:34:42.672394+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:42.672394+0000","last_undegraded":"2024-09-20T20:34:42.672394+0000","last_fullsized":"2024-09-20T20:34:42.672394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:42:44.531106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":353,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640514+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:42.640514+0000","last_peered":"2024-09-20T20:34:42.640514+0000","last_clean":"2024-09-20T20:34:42.640514+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:42.640514+0000","last_undegraded":"2024-09-20T20:34:42.640514+0000","last_fullsized":"2024-09-20T20:34:42.640514+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:16.388541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":93,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641106+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:42.641106+0000","last_peered":"2024-09-20T20:34:42.641106+0000","last_clean":"2024-09-20T20:34:42.641106+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:42.641106+0000","last_undegraded":"2024-09-20T20:34:42.641106+0000","last_fullsized":"2024-09-20T20:34:42.641106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:08:20.599884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":728,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672067+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:42.672067+0000","last_peered":"2024-09-20T20:34:42.672067+0000","last_clean":"2024-09-20T20:34:42.672067+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:42.672067+0000","last_undegraded":"2024-09-20T20:34:42.672067+0000","last_fullsized":"2024-09-20T20:34:42.672067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:08.558938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643546+0000","last_change":"2024-09-20T20:34:33.628780+0000","last_active":"2024-09-20T20:34:42.643546+0000","last_peered":"2024-09-20T20:34:42.643546+0000","last_clean":"2024-09-20T20:34:42.643546+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:42.643546+0000","last_undegraded":"2024-09-20T20:34:42.643546+0000","last_fullsized":"2024-09-20T20:34:42.643546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:45.381752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641946+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:42.641946+0000","last_peered":"2024-09-20T20:34:42.641946+0000","last_clean":"2024-09-20T20:34:42.641946+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:42.641946+0000","last_undegraded":"2024-09-20T20:34:42.641946+0000","last_fullsized":"2024-09-20T20:34:42.641946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:26:07.249331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"63'127","reported_seq":372,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670895+0000","last_change":"2024-09-20T20:34:17.769100+0000","last_active":"2024-09-20T20:34:42.670895+0000","last_peered":"2024-09-20T20:34:42.670895+0000","last_clean":"2024-09-20T20:34:42.670895+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:34:42.670895+0000","last_undegraded":"2024-09-20T20:34:42.670895+0000","last_fullsized":"2024-09-20T20:34:42.670895+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:41.059892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672614+0000","last_change":"2024-09-20T20:34:26.695290+0000","last_active":"2024-09-20T20:34:42.672614+0000","last_peered":"2024-09-20T20:34:42.672614+0000","last_clean":"2024-09-20T20:34:42.672614+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:34:42.672614+0000","last_undegraded":"2024-09-20T20:34:42.672614+0000","last_fullsized":"2024-09-20T20:34:42.672614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:55.467666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671256+0000","last_change":"2024-09-20T20:29:51.831509+0000","last_active":"2024-09-20T20:34:42.671256+0000","last_peered":"2024-09-20T20:34:42.671256+0000","last_clean":"2024-09-20T20:34:42.671256+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:34:42.671256+0000","last_undegraded":"2024-09-20T20:34:42.671256+0000","last_fullsized":"2024-09-20T20:34:42.671256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:37.380542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"63'322","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670548+0000","last_change":"2024-09-20T20:34:26.687819+0000","last_active":"2024-09-20T20:34:42.670548+0000","last_peered":"2024-09-20T20:34:42.670548+0000","last_clean":"2024-09-20T20:34:42.670548+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:34:42.670548+0000","last_undegraded":"2024-09-20T20:34:42.670548+0000","last_fullsized":"2024-09-20T20:34:42.670548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:04.769102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672623+0000","last_change":"2024-09-20T20:29:55.015008+0000","last_active":"2024-09-20T20:34:42.672623+0000","last_peered":"2024-09-20T20:34:42.672623+0000","last_clean":"2024-09-20T20:34:42.672623+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:42.672623+0000","last_undegraded":"2024-09-20T20:34:42.672623+0000","last_fullsized":"2024-09-20T20:34:42.672623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:34.056198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640901+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:42.640901+0000","last_peered":"2024-09-20T20:34:42.640901+0000","last_clean":"2024-09-20T20:34:42.640901+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:42.640901+0000","last_undegraded":"2024-09-20T20:34:42.640901+0000","last_fullsized":"2024-09-20T20:34:42.640901+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:18:21.673964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641845+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:42.641845+0000","last_peered":"2024-09-20T20:34:42.641845+0000","last_clean":"2024-09-20T20:34:42.641845+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:42.641845+0000","last_undegraded":"2024-09-20T20:34:42.641845+0000","last_fullsized":"2024-09-20T20:34:42.641845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:00.572120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":607,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672046+0000","last_change":"2024-09-20T20:29:54.998014+0000","last_active":"2024-09-20T20:34:42.672046+0000","last_peered":"2024-09-20T20:34:42.672046+0000","last_clean":"2024-09-20T20:34:42.672046+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:34:42.672046+0000","last_undegraded":"2024-09-20T20:34:42.672046+0000","last_fullsized":"2024-09-20T20:34:42.672046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:46:51.752026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"63'264","reported_seq":327,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642890+0000","last_change":"2024-09-20T20:34:20.796764+0000","last_active":"2024-09-20T20:34:42.642890+0000","last_peered":"2024-09-20T20:34:42.642890+0000","last_clean":"2024-09-20T20:34:42.642890+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:34:42.642890+0000","last_undegraded":"2024-09-20T20:34:42.642890+0000","last_fullsized":"2024-09-20T20:34:42.642890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:09:17.560599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672338+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:42.672338+0000","last_peered":"2024-09-20T20:34:42.672338+0000","last_clean":"2024-09-20T20:34:42.672338+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:42.672338+0000","last_undegraded":"2024-09-20T20:34:42.672338+0000","last_fullsized":"2024-09-20T20:34:42.672338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:57:23.311114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":842,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670969+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:42.670969+0000","last_peered":"2024-09-20T20:34:42.670969+0000","last_clean":"2024-09-20T20:34:42.670969+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:42.670969+0000","last_undegraded":"2024-09-20T20:34:42.670969+0000","last_fullsized":"2024-09-20T20:34:42.670969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:40:10.807389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672097+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:42.672097+0000","last_peered":"2024-09-20T20:34:42.672097+0000","last_clean":"2024-09-20T20:34:42.672097+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:42.672097+0000","last_undegraded":"2024-09-20T20:34:42.672097+0000","last_fullsized":"2024-09-20T20:34:42.672097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:25:51.945817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672545+0000","last_change":"2024-09-20T20:34:26.692452+0000","last_active":"2024-09-20T20:34:42.672545+0000","last_peered":"2024-09-20T20:34:42.672545+0000","last_clean":"2024-09-20T20:34:42.672545+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:42.672545+0000","last_undegraded":"2024-09-20T20:34:42.672545+0000","last_fullsized":"2024-09-20T20:34:42.672545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:21:59.453939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":898,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671061+0000","last_change":"2024-09-20T20:34:22.656084+0000","last_active":"2024-09-20T20:34:42.671061+0000","last_peered":"2024-09-20T20:34:42.671061+0000","last_clean":"2024-09-20T20:34:42.671061+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:34:42.671061+0000","last_undegraded":"2024-09-20T20:34:42.671061+0000","last_fullsized":"2024-09-20T20:34:42.671061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:39.720134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673319+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:42.673319+0000","last_peered":"2024-09-20T20:34:42.673319+0000","last_clean":"2024-09-20T20:34:42.673319+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:42.673319+0000","last_undegraded":"2024-09-20T20:34:42.673319+0000","last_fullsized":"2024-09-20T20:34:42.673319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:14.624919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672991+0000","last_change":"2024-09-20T20:29:51.831917+0000","last_active":"2024-09-20T20:34:42.672991+0000","last_peered":"2024-09-20T20:34:42.672991+0000","last_clean":"2024-09-20T20:34:42.672991+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:34:42.672991+0000","last_undegraded":"2024-09-20T20:34:42.672991+0000","last_fullsized":"2024-09-20T20:34:42.672991+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:44.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1061,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670650+0000","last_change":"2024-09-20T20:34:41.673197+0000","last_active":"2024-09-20T20:34:42.670650+0000","last_peered":"2024-09-20T20:34:42.670650+0000","last_clean":"2024-09-20T20:34:42.670650+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:34:42.670650+0000","last_undegraded":"2024-09-20T20:34:42.670650+0000","last_fullsized":"2024-09-20T20:34:42.670650+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"63'118","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672875+0000","last_change":"2024-09-20T20:34:17.740461+0000","last_active":"2024-09-20T20:34:42.672875+0000","last_peered":"2024-09-20T20:34:42.672875+0000","last_clean":"2024-09-20T20:34:42.672875+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:34:42.672875+0000","last_undegraded":"2024-09-20T20:34:42.672875+0000","last_fullsized":"2024-09-20T20:34:42.672875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:54.464470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643828+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:42.643828+0000","last_peered":"2024-09-20T20:34:42.643828+0000","last_clean":"2024-09-20T20:34:42.643828+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:42.643828+0000","last_undegraded":"2024-09-20T20:34:42.643828+0000","last_fullsized":"2024-09-20T20:34:42.643828+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:48.707820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670502+0000","last_change":"2024-09-20T20:34:24.663273+0000","last_active":"2024-09-20T20:34:42.670502+0000","last_peered":"2024-09-20T20:34:42.670502+0000","last_clean":"2024-09-20T20:34:42.670502+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:34:42.670502+0000","last_undegraded":"2024-09-20T20:34:42.670502+0000","last_fullsized":"2024-09-20T20:34:42.670502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:24.428070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":574,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642465+0000","last_change":"2024-09-20T20:34:26.667252+0000","last_active":"2024-09-20T20:34:42.642465+0000","last_peered":"2024-09-20T20:34:42.642465+0000","last_clean":"2024-09-20T20:34:42.642465+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:34:42.642465+0000","last_undegraded":"2024-09-20T20:34:42.642465+0000","last_fullsized":"2024-09-20T20:34:42.642465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:18:08.695268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"65'270","reported_seq":437,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642608+0000","last_change":"2024-09-20T20:34:20.798571+0000","last_active":"2024-09-20T20:34:42.642608+0000","last_peered":"2024-09-20T20:34:42.642608+0000","last_clean":"2024-09-20T20:34:42.642608+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:34:42.642608+0000","last_undegraded":"2024-09-20T20:34:42.642608+0000","last_fullsized":"2024-09-20T20:34:42.642608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:31.928952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":591,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670675+0000","last_change":"2024-09-20T20:29:54.998049+0000","last_active":"2024-09-20T20:34:42.670675+0000","last_peered":"2024-09-20T20:34:42.670675+0000","last_clean":"2024-09-20T20:34:42.670675+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:34:42.670675+0000","last_undegraded":"2024-09-20T20:34:42.670675+0000","last_fullsized":"2024-09-20T20:34:42.670675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:20.482070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"63'89","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672453+0000","last_change":"2024-09-20T20:34:17.744593+0000","last_active":"2024-09-20T20:34:42.672453+0000","last_peered":"2024-09-20T20:34:42.672453+0000","last_clean":"2024-09-20T20:34:42.672453+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:34:42.672453+0000","last_undegraded":"2024-09-20T20:34:42.672453+0000","last_fullsized":"2024-09-20T20:34:42.672453+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:23:07.509298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643594+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:42.643594+0000","last_peered":"2024-09-20T20:34:42.643594+0000","last_clean":"2024-09-20T20:34:42.643594+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:42.643594+0000","last_undegraded":"2024-09-20T20:34:42.643594+0000","last_fullsized":"2024-09-20T20:34:42.643594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:45.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1088,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670557+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:42.670557+0000","last_peered":"2024-09-20T20:34:42.670557+0000","last_clean":"2024-09-20T20:34:42.670557+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:42.670557+0000","last_undegraded":"2024-09-20T20:34:42.670557+0000","last_fullsized":"2024-09-20T20:34:42.670557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:04.984726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673245+0000","last_change":"2024-09-20T20:34:17.690212+0000","last_active":"2024-09-20T20:34:42.673245+0000","last_peered":"2024-09-20T20:34:42.673245+0000","last_clean":"2024-09-20T20:34:42.673245+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:34:42.673245+0000","last_undegraded":"2024-09-20T20:34:42.673245+0000","last_fullsized":"2024-09-20T20:34:42.673245+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":676,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670536+0000","last_change":"2024-09-20T20:29:54.999108+0000","last_active":"2024-09-20T20:34:42.670536+0000","last_peered":"2024-09-20T20:34:42.670536+0000","last_clean":"2024-09-20T20:34:42.670536+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:34:42.670536+0000","last_undegraded":"2024-09-20T20:34:42.670536+0000","last_fullsized":"2024-09-20T20:34:42.670536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:15.220122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":846,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672855+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:42.672855+0000","last_peered":"2024-09-20T20:34:42.672855+0000","last_clean":"2024-09-20T20:34:42.672855+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:42.672855+0000","last_undegraded":"2024-09-20T20:34:42.672855+0000","last_fullsized":"2024-09-20T20:34:42.672855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:10:24.045674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":867,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671086+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:42.671086+0000","last_peered":"2024-09-20T20:34:42.671086+0000","last_clean":"2024-09-20T20:34:42.671086+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:42.671086+0000","last_undegraded":"2024-09-20T20:34:42.671086+0000","last_fullsized":"2024-09-20T20:34:42.671086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:34.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672283+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:42.672283+0000","last_peered":"2024-09-20T20:34:42.672283+0000","last_clean":"2024-09-20T20:34:42.672283+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:42.672283+0000","last_undegraded":"2024-09-20T20:34:42.672283+0000","last_fullsized":"2024-09-20T20:34:42.672283+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:50:49.781497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"63'183","reported_seq":365,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671060+0000","last_change":"2024-09-20T20:34:20.834182+0000","last_active":"2024-09-20T20:34:42.671060+0000","last_peered":"2024-09-20T20:34:42.671060+0000","last_clean":"2024-09-20T20:34:42.671060+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:34:42.671060+0000","last_undegraded":"2024-09-20T20:34:42.671060+0000","last_fullsized":"2024-09-20T20:34:42.671060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:05.225002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":965,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671738+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:42.671738+0000","last_peered":"2024-09-20T20:34:42.671738+0000","last_clean":"2024-09-20T20:34:42.671738+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:42.671738+0000","last_undegraded":"2024-09-20T20:34:42.671738+0000","last_fullsized":"2024-09-20T20:34:42.671738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:28:02.575057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"63'236","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671260+0000","last_change":"2024-09-20T20:34:26.693641+0000","last_active":"2024-09-20T20:34:42.671260+0000","last_peered":"2024-09-20T20:34:42.671260+0000","last_clean":"2024-09-20T20:34:42.671260+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:42.671260+0000","last_undegraded":"2024-09-20T20:34:42.671260+0000","last_fullsized":"2024-09-20T20:34:42.671260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:37:18.824843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":538,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671557+0000","last_change":"2024-09-20T20:34:26.702226+0000","last_active":"2024-09-20T20:34:42.671557+0000","last_peered":"2024-09-20T20:34:42.671557+0000","last_clean":"2024-09-20T20:34:42.671557+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:42.671557+0000","last_undegraded":"2024-09-20T20:34:42.671557+0000","last_fullsized":"2024-09-20T20:34:42.671557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:47:46.546170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671334+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:42.671334+0000","last_peered":"2024-09-20T20:34:42.671334+0000","last_clean":"2024-09-20T20:34:42.671334+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:42.671334+0000","last_undegraded":"2024-09-20T20:34:42.671334+0000","last_fullsized":"2024-09-20T20:34:42.671334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:02:44.393562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642236+0000","last_change":"2024-09-20T20:34:31.639373+0000","last_active":"2024-09-20T20:34:42.642236+0000","last_peered":"2024-09-20T20:34:42.642236+0000","last_clean":"2024-09-20T20:34:42.642236+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:42.642236+0000","last_undegraded":"2024-09-20T20:34:42.642236+0000","last_fullsized":"2024-09-20T20:34:42.642236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:41:06.238905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"63'199","reported_seq":370,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642667+0000","last_change":"2024-09-20T20:34:20.796743+0000","last_active":"2024-09-20T20:34:42.642667+0000","last_peered":"2024-09-20T20:34:42.642667+0000","last_clean":"2024-09-20T20:34:42.642667+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:34:42.642667+0000","last_undegraded":"2024-09-20T20:34:42.642667+0000","last_fullsized":"2024-09-20T20:34:42.642667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:30:19.044814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641490+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:42.641490+0000","last_peered":"2024-09-20T20:34:42.641490+0000","last_clean":"2024-09-20T20:34:42.641490+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:42.641490+0000","last_undegraded":"2024-09-20T20:34:42.641490+0000","last_fullsized":"2024-09-20T20:34:42.641490+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:35.763189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"63'271","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672043+0000","last_change":"2024-09-20T20:34:20.834224+0000","last_active":"2024-09-20T20:34:42.672043+0000","last_peered":"2024-09-20T20:34:42.672043+0000","last_clean":"2024-09-20T20:34:42.672043+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:34:42.672043+0000","last_undegraded":"2024-09-20T20:34:42.672043+0000","last_fullsized":"2024-09-20T20:34:42.672043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:00:17.992837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671503+0000","last_change":"2024-09-20T20:34:26.700612+0000","last_active":"2024-09-20T20:34:42.671503+0000","last_peered":"2024-09-20T20:34:42.671503+0000","last_clean":"2024-09-20T20:34:42.671503+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:34:42.671503+0000","last_undegraded":"2024-09-20T20:34:42.671503+0000","last_fullsized":"2024-09-20T20:34:42.671503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:54:56.575391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672549+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:42.672549+0000","last_peered":"2024-09-20T20:34:42.672549+0000","last_clean":"2024-09-20T20:34:42.672549+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:42.672549+0000","last_undegraded":"2024-09-20T20:34:42.672549+0000","last_fullsized":"2024-09-20T20:34:42.672549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:15:52.757551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642073+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:42.642073+0000","last_peered":"2024-09-20T20:34:42.642073+0000","last_clean":"2024-09-20T20:34:42.642073+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:42.642073+0000","last_undegraded":"2024-09-20T20:34:42.642073+0000","last_fullsized":"2024-09-20T20:34:42.642073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:02:59.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"63'56","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672824+0000","last_change":"2024-09-20T20:34:17.680199+0000","last_active":"2024-09-20T20:34:42.672824+0000","last_peered":"2024-09-20T20:34:42.672824+0000","last_clean":"2024-09-20T20:34:42.672824+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:42.672824+0000","last_undegraded":"2024-09-20T20:34:42.672824+0000","last_fullsized":"2024-09-20T20:34:42.672824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:20.688168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6675,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6367,"ondisk_log_size":6367,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99328,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272512,"statfs":{"total":96636764160,"available":96535052288,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738435,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104360,"kb_used_data":28816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267480,"statfs":{"total":96636764160,"available":96529899520,"internally_reserved":0,"allocated":29507584,"data_stored":85109907,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57324,"kb_used_data":23640,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94314516,"statfs":{"total":96636764160,"available":96578064384,"internally_reserved":0,"allocated":24207360,"data_stored":90774901,"data_compressed":13901890,"data_compressed_allocated":16965632,"data_compressed_original":84058112,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:34:54.959 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.960 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.960 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.960 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.960 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.960 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.960 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.960 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.961 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.962 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.963 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.964 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.965 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-20T20:29:43.686824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=43, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.966 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.967 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.968 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.969 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.970 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.971 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.971 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.971 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.971 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.971 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:34:54.971 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-20T20:35:14.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:35:15.297 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:35:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:35:15.316 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-09-20T20:35:13.733831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6689,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33216,"ondisk_log_size":33216,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":260996,"kb_used_data":80404,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282854524,"statfs":{"total":289910292480,"available":289643032576,"internally_reserved":0,"allocated":82333696,"data_stored":257450488,"data_compressed":37624865,"data_compressed_allocated":48259072,"data_compressed_original":224894976,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004354"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":642,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.620529+0000","last_change":"2024-09-20T20:35:03.620586+0000","last_active":"2024-09-20T20:35:03.620529+0000","last_peered":"2024-09-20T20:35:03.620529+0000","last_clean":"2024-09-20T20:35:03.620529+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:35:03.620529+0000","last_undegraded":"2024-09-20T20:35:03.620529+0000","last_fullsized":"2024-09-20T20:35:03.620529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'451","last_scrub_stamp":"2024-09-20T20:35:03.620336+0000","last_deep_scrub":"63'451","last_deep_scrub_stamp":"2024-09-20T20:35:03.620336+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.620336+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:44.363780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":670,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672181+0000","last_change":"2024-09-20T20:29:55.010555+0000","last_active":"2024-09-20T20:34:42.672181+0000","last_peered":"2024-09-20T20:34:42.672181+0000","last_clean":"2024-09-20T20:34:42.672181+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:34:42.672181+0000","last_undegraded":"2024-09-20T20:34:42.672181+0000","last_fullsized":"2024-09-20T20:34:42.672181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.644065+0000","last_change":"2024-09-20T20:34:28.630632+0000","last_active":"2024-09-20T20:34:42.644065+0000","last_peered":"2024-09-20T20:34:42.644065+0000","last_clean":"2024-09-20T20:34:42.644065+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:34:42.644065+0000","last_undegraded":"2024-09-20T20:34:42.644065+0000","last_fullsized":"2024-09-20T20:34:42.644065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":564,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643037+0000","last_change":"2024-09-20T20:34:29.628384+0000","last_active":"2024-09-20T20:34:42.643037+0000","last_peered":"2024-09-20T20:34:42.643037+0000","last_clean":"2024-09-20T20:34:42.643037+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:34:42.643037+0000","last_undegraded":"2024-09-20T20:34:42.643037+0000","last_fullsized":"2024-09-20T20:34:42.643037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":528,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.524666+0000","last_change":"2024-09-20T20:34:58.524725+0000","last_active":"2024-09-20T20:34:58.524666+0000","last_peered":"2024-09-20T20:34:58.524666+0000","last_clean":"2024-09-20T20:34:58.524666+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:58.524666+0000","last_undegraded":"2024-09-20T20:34:58.524666+0000","last_fullsized":"2024-09-20T20:34:58.524666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'413","last_scrub_stamp":"2024-09-20T20:34:58.524458+0000","last_deep_scrub":"63'413","last_deep_scrub_stamp":"2024-09-20T20:34:58.524458+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.524458+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:39.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":590,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.831717+0000","last_change":"2024-09-20T20:34:56.831778+0000","last_active":"2024-09-20T20:34:56.831717+0000","last_peered":"2024-09-20T20:34:56.831717+0000","last_clean":"2024-09-20T20:34:56.831717+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:56.831717+0000","last_undegraded":"2024-09-20T20:34:56.831717+0000","last_fullsized":"2024-09-20T20:34:56.831717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'387","last_scrub_stamp":"2024-09-20T20:34:56.831519+0000","last_deep_scrub":"63'387","last_deep_scrub_stamp":"2024-09-20T20:34:56.831519+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.831519+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:35.128128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":627,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641610+0000","last_change":"2024-09-20T20:34:27.628943+0000","last_active":"2024-09-20T20:34:42.641610+0000","last_peered":"2024-09-20T20:34:42.641610+0000","last_clean":"2024-09-20T20:34:42.641610+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:34:42.641610+0000","last_undegraded":"2024-09-20T20:34:42.641610+0000","last_fullsized":"2024-09-20T20:34:42.641610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641933+0000","last_change":"2024-09-20T20:34:41.640769+0000","last_active":"2024-09-20T20:34:42.641933+0000","last_peered":"2024-09-20T20:34:42.641933+0000","last_clean":"2024-09-20T20:34:42.641933+0000","last_became_active":"2024-09-20T20:34:41.636093+0000","last_became_peered":"2024-09-20T20:34:41.636093+0000","last_unstale":"2024-09-20T20:34:42.641933+0000","last_undegraded":"2024-09-20T20:34:42.641933+0000","last_fullsized":"2024-09-20T20:34:42.641933+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.787487+0000","last_change":"2024-09-20T20:35:09.787632+0000","last_active":"2024-09-20T20:35:09.787487+0000","last_peered":"2024-09-20T20:35:09.787487+0000","last_clean":"2024-09-20T20:35:09.787487+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:35:09.787487+0000","last_undegraded":"2024-09-20T20:35:09.787487+0000","last_fullsized":"2024-09-20T20:35:09.787487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'414","last_scrub_stamp":"2024-09-20T20:35:09.787259+0000","last_deep_scrub":"63'414","last_deep_scrub_stamp":"2024-09-20T20:35:09.787259+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.787259+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:26:21.110972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":574,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:47.736776+0000","last_change":"2024-09-20T20:29:55.010232+0000","last_active":"2024-09-20T20:34:47.736776+0000","last_peered":"2024-09-20T20:34:47.736776+0000","last_clean":"2024-09-20T20:34:47.736776+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:34:47.736776+0000","last_undegraded":"2024-09-20T20:34:47.736776+0000","last_fullsized":"2024-09-20T20:34:47.736776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.871773+0000","last_change":"2024-09-20T20:35:05.871834+0000","last_active":"2024-09-20T20:35:05.871773+0000","last_peered":"2024-09-20T20:35:05.871773+0000","last_clean":"2024-09-20T20:35:05.871773+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:35:05.871773+0000","last_undegraded":"2024-09-20T20:35:05.871773+0000","last_fullsized":"2024-09-20T20:35:05.871773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'367","last_scrub_stamp":"2024-09-20T20:35:05.871579+0000","last_deep_scrub":"63'367","last_deep_scrub_stamp":"2024-09-20T20:35:05.871579+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.871579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:13.777294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":827,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.438828+0000","last_change":"2024-09-20T20:34:54.438886+0000","last_active":"2024-09-20T20:34:54.438828+0000","last_peered":"2024-09-20T20:34:54.438828+0000","last_clean":"2024-09-20T20:34:54.438828+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:54.438828+0000","last_undegraded":"2024-09-20T20:34:54.438828+0000","last_fullsized":"2024-09-20T20:34:54.438828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'358","last_scrub_stamp":"2024-09-20T20:34:54.438632+0000","last_deep_scrub":"63'358","last_deep_scrub_stamp":"2024-09-20T20:34:54.438632+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.438632+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:56.379760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.608986+0000","last_change":"2024-09-20T20:35:09.609047+0000","last_active":"2024-09-20T20:35:09.608986+0000","last_peered":"2024-09-20T20:35:09.608986+0000","last_clean":"2024-09-20T20:35:09.608986+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:35:09.608986+0000","last_undegraded":"2024-09-20T20:35:09.608986+0000","last_fullsized":"2024-09-20T20:35:09.608986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'421","last_scrub_stamp":"2024-09-20T20:35:09.608780+0000","last_deep_scrub":"63'421","last_deep_scrub_stamp":"2024-09-20T20:35:09.608780+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.608780+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:29.678874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.846395+0000","last_change":"2024-09-20T20:34:54.846453+0000","last_active":"2024-09-20T20:34:54.846395+0000","last_peered":"2024-09-20T20:34:54.846395+0000","last_clean":"2024-09-20T20:34:54.846395+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:54.846395+0000","last_undegraded":"2024-09-20T20:34:54.846395+0000","last_fullsized":"2024-09-20T20:34:54.846395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'420","last_scrub_stamp":"2024-09-20T20:34:54.846176+0000","last_deep_scrub":"63'420","last_deep_scrub_stamp":"2024-09-20T20:34:54.846176+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.846176+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:49:14.810187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":707,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.844934+0000","last_change":"2024-09-20T20:34:58.844995+0000","last_active":"2024-09-20T20:34:58.844934+0000","last_peered":"2024-09-20T20:34:58.844934+0000","last_clean":"2024-09-20T20:34:58.844934+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:58.844934+0000","last_undegraded":"2024-09-20T20:34:58.844934+0000","last_fullsized":"2024-09-20T20:34:58.844934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-09-20T20:34:58.844737+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-09-20T20:34:58.844737+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.844737+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:13.120956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":617,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642293+0000","last_change":"2024-09-20T20:34:38.627999+0000","last_active":"2024-09-20T20:34:42.642293+0000","last_peered":"2024-09-20T20:34:42.642293+0000","last_clean":"2024-09-20T20:34:42.642293+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:34:42.642293+0000","last_undegraded":"2024-09-20T20:34:42.642293+0000","last_fullsized":"2024-09-20T20:34:42.642293+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.888686+0000","last_change":"2024-09-20T20:34:54.888803+0000","last_active":"2024-09-20T20:34:54.888686+0000","last_peered":"2024-09-20T20:34:54.888686+0000","last_clean":"2024-09-20T20:34:54.888686+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:54.888686+0000","last_undegraded":"2024-09-20T20:34:54.888686+0000","last_fullsized":"2024-09-20T20:34:54.888686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'419","last_scrub_stamp":"2024-09-20T20:34:54.888376+0000","last_deep_scrub":"63'419","last_deep_scrub_stamp":"2024-09-20T20:34:54.888376+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.888376+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:52.642419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":634,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672515+0000","last_change":"2024-09-20T20:29:55.003569+0000","last_active":"2024-09-20T20:34:42.672515+0000","last_peered":"2024-09-20T20:34:42.672515+0000","last_clean":"2024-09-20T20:34:42.672515+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:34:42.672515+0000","last_undegraded":"2024-09-20T20:34:42.672515+0000","last_fullsized":"2024-09-20T20:34:42.672515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":647,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671509+0000","last_change":"2024-09-20T20:30:59.449416+0000","last_active":"2024-09-20T20:34:42.671509+0000","last_peered":"2024-09-20T20:34:42.671509+0000","last_clean":"2024-09-20T20:34:42.671509+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:34:42.671509+0000","last_undegraded":"2024-09-20T20:34:42.671509+0000","last_fullsized":"2024-09-20T20:34:42.671509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.885617+0000","last_change":"2024-09-20T20:35:07.885674+0000","last_active":"2024-09-20T20:35:07.885617+0000","last_peered":"2024-09-20T20:35:07.885617+0000","last_clean":"2024-09-20T20:35:07.885617+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:35:07.885617+0000","last_undegraded":"2024-09-20T20:35:07.885617+0000","last_fullsized":"2024-09-20T20:35:07.885617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-09-20T20:35:07.885422+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-09-20T20:35:07.885422+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.885422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:06.231903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.889617+0000","last_change":"2024-09-20T20:35:03.889679+0000","last_active":"2024-09-20T20:35:03.889617+0000","last_peered":"2024-09-20T20:35:03.889617+0000","last_clean":"2024-09-20T20:35:03.889617+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:35:03.889617+0000","last_undegraded":"2024-09-20T20:35:03.889617+0000","last_fullsized":"2024-09-20T20:35:03.889617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'395","last_scrub_stamp":"2024-09-20T20:35:03.889430+0000","last_deep_scrub":"63'395","last_deep_scrub_stamp":"2024-09-20T20:35:03.889430+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.889430+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:44.178040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":967,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670820+0000","last_change":"2024-09-20T20:34:39.664844+0000","last_active":"2024-09-20T20:34:42.670820+0000","last_peered":"2024-09-20T20:34:42.670820+0000","last_clean":"2024-09-20T20:34:42.670820+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:34:42.670820+0000","last_undegraded":"2024-09-20T20:34:42.670820+0000","last_fullsized":"2024-09-20T20:34:42.670820+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1011,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670339+0000","last_change":"2024-09-20T20:34:35.661556+0000","last_active":"2024-09-20T20:34:42.670339+0000","last_peered":"2024-09-20T20:34:42.670339+0000","last_clean":"2024-09-20T20:34:42.670339+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:34:42.670339+0000","last_undegraded":"2024-09-20T20:34:42.670339+0000","last_fullsized":"2024-09-20T20:34:42.670339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":703,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.558988+0000","last_change":"2024-09-20T20:35:00.559048+0000","last_active":"2024-09-20T20:35:00.558988+0000","last_peered":"2024-09-20T20:35:00.558988+0000","last_clean":"2024-09-20T20:35:00.558988+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:35:00.558988+0000","last_undegraded":"2024-09-20T20:35:00.558988+0000","last_fullsized":"2024-09-20T20:35:00.558988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'473","last_scrub_stamp":"2024-09-20T20:35:00.558787+0000","last_deep_scrub":"63'473","last_deep_scrub_stamp":"2024-09-20T20:35:00.558787+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.558787+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:32.658097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672855+0000","last_change":"2024-09-20T20:34:38.665667+0000","last_active":"2024-09-20T20:34:42.672855+0000","last_peered":"2024-09-20T20:34:42.672855+0000","last_clean":"2024-09-20T20:34:42.672855+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:34:42.672855+0000","last_undegraded":"2024-09-20T20:34:42.672855+0000","last_fullsized":"2024-09-20T20:34:42.672855+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1086,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672367+0000","last_change":"2024-09-20T20:34:33.659796+0000","last_active":"2024-09-20T20:34:42.672367+0000","last_peered":"2024-09-20T20:34:42.672367+0000","last_clean":"2024-09-20T20:34:42.672367+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:34:42.672367+0000","last_undegraded":"2024-09-20T20:34:42.672367+0000","last_fullsized":"2024-09-20T20:34:42.672367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":629,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643822+0000","last_change":"2024-09-20T20:34:34.630196+0000","last_active":"2024-09-20T20:34:42.643822+0000","last_peered":"2024-09-20T20:34:42.643822+0000","last_clean":"2024-09-20T20:34:42.643822+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:34:42.643822+0000","last_undegraded":"2024-09-20T20:34:42.643822+0000","last_fullsized":"2024-09-20T20:34:42.643822+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":936,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671995+0000","last_change":"2024-09-20T20:34:27.659318+0000","last_active":"2024-09-20T20:34:42.671995+0000","last_peered":"2024-09-20T20:34:42.671995+0000","last_clean":"2024-09-20T20:34:42.671995+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:34:42.671995+0000","last_undegraded":"2024-09-20T20:34:42.671995+0000","last_fullsized":"2024-09-20T20:34:42.671995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":668,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.814096+0000","last_change":"2024-09-20T20:35:07.814229+0000","last_active":"2024-09-20T20:35:07.814096+0000","last_peered":"2024-09-20T20:35:07.814096+0000","last_clean":"2024-09-20T20:35:07.814096+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:35:07.814096+0000","last_undegraded":"2024-09-20T20:35:07.814096+0000","last_fullsized":"2024-09-20T20:35:07.814096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-09-20T20:35:07.813803+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-09-20T20:35:07.813803+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.813803+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:43.077510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1022,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671379+0000","last_change":"2024-09-20T20:34:40.670826+0000","last_active":"2024-09-20T20:34:42.671379+0000","last_peered":"2024-09-20T20:34:42.671379+0000","last_clean":"2024-09-20T20:34:42.671379+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:34:42.671379+0000","last_undegraded":"2024-09-20T20:34:42.671379+0000","last_fullsized":"2024-09-20T20:34:42.671379+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":629,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.801774+0000","last_change":"2024-09-20T20:34:59.801835+0000","last_active":"2024-09-20T20:34:59.801774+0000","last_peered":"2024-09-20T20:34:59.801774+0000","last_clean":"2024-09-20T20:34:59.801774+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:59.801774+0000","last_undegraded":"2024-09-20T20:34:59.801774+0000","last_fullsized":"2024-09-20T20:34:59.801774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'435","last_scrub_stamp":"2024-09-20T20:34:59.801577+0000","last_deep_scrub":"63'435","last_deep_scrub_stamp":"2024-09-20T20:34:59.801577+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.801577+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:05.024160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":569,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.649829+0000","last_change":"2024-09-20T20:34:42.648962+0000","last_active":"2024-09-20T20:34:42.649829+0000","last_peered":"2024-09-20T20:34:42.649829+0000","last_clean":"2024-09-20T20:34:42.649829+0000","last_became_active":"2024-09-20T20:34:42.644350+0000","last_became_peered":"2024-09-20T20:34:42.644350+0000","last_unstale":"2024-09-20T20:34:42.649829+0000","last_undegraded":"2024-09-20T20:34:42.649829+0000","last_fullsized":"2024-09-20T20:34:42.649829+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":506,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.453668+0000","last_change":"2024-09-20T20:34:55.453725+0000","last_active":"2024-09-20T20:34:55.453668+0000","last_peered":"2024-09-20T20:34:55.453668+0000","last_clean":"2024-09-20T20:34:55.453668+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:55.453668+0000","last_undegraded":"2024-09-20T20:34:55.453668+0000","last_fullsized":"2024-09-20T20:34:55.453668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'379","last_scrub_stamp":"2024-09-20T20:34:55.453479+0000","last_deep_scrub":"63'379","last_deep_scrub_stamp":"2024-09-20T20:34:55.453479+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.453479+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:08.044870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"62'454","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642103+0000","last_change":"2024-09-20T20:34:17.676607+0000","last_active":"2024-09-20T20:34:42.642103+0000","last_peered":"2024-09-20T20:34:42.642103+0000","last_clean":"2024-09-20T20:34:42.642103+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:34:42.642103+0000","last_undegraded":"2024-09-20T20:34:42.642103+0000","last_fullsized":"2024-09-20T20:34:42.642103+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":544,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.559888+0000","last_change":"2024-09-20T20:35:07.559949+0000","last_active":"2024-09-20T20:35:07.559888+0000","last_peered":"2024-09-20T20:35:07.559888+0000","last_clean":"2024-09-20T20:35:07.559888+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:35:07.559888+0000","last_undegraded":"2024-09-20T20:35:07.559888+0000","last_fullsized":"2024-09-20T20:35:07.559888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-09-20T20:35:07.559690+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-09-20T20:35:07.559690+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.559690+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:26:18.883403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.814543+0000","last_change":"2024-09-20T20:34:58.814606+0000","last_active":"2024-09-20T20:34:58.814543+0000","last_peered":"2024-09-20T20:34:58.814543+0000","last_clean":"2024-09-20T20:34:58.814543+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:58.814543+0000","last_undegraded":"2024-09-20T20:34:58.814543+0000","last_fullsized":"2024-09-20T20:34:58.814543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'56","last_scrub_stamp":"2024-09-20T20:34:58.814346+0000","last_deep_scrub":"63'56","last_deep_scrub_stamp":"2024-09-20T20:34:58.814346+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.814346+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:56.601755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1004,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:47.743913+0000","last_change":"2024-09-20T20:34:37.659022+0000","last_active":"2024-09-20T20:34:47.743913+0000","last_peered":"2024-09-20T20:34:47.743913+0000","last_clean":"2024-09-20T20:34:47.743913+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:34:47.743913+0000","last_undegraded":"2024-09-20T20:34:47.743913+0000","last_fullsized":"2024-09-20T20:34:47.743913+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670958+0000","last_change":"2024-09-20T20:34:17.677716+0000","last_active":"2024-09-20T20:34:42.670958+0000","last_peered":"2024-09-20T20:34:42.670958+0000","last_clean":"2024-09-20T20:34:42.670958+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:34:42.670958+0000","last_undegraded":"2024-09-20T20:34:42.670958+0000","last_fullsized":"2024-09-20T20:34:42.670958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:47.743957+0000","last_change":"2024-09-20T20:34:42.679159+0000","last_active":"2024-09-20T20:34:47.743957+0000","last_peered":"2024-09-20T20:34:47.743957+0000","last_clean":"2024-09-20T20:34:47.743957+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:34:47.743957+0000","last_undegraded":"2024-09-20T20:34:47.743957+0000","last_fullsized":"2024-09-20T20:34:47.743957+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'53","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641234+0000","last_change":"2024-09-20T20:34:17.645905+0000","last_active":"2024-09-20T20:34:42.641234+0000","last_peered":"2024-09-20T20:34:42.641234+0000","last_clean":"2024-09-20T20:34:42.641234+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:34:42.641234+0000","last_undegraded":"2024-09-20T20:34:42.641234+0000","last_fullsized":"2024-09-20T20:34:42.641234+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'141","reported_seq":228,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.935706+0000","last_change":"2024-09-20T20:35:00.935774+0000","last_active":"2024-09-20T20:35:00.935706+0000","last_peered":"2024-09-20T20:35:00.935706+0000","last_clean":"2024-09-20T20:35:00.935706+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:35:00.935706+0000","last_undegraded":"2024-09-20T20:35:00.935706+0000","last_fullsized":"2024-09-20T20:35:00.935706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'141","last_scrub_stamp":"2024-09-20T20:35:00.935520+0000","last_deep_scrub":"95'141","last_deep_scrub_stamp":"2024-09-20T20:35:00.935520+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.935520+0000","objects_scrubbed":2,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:38:04.884983+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":917,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.614980+0000","last_change":"2024-09-20T20:35:04.615157+0000","last_active":"2024-09-20T20:35:04.614980+0000","last_peered":"2024-09-20T20:35:04.614980+0000","last_clean":"2024-09-20T20:35:04.614980+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:35:04.614980+0000","last_undegraded":"2024-09-20T20:35:04.614980+0000","last_fullsized":"2024-09-20T20:35:04.614980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'398","last_scrub_stamp":"2024-09-20T20:35:04.614732+0000","last_deep_scrub":"63'398","last_deep_scrub_stamp":"2024-09-20T20:35:04.614732+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.614732+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:13.018609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"62'263","reported_seq":440,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672791+0000","last_change":"2024-09-20T20:34:17.677470+0000","last_active":"2024-09-20T20:34:42.672791+0000","last_peered":"2024-09-20T20:34:42.672791+0000","last_clean":"2024-09-20T20:34:42.672791+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:34:42.672791+0000","last_undegraded":"2024-09-20T20:34:42.672791+0000","last_fullsized":"2024-09-20T20:34:42.672791+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":554,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670674+0000","last_change":"2024-09-20T20:34:26.700699+0000","last_active":"2024-09-20T20:34:42.670674+0000","last_peered":"2024-09-20T20:34:42.670674+0000","last_clean":"2024-09-20T20:34:42.670674+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:34:42.670674+0000","last_undegraded":"2024-09-20T20:34:42.670674+0000","last_fullsized":"2024-09-20T20:34:42.670674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"63'452","reported_seq":570,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643576+0000","last_change":"2024-09-20T20:34:17.676564+0000","last_active":"2024-09-20T20:34:42.643576+0000","last_peered":"2024-09-20T20:34:42.643576+0000","last_clean":"2024-09-20T20:34:42.643576+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:34:42.643576+0000","last_undegraded":"2024-09-20T20:34:42.643576+0000","last_fullsized":"2024-09-20T20:34:42.643576+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":644,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:53.819376+0000","last_change":"2024-09-20T20:34:53.819439+0000","last_active":"2024-09-20T20:34:53.819376+0000","last_peered":"2024-09-20T20:34:53.819376+0000","last_clean":"2024-09-20T20:34:53.819376+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:53.819376+0000","last_undegraded":"2024-09-20T20:34:53.819376+0000","last_fullsized":"2024-09-20T20:34:53.819376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-09-20T20:34:53.819178+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-09-20T20:34:53.819178+0000","last_clean_scrub_stamp":"2024-09-20T20:34:53.819178+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:55.658671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643075+0000","last_change":"2024-09-20T20:34:17.674499+0000","last_active":"2024-09-20T20:34:42.643075+0000","last_peered":"2024-09-20T20:34:42.643075+0000","last_clean":"2024-09-20T20:34:42.643075+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:34:42.643075+0000","last_undegraded":"2024-09-20T20:34:42.643075+0000","last_fullsized":"2024-09-20T20:34:42.643075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1075,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671506+0000","last_change":"2024-09-20T20:34:21.836509+0000","last_active":"2024-09-20T20:34:42.671506+0000","last_peered":"2024-09-20T20:34:42.671506+0000","last_clean":"2024-09-20T20:34:42.671506+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:34:42.671506+0000","last_undegraded":"2024-09-20T20:34:42.671506+0000","last_fullsized":"2024-09-20T20:34:42.671506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"95'198","reported_seq":389,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.873232+0000","last_change":"2024-09-20T20:35:06.873412+0000","last_active":"2024-09-20T20:35:06.873232+0000","last_peered":"2024-09-20T20:35:06.873232+0000","last_clean":"2024-09-20T20:35:06.873232+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:35:06.873232+0000","last_undegraded":"2024-09-20T20:35:06.873232+0000","last_fullsized":"2024-09-20T20:35:06.873232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'198","last_scrub_stamp":"2024-09-20T20:35:06.873016+0000","last_deep_scrub":"95'198","last_deep_scrub_stamp":"2024-09-20T20:35:06.873016+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.873016+0000","objects_scrubbed":3,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:02.462362+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.889637+0000","last_change":"2024-09-20T20:34:59.889698+0000","last_active":"2024-09-20T20:34:59.889637+0000","last_peered":"2024-09-20T20:34:59.889637+0000","last_clean":"2024-09-20T20:34:59.889637+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:59.889637+0000","last_undegraded":"2024-09-20T20:34:59.889637+0000","last_fullsized":"2024-09-20T20:34:59.889637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-09-20T20:34:59.889432+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-09-20T20:34:59.889432+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.889432+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:31.749238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"95'137","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.951254+0000","last_change":"2024-09-20T20:35:02.951316+0000","last_active":"2024-09-20T20:35:02.951254+0000","last_peered":"2024-09-20T20:35:02.951254+0000","last_clean":"2024-09-20T20:35:02.951254+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:35:02.951254+0000","last_undegraded":"2024-09-20T20:35:02.951254+0000","last_fullsized":"2024-09-20T20:35:02.951254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'137","last_scrub_stamp":"2024-09-20T20:35:02.951061+0000","last_deep_scrub":"95'137","last_deep_scrub_stamp":"2024-09-20T20:35:02.951061+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.951061+0000","objects_scrubbed":1,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:41.086825+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":579,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643413+0000","last_change":"2024-09-20T20:34:35.633591+0000","last_active":"2024-09-20T20:34:42.643413+0000","last_peered":"2024-09-20T20:34:42.643413+0000","last_clean":"2024-09-20T20:34:42.643413+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:34:42.643413+0000","last_undegraded":"2024-09-20T20:34:42.643413+0000","last_fullsized":"2024-09-20T20:34:42.643413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.599787+0000","last_change":"2024-09-20T20:35:05.599849+0000","last_active":"2024-09-20T20:35:05.599787+0000","last_peered":"2024-09-20T20:35:05.599787+0000","last_clean":"2024-09-20T20:35:05.599787+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:35:05.599787+0000","last_undegraded":"2024-09-20T20:35:05.599787+0000","last_fullsized":"2024-09-20T20:35:05.599787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'51","last_scrub_stamp":"2024-09-20T20:35:05.599586+0000","last_deep_scrub":"63'51","last_deep_scrub_stamp":"2024-09-20T20:35:05.599586+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.599586+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:53.756207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.965721+0000","last_change":"2024-09-20T20:35:01.965786+0000","last_active":"2024-09-20T20:35:01.965721+0000","last_peered":"2024-09-20T20:35:01.965721+0000","last_clean":"2024-09-20T20:35:01.965721+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:35:01.965721+0000","last_undegraded":"2024-09-20T20:35:01.965721+0000","last_fullsized":"2024-09-20T20:35:01.965721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'369","last_scrub_stamp":"2024-09-20T20:35:01.965520+0000","last_deep_scrub":"63'369","last_deep_scrub_stamp":"2024-09-20T20:35:01.965520+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.965520+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.253421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"63'481","reported_seq":650,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670594+0000","last_change":"2024-09-20T20:29:53.996382+0000","last_active":"2024-09-20T20:34:42.670594+0000","last_peered":"2024-09-20T20:34:42.670594+0000","last_clean":"2024-09-20T20:34:42.670594+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:34:42.670594+0000","last_undegraded":"2024-09-20T20:34:42.670594+0000","last_fullsized":"2024-09-20T20:34:42.670594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":606,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.795657+0000","last_change":"2024-09-20T20:34:57.795721+0000","last_active":"2024-09-20T20:34:57.795657+0000","last_peered":"2024-09-20T20:34:57.795657+0000","last_clean":"2024-09-20T20:34:57.795657+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:57.795657+0000","last_undegraded":"2024-09-20T20:34:57.795657+0000","last_fullsized":"2024-09-20T20:34:57.795657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'396","last_scrub_stamp":"2024-09-20T20:34:57.795452+0000","last_deep_scrub":"63'396","last_deep_scrub_stamp":"2024-09-20T20:34:57.795452+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.795452+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:24.773347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":354,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.640669+0000","last_change":"2024-09-20T20:34:17.643543+0000","last_active":"2024-09-20T20:34:42.640669+0000","last_peered":"2024-09-20T20:34:42.640669+0000","last_clean":"2024-09-20T20:34:42.640669+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:34:42.640669+0000","last_undegraded":"2024-09-20T20:34:42.640669+0000","last_fullsized":"2024-09-20T20:34:42.640669+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:43.686824+0000","last_clean_scrub_stamp":"2024-09-20T20:29:43.686824+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641241+0000","last_change":"2024-09-20T20:34:17.674857+0000","last_active":"2024-09-20T20:34:42.641241+0000","last_peered":"2024-09-20T20:34:42.641241+0000","last_clean":"2024-09-20T20:34:42.641241+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:34:42.641241+0000","last_undegraded":"2024-09-20T20:34:42.641241+0000","last_fullsized":"2024-09-20T20:34:42.641241+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"63'560","reported_seq":729,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672205+0000","last_change":"2024-09-20T20:29:53.995863+0000","last_active":"2024-09-20T20:34:42.672205+0000","last_peered":"2024-09-20T20:34:42.672205+0000","last_clean":"2024-09-20T20:34:42.672205+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:34:42.672205+0000","last_undegraded":"2024-09-20T20:34:42.672205+0000","last_fullsized":"2024-09-20T20:34:42.672205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":605,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.876626+0000","last_change":"2024-09-20T20:34:57.876683+0000","last_active":"2024-09-20T20:34:57.876626+0000","last_peered":"2024-09-20T20:34:57.876626+0000","last_clean":"2024-09-20T20:34:57.876626+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:57.876626+0000","last_undegraded":"2024-09-20T20:34:57.876626+0000","last_fullsized":"2024-09-20T20:34:57.876626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'426","last_scrub_stamp":"2024-09-20T20:34:57.876414+0000","last_deep_scrub":"63'426","last_deep_scrub_stamp":"2024-09-20T20:34:57.876414+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.876414+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:35.614386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642051+0000","last_change":"2024-09-20T20:34:17.648330+0000","last_active":"2024-09-20T20:34:42.642051+0000","last_peered":"2024-09-20T20:34:42.642051+0000","last_clean":"2024-09-20T20:34:42.642051+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:34:42.642051+0000","last_undegraded":"2024-09-20T20:34:42.642051+0000","last_fullsized":"2024-09-20T20:34:42.642051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"95'128","reported_seq":382,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.934411+0000","last_change":"2024-09-20T20:35:04.934480+0000","last_active":"2024-09-20T20:35:04.934411+0000","last_peered":"2024-09-20T20:35:04.934411+0000","last_clean":"2024-09-20T20:35:04.934411+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:35:04.934411+0000","last_undegraded":"2024-09-20T20:35:04.934411+0000","last_fullsized":"2024-09-20T20:35:04.934411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'128","last_scrub_stamp":"2024-09-20T20:35:04.934220+0000","last_deep_scrub":"95'128","last_deep_scrub_stamp":"2024-09-20T20:35:04.934220+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.934220+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:46.935126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.571536+0000","last_change":"2024-09-20T20:35:01.571597+0000","last_active":"2024-09-20T20:35:01.571536+0000","last_peered":"2024-09-20T20:35:01.571536+0000","last_clean":"2024-09-20T20:35:01.571536+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:35:01.571536+0000","last_undegraded":"2024-09-20T20:35:01.571536+0000","last_fullsized":"2024-09-20T20:35:01.571536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'440","last_scrub_stamp":"2024-09-20T20:35:01.571344+0000","last_deep_scrub":"63'440","last_deep_scrub_stamp":"2024-09-20T20:35:01.571344+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.571344+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:13.494135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:10.801854+0000","last_change":"2024-09-20T20:35:10.801904+0000","last_active":"2024-09-20T20:35:10.801854+0000","last_peered":"2024-09-20T20:35:10.801854+0000","last_clean":"2024-09-20T20:35:10.801854+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:35:10.801854+0000","last_undegraded":"2024-09-20T20:35:10.801854+0000","last_fullsized":"2024-09-20T20:35:10.801854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:10.801655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:10.801655+0000","last_clean_scrub_stamp":"2024-09-20T20:35:10.801655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:28.256956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'324","reported_seq":416,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.646615+0000","last_change":"2024-09-20T20:35:02.646762+0000","last_active":"2024-09-20T20:35:02.646615+0000","last_peered":"2024-09-20T20:35:02.646615+0000","last_clean":"2024-09-20T20:35:02.646615+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:35:02.646615+0000","last_undegraded":"2024-09-20T20:35:02.646615+0000","last_fullsized":"2024-09-20T20:35:02.646615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'324","last_scrub_stamp":"2024-09-20T20:35:02.646394+0000","last_deep_scrub":"95'324","last_deep_scrub_stamp":"2024-09-20T20:35:02.646394+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.646394+0000","objects_scrubbed":2,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:13.258717+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.842059+0000","last_change":"2024-09-20T20:34:55.842119+0000","last_active":"2024-09-20T20:34:55.842059+0000","last_peered":"2024-09-20T20:34:55.842059+0000","last_clean":"2024-09-20T20:34:55.842059+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:55.842059+0000","last_undegraded":"2024-09-20T20:34:55.842059+0000","last_fullsized":"2024-09-20T20:34:55.842059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'346","last_scrub_stamp":"2024-09-20T20:34:55.841867+0000","last_deep_scrub":"63'346","last_deep_scrub_stamp":"2024-09-20T20:34:55.841867+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.841867+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:36.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":95,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641046+0000","last_change":"2024-09-20T20:34:17.676726+0000","last_active":"2024-09-20T20:34:42.641046+0000","last_peered":"2024-09-20T20:34:42.641046+0000","last_clean":"2024-09-20T20:34:42.641046+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:34:42.641046+0000","last_undegraded":"2024-09-20T20:34:42.641046+0000","last_fullsized":"2024-09-20T20:34:42.641046+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642012+0000","last_change":"2024-09-20T20:34:17.676757+0000","last_active":"2024-09-20T20:34:42.642012+0000","last_peered":"2024-09-20T20:34:42.642012+0000","last_clean":"2024-09-20T20:34:42.642012+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:34:42.642012+0000","last_undegraded":"2024-09-20T20:34:42.642012+0000","last_fullsized":"2024-09-20T20:34:42.642012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.889678+0000","last_change":"2024-09-20T20:35:05.889736+0000","last_active":"2024-09-20T20:35:05.889678+0000","last_peered":"2024-09-20T20:35:05.889678+0000","last_clean":"2024-09-20T20:35:05.889678+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:35:05.889678+0000","last_undegraded":"2024-09-20T20:35:05.889678+0000","last_fullsized":"2024-09-20T20:35:05.889678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-09-20T20:35:05.889481+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-09-20T20:35:05.889481+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.889481+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:56.476099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"95'265","reported_seq":337,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.910010+0000","last_change":"2024-09-20T20:35:08.910079+0000","last_active":"2024-09-20T20:35:08.910010+0000","last_peered":"2024-09-20T20:35:08.910010+0000","last_clean":"2024-09-20T20:35:08.910010+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:35:08.910010+0000","last_undegraded":"2024-09-20T20:35:08.910010+0000","last_fullsized":"2024-09-20T20:35:08.910010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'265","last_scrub_stamp":"2024-09-20T20:35:08.909825+0000","last_deep_scrub":"95'265","last_deep_scrub_stamp":"2024-09-20T20:35:08.909825+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.909825+0000","objects_scrubbed":1,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:41.695165+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672451+0000","last_change":"2024-09-20T20:29:51.831417+0000","last_active":"2024-09-20T20:34:42.672451+0000","last_peered":"2024-09-20T20:34:42.672451+0000","last_clean":"2024-09-20T20:34:42.672451+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:34:42.672451+0000","last_undegraded":"2024-09-20T20:34:42.672451+0000","last_fullsized":"2024-09-20T20:34:42.672451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":843,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.671102+0000","last_change":"2024-09-20T20:34:32.665825+0000","last_active":"2024-09-20T20:34:42.671102+0000","last_peered":"2024-09-20T20:34:42.671102+0000","last_clean":"2024-09-20T20:34:42.671102+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:34:42.671102+0000","last_undegraded":"2024-09-20T20:34:42.671102+0000","last_fullsized":"2024-09-20T20:34:42.671102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672233+0000","last_change":"2024-09-20T20:29:53.995327+0000","last_active":"2024-09-20T20:34:42.672233+0000","last_peered":"2024-09-20T20:34:42.672233+0000","last_clean":"2024-09-20T20:34:42.672233+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:34:42.672233+0000","last_undegraded":"2024-09-20T20:34:42.672233+0000","last_fullsized":"2024-09-20T20:34:42.672233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.493357+0000","last_change":"2024-09-20T20:34:57.493408+0000","last_active":"2024-09-20T20:34:57.493357+0000","last_peered":"2024-09-20T20:34:57.493357+0000","last_clean":"2024-09-20T20:34:57.493357+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:57.493357+0000","last_undegraded":"2024-09-20T20:34:57.493357+0000","last_fullsized":"2024-09-20T20:34:57.493357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:34:57.493161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:34:57.493161+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.493161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:00.107933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":907,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.566349+0000","last_change":"2024-09-20T20:35:08.566407+0000","last_active":"2024-09-20T20:35:08.566349+0000","last_peered":"2024-09-20T20:35:08.566349+0000","last_clean":"2024-09-20T20:35:08.566349+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:35:08.566349+0000","last_undegraded":"2024-09-20T20:35:08.566349+0000","last_fullsized":"2024-09-20T20:35:08.566349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'391","last_scrub_stamp":"2024-09-20T20:35:08.566148+0000","last_deep_scrub":"63'391","last_deep_scrub_stamp":"2024-09-20T20:35:08.566148+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.566148+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:26.021449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"63'64","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.673382+0000","last_change":"2024-09-20T20:29:53.998066+0000","last_active":"2024-09-20T20:34:42.673382+0000","last_peered":"2024-09-20T20:34:42.673382+0000","last_clean":"2024-09-20T20:34:42.673382+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:34:42.673382+0000","last_undegraded":"2024-09-20T20:34:42.673382+0000","last_fullsized":"2024-09-20T20:34:42.673382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:11.849580+0000","last_change":"2024-09-20T20:35:11.849633+0000","last_active":"2024-09-20T20:35:11.849580+0000","last_peered":"2024-09-20T20:35:11.849580+0000","last_clean":"2024-09-20T20:35:11.849580+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:35:11.849580+0000","last_undegraded":"2024-09-20T20:35:11.849580+0000","last_fullsized":"2024-09-20T20:35:11.849580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:11.849387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:11.849387+0000","last_clean_scrub_stamp":"2024-09-20T20:35:11.849387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:02.332494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1062,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670857+0000","last_change":"2024-09-20T20:34:41.673197+0000","last_active":"2024-09-20T20:34:42.670857+0000","last_peered":"2024-09-20T20:34:42.670857+0000","last_clean":"2024-09-20T20:34:42.670857+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:34:42.670857+0000","last_undegraded":"2024-09-20T20:34:42.670857+0000","last_fullsized":"2024-09-20T20:34:42.670857+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"95'119","reported_seq":308,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.902062+0000","last_change":"2024-09-20T20:35:02.902128+0000","last_active":"2024-09-20T20:35:02.902062+0000","last_peered":"2024-09-20T20:35:02.902062+0000","last_clean":"2024-09-20T20:35:02.902062+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:35:02.902062+0000","last_undegraded":"2024-09-20T20:35:02.902062+0000","last_fullsized":"2024-09-20T20:35:02.902062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'119","last_scrub_stamp":"2024-09-20T20:35:02.901876+0000","last_deep_scrub":"95'119","last_deep_scrub_stamp":"2024-09-20T20:35:02.901876+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.901876+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:48.084840+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643943+0000","last_change":"2024-09-20T20:34:17.637030+0000","last_active":"2024-09-20T20:34:42.643943+0000","last_peered":"2024-09-20T20:34:42.643943+0000","last_clean":"2024-09-20T20:34:42.643943+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:34:42.643943+0000","last_undegraded":"2024-09-20T20:34:42.643943+0000","last_fullsized":"2024-09-20T20:34:42.643943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:48.803675+0000","last_clean_scrub_stamp":"2024-09-20T20:29:48.803675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.565469+0000","last_change":"2024-09-20T20:35:06.565643+0000","last_active":"2024-09-20T20:35:06.565469+0000","last_peered":"2024-09-20T20:35:06.565469+0000","last_clean":"2024-09-20T20:35:06.565469+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:35:06.565469+0000","last_undegraded":"2024-09-20T20:35:06.565469+0000","last_fullsized":"2024-09-20T20:35:06.565469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-09-20T20:35:06.565243+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-09-20T20:35:06.565243+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.565243+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:52.475888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":583,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.858941+0000","last_change":"2024-09-20T20:35:09.859000+0000","last_active":"2024-09-20T20:35:09.858941+0000","last_peered":"2024-09-20T20:35:09.858941+0000","last_clean":"2024-09-20T20:35:09.858941+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:35:09.858941+0000","last_undegraded":"2024-09-20T20:35:09.858941+0000","last_fullsized":"2024-09-20T20:35:09.858941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'398","last_scrub_stamp":"2024-09-20T20:35:09.858742+0000","last_deep_scrub":"63'398","last_deep_scrub_stamp":"2024-09-20T20:35:09.858742+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.858742+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:20.819085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"95'276","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.954637+0000","last_change":"2024-09-20T20:35:04.954704+0000","last_active":"2024-09-20T20:35:04.954637+0000","last_peered":"2024-09-20T20:35:04.954637+0000","last_clean":"2024-09-20T20:35:04.954637+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:35:04.954637+0000","last_undegraded":"2024-09-20T20:35:04.954637+0000","last_fullsized":"2024-09-20T20:35:04.954637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'276","last_scrub_stamp":"2024-09-20T20:35:04.954461+0000","last_deep_scrub":"95'276","last_deep_scrub_stamp":"2024-09-20T20:35:04.954461+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.954461+0000","objects_scrubbed":6,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:48:52.941148+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":600,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.881172+0000","last_change":"2024-09-20T20:35:03.881232+0000","last_active":"2024-09-20T20:35:03.881172+0000","last_peered":"2024-09-20T20:35:03.881172+0000","last_clean":"2024-09-20T20:35:03.881172+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:35:03.881172+0000","last_undegraded":"2024-09-20T20:35:03.881172+0000","last_fullsized":"2024-09-20T20:35:03.881172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'401","last_scrub_stamp":"2024-09-20T20:35:03.880955+0000","last_deep_scrub":"63'401","last_deep_scrub_stamp":"2024-09-20T20:35:03.880955+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.880955+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:44.587743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"95'91","reported_seq":280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:12.616152+0000","last_change":"2024-09-20T20:35:12.616216+0000","last_active":"2024-09-20T20:35:12.616152+0000","last_peered":"2024-09-20T20:35:12.616152+0000","last_clean":"2024-09-20T20:35:12.616152+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:35:12.616152+0000","last_undegraded":"2024-09-20T20:35:12.616152+0000","last_fullsized":"2024-09-20T20:35:12.616152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'91","last_scrub_stamp":"2024-09-20T20:35:12.615981+0000","last_deep_scrub":"95'91","last_deep_scrub_stamp":"2024-09-20T20:35:12.615981+0000","last_clean_scrub_stamp":"2024-09-20T20:35:12.615981+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:38:18.657894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"63'206","reported_seq":273,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.643723+0000","last_change":"2024-09-20T20:34:20.796728+0000","last_active":"2024-09-20T20:34:42.643723+0000","last_peered":"2024-09-20T20:34:42.643723+0000","last_clean":"2024-09-20T20:34:42.643723+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:34:42.643723+0000","last_undegraded":"2024-09-20T20:34:42.643723+0000","last_fullsized":"2024-09-20T20:34:42.643723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1089,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.670693+0000","last_change":"2024-09-20T20:34:28.663324+0000","last_active":"2024-09-20T20:34:42.670693+0000","last_peered":"2024-09-20T20:34:42.670693+0000","last_clean":"2024-09-20T20:34:42.670693+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:34:42.670693+0000","last_undegraded":"2024-09-20T20:34:42.670693+0000","last_fullsized":"2024-09-20T20:34:42.670693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.828455+0000","last_change":"2024-09-20T20:35:00.828517+0000","last_active":"2024-09-20T20:35:00.828455+0000","last_peered":"2024-09-20T20:35:00.828455+0000","last_clean":"2024-09-20T20:35:00.828455+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:35:00.828455+0000","last_undegraded":"2024-09-20T20:35:00.828455+0000","last_fullsized":"2024-09-20T20:35:00.828455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'58","last_scrub_stamp":"2024-09-20T20:35:00.828255+0000","last_deep_scrub":"63'58","last_deep_scrub_stamp":"2024-09-20T20:35:00.828255+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.828255+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:34:06.354325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":685,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.850033+0000","last_change":"2024-09-20T20:35:01.850097+0000","last_active":"2024-09-20T20:35:01.850033+0000","last_peered":"2024-09-20T20:35:01.850033+0000","last_clean":"2024-09-20T20:35:01.850033+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:35:01.850033+0000","last_undegraded":"2024-09-20T20:35:01.850033+0000","last_fullsized":"2024-09-20T20:35:01.850033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'495","last_scrub_stamp":"2024-09-20T20:35:01.849806+0000","last_deep_scrub":"63'495","last_deep_scrub_stamp":"2024-09-20T20:35:01.849806+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.849806+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:56.932808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":847,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672919+0000","last_change":"2024-09-20T20:34:37.663406+0000","last_active":"2024-09-20T20:34:42.672919+0000","last_peered":"2024-09-20T20:34:42.672919+0000","last_clean":"2024-09-20T20:34:42.672919+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:34:42.672919+0000","last_undegraded":"2024-09-20T20:34:42.672919+0000","last_fullsized":"2024-09-20T20:34:42.672919+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"63'699","reported_seq":868,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:47.743774+0000","last_change":"2024-09-20T20:29:53.995224+0000","last_active":"2024-09-20T20:34:47.743774+0000","last_peered":"2024-09-20T20:34:47.743774+0000","last_clean":"2024-09-20T20:34:47.743774+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:34:47.743774+0000","last_undegraded":"2024-09-20T20:34:47.743774+0000","last_fullsized":"2024-09-20T20:34:47.743774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":946,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672410+0000","last_change":"2024-09-20T20:34:34.658712+0000","last_active":"2024-09-20T20:34:42.672410+0000","last_peered":"2024-09-20T20:34:42.672410+0000","last_clean":"2024-09-20T20:34:42.672410+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:34:42.672410+0000","last_undegraded":"2024-09-20T20:34:42.672410+0000","last_fullsized":"2024-09-20T20:34:42.672410+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"95'184","reported_seq":375,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.805023+0000","last_change":"2024-09-20T20:35:08.805093+0000","last_active":"2024-09-20T20:35:08.805023+0000","last_peered":"2024-09-20T20:35:08.805023+0000","last_clean":"2024-09-20T20:35:08.805023+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:35:08.805023+0000","last_undegraded":"2024-09-20T20:35:08.805023+0000","last_fullsized":"2024-09-20T20:35:08.805023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'184","last_scrub_stamp":"2024-09-20T20:35:08.804833+0000","last_deep_scrub":"95'184","last_deep_scrub_stamp":"2024-09-20T20:35:08.804833+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.804833+0000","objects_scrubbed":1,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:54.715477+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":967,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.178894+0000","last_change":"2024-09-20T20:34:36.667444+0000","last_active":"2024-09-20T20:34:54.178894+0000","last_peered":"2024-09-20T20:34:54.178894+0000","last_clean":"2024-09-20T20:34:54.178894+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:34:54.178894+0000","last_undegraded":"2024-09-20T20:34:54.178894+0000","last_fullsized":"2024-09-20T20:34:54.178894+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"95'239","reported_seq":338,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.583246+0000","last_change":"2024-09-20T20:34:59.583313+0000","last_active":"2024-09-20T20:34:59.583246+0000","last_peered":"2024-09-20T20:34:59.583246+0000","last_clean":"2024-09-20T20:34:59.583246+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:59.583246+0000","last_undegraded":"2024-09-20T20:34:59.583246+0000","last_fullsized":"2024-09-20T20:34:59.583246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'239","last_scrub_stamp":"2024-09-20T20:34:59.583051+0000","last_deep_scrub":"95'239","last_deep_scrub_stamp":"2024-09-20T20:34:59.583051+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.583051+0000","objects_scrubbed":3,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:48.952097+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":547,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.469043+0000","last_change":"2024-09-20T20:34:56.469100+0000","last_active":"2024-09-20T20:34:56.469043+0000","last_peered":"2024-09-20T20:34:56.469043+0000","last_clean":"2024-09-20T20:34:56.469043+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:56.469043+0000","last_undegraded":"2024-09-20T20:34:56.469043+0000","last_fullsized":"2024-09-20T20:34:56.469043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'379","last_scrub_stamp":"2024-09-20T20:34:56.468841+0000","last_deep_scrub":"63'379","last_deep_scrub_stamp":"2024-09-20T20:34:56.468841+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.468841+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:23.446737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"62'60","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.178441+0000","last_change":"2024-09-20T20:34:17.710998+0000","last_active":"2024-09-20T20:34:54.178441+0000","last_peered":"2024-09-20T20:34:54.178441+0000","last_clean":"2024-09-20T20:34:54.178441+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:34:54.178441+0000","last_undegraded":"2024-09-20T20:34:54.178441+0000","last_fullsized":"2024-09-20T20:34:54.178441+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.875633+0000","last_change":"2024-09-20T20:34:55.875689+0000","last_active":"2024-09-20T20:34:55.875633+0000","last_peered":"2024-09-20T20:34:55.875633+0000","last_clean":"2024-09-20T20:34:55.875633+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:55.875633+0000","last_undegraded":"2024-09-20T20:34:55.875633+0000","last_fullsized":"2024-09-20T20:34:55.875633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'373","last_scrub_stamp":"2024-09-20T20:34:55.875446+0000","last_deep_scrub":"63'373","last_deep_scrub_stamp":"2024-09-20T20:34:55.875446+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.875446+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:30.314326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"95'201","reported_seq":381,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.882979+0000","last_change":"2024-09-20T20:35:06.883109+0000","last_active":"2024-09-20T20:35:06.882979+0000","last_peered":"2024-09-20T20:35:06.882979+0000","last_clean":"2024-09-20T20:35:06.882979+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:35:06.882979+0000","last_undegraded":"2024-09-20T20:35:06.882979+0000","last_fullsized":"2024-09-20T20:35:06.882979+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'201","last_scrub_stamp":"2024-09-20T20:35:06.882785+0000","last_deep_scrub":"95'201","last_deep_scrub_stamp":"2024-09-20T20:35:06.882785+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.882785+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:20.024822+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":579,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.641596+0000","last_change":"2024-09-20T20:34:36.630850+0000","last_active":"2024-09-20T20:34:42.641596+0000","last_peered":"2024-09-20T20:34:42.641596+0000","last_clean":"2024-09-20T20:34:42.641596+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:34:42.641596+0000","last_undegraded":"2024-09-20T20:34:42.641596+0000","last_fullsized":"2024-09-20T20:34:42.641596+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"95'275","reported_seq":466,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:10.700864+0000","last_change":"2024-09-20T20:35:10.700944+0000","last_active":"2024-09-20T20:35:10.700864+0000","last_peered":"2024-09-20T20:35:10.700864+0000","last_clean":"2024-09-20T20:35:10.700864+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:35:10.700864+0000","last_undegraded":"2024-09-20T20:35:10.700864+0000","last_fullsized":"2024-09-20T20:35:10.700864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'275","last_scrub_stamp":"2024-09-20T20:35:10.700658+0000","last_deep_scrub":"95'275","last_deep_scrub_stamp":"2024-09-20T20:35:10.700658+0000","last_clean_scrub_stamp":"2024-09-20T20:35:10.700658+0000","objects_scrubbed":4,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:14.131284+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":623,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:11.642339+0000","last_change":"2024-09-20T20:35:11.642400+0000","last_active":"2024-09-20T20:35:11.642339+0000","last_peered":"2024-09-20T20:35:11.642339+0000","last_clean":"2024-09-20T20:35:11.642339+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:35:11.642339+0000","last_undegraded":"2024-09-20T20:35:11.642339+0000","last_fullsized":"2024-09-20T20:35:11.642339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'435","last_scrub_stamp":"2024-09-20T20:35:11.642148+0000","last_deep_scrub":"63'435","last_deep_scrub_stamp":"2024-09-20T20:35:11.642148+0000","last_clean_scrub_stamp":"2024-09-20T20:35:11.642148+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:20.598824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"63'65","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.672686+0000","last_change":"2024-09-20T20:29:53.997075+0000","last_active":"2024-09-20T20:34:42.672686+0000","last_peered":"2024-09-20T20:34:42.672686+0000","last_clean":"2024-09-20T20:34:42.672686+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:34:42.672686+0000","last_undegraded":"2024-09-20T20:34:42.672686+0000","last_fullsized":"2024-09-20T20:34:42.672686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:52.964383+0000","last_clean_scrub_stamp":"2024-09-20T20:29:52.964383+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:42.642193+0000","last_change":"2024-09-20T20:34:40.642728+0000","last_active":"2024-09-20T20:34:42.642193+0000","last_peered":"2024-09-20T20:34:42.642193+0000","last_clean":"2024-09-20T20:34:42.642193+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:34:42.642193+0000","last_undegraded":"2024-09-20T20:34:42.642193+0000","last_fullsized":"2024-09-20T20:34:42.642193+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"95'59","reported_seq":244,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.823156+0000","last_change":"2024-09-20T20:34:56.823234+0000","last_active":"2024-09-20T20:34:56.823156+0000","last_peered":"2024-09-20T20:34:56.823156+0000","last_clean":"2024-09-20T20:34:56.823156+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:56.823156+0000","last_undegraded":"2024-09-20T20:34:56.823156+0000","last_fullsized":"2024-09-20T20:34:56.823156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'59","last_scrub_stamp":"2024-09-20T20:34:56.822965+0000","last_deep_scrub":"95'59","last_deep_scrub_stamp":"2024-09-20T20:34:56.822965+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.822965+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:09.414357+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6675,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6399,"ondisk_log_size":6399,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738438,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99324,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272516,"statfs":{"total":96636764160,"available":96535056384,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104352,"kb_used_data":28816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267488,"statfs":{"total":96636764160,"available":96529907712,"internally_reserved":0,"allocated":29507584,"data_stored":85109907,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57320,"kb_used_data":23640,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94314520,"statfs":{"total":96636764160,"available":96578068480,"internally_reserved":0,"allocated":24207360,"data_stored":90774901,"data_compressed":13901890,"data_compressed_allocated":16965632,"data_compressed_original":84058112,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:35:15.361 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.362 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.362 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.362 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.362 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.362 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.362 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.363 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.363 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.363 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.363 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.363 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.363 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.363 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.364 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.364 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.364 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.364 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.364 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.364 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.364 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.364 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.365 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.365 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.365 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.365 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.365 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.365 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.365 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.365 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-20T20:29:43.686824+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=43, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.366 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.366 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.366 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.366 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.366 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.366 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.366 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.366 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.367 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.367 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.367 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-20T20:29:48.803675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=48, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.367 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.367 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.368 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.368 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.368 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.368 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.368 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.368 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.368 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-20T20:29:52.964383+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.368 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:15.369 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-20T20:35:35.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:35:35.694 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:35:35.697 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:35:35.713 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-20T20:35:33.741074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6689,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33241,"ondisk_log_size":33241,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":260996,"kb_used_data":80404,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282854524,"statfs":{"total":289910292480,"available":289643032576,"internally_reserved":0,"allocated":82333696,"data_stored":257450488,"data_compressed":37624865,"data_compressed_allocated":48259072,"data_compressed_original":224894976,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004353"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":642,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.620529+0000","last_change":"2024-09-20T20:35:03.620586+0000","last_active":"2024-09-20T20:35:03.620529+0000","last_peered":"2024-09-20T20:35:03.620529+0000","last_clean":"2024-09-20T20:35:03.620529+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:35:03.620529+0000","last_undegraded":"2024-09-20T20:35:03.620529+0000","last_fullsized":"2024-09-20T20:35:03.620529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'451","last_scrub_stamp":"2024-09-20T20:35:03.620336+0000","last_deep_scrub":"63'451","last_deep_scrub_stamp":"2024-09-20T20:35:03.620336+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.620336+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:44.363780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":678,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:16.528148+0000","last_change":"2024-09-20T20:35:16.528214+0000","last_active":"2024-09-20T20:35:16.528148+0000","last_peered":"2024-09-20T20:35:16.528148+0000","last_clean":"2024-09-20T20:35:16.528148+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:35:16.528148+0000","last_undegraded":"2024-09-20T20:35:16.528148+0000","last_fullsized":"2024-09-20T20:35:16.528148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'427","last_scrub_stamp":"2024-09-20T20:35:16.527952+0000","last_deep_scrub":"63'427","last_deep_scrub_stamp":"2024-09-20T20:35:16.527952+0000","last_clean_scrub_stamp":"2024-09-20T20:35:16.527952+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:51.609881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":604,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:13.800695+0000","last_change":"2024-09-20T20:35:13.800756+0000","last_active":"2024-09-20T20:35:13.800695+0000","last_peered":"2024-09-20T20:35:13.800695+0000","last_clean":"2024-09-20T20:35:13.800695+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:35:13.800695+0000","last_undegraded":"2024-09-20T20:35:13.800695+0000","last_fullsized":"2024-09-20T20:35:13.800695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'399","last_scrub_stamp":"2024-09-20T20:35:13.800503+0000","last_deep_scrub":"63'399","last_deep_scrub_stamp":"2024-09-20T20:35:13.800503+0000","last_clean_scrub_stamp":"2024-09-20T20:35:13.800503+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:44:30.478240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":572,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:23.783179+0000","last_change":"2024-09-20T20:35:23.783236+0000","last_active":"2024-09-20T20:35:23.783179+0000","last_peered":"2024-09-20T20:35:23.783179+0000","last_clean":"2024-09-20T20:35:23.783179+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:35:23.783179+0000","last_undegraded":"2024-09-20T20:35:23.783179+0000","last_fullsized":"2024-09-20T20:35:23.783179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'396","last_scrub_stamp":"2024-09-20T20:35:23.782979+0000","last_deep_scrub":"63'396","last_deep_scrub_stamp":"2024-09-20T20:35:23.782979+0000","last_clean_scrub_stamp":"2024-09-20T20:35:23.782979+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:42:35.750041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":528,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.524666+0000","last_change":"2024-09-20T20:34:58.524725+0000","last_active":"2024-09-20T20:34:58.524666+0000","last_peered":"2024-09-20T20:34:58.524666+0000","last_clean":"2024-09-20T20:34:58.524666+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:58.524666+0000","last_undegraded":"2024-09-20T20:34:58.524666+0000","last_fullsized":"2024-09-20T20:34:58.524666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'413","last_scrub_stamp":"2024-09-20T20:34:58.524458+0000","last_deep_scrub":"63'413","last_deep_scrub_stamp":"2024-09-20T20:34:58.524458+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.524458+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:39.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":590,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.831717+0000","last_change":"2024-09-20T20:34:56.831778+0000","last_active":"2024-09-20T20:34:56.831717+0000","last_peered":"2024-09-20T20:34:56.831717+0000","last_clean":"2024-09-20T20:34:56.831717+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:56.831717+0000","last_undegraded":"2024-09-20T20:34:56.831717+0000","last_fullsized":"2024-09-20T20:34:56.831717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'387","last_scrub_stamp":"2024-09-20T20:34:56.831519+0000","last_deep_scrub":"63'387","last_deep_scrub_stamp":"2024-09-20T20:34:56.831519+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.831519+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:35.128128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:11.841692+0000","last_change":"2024-09-20T20:35:11.841750+0000","last_active":"2024-09-20T20:35:11.841692+0000","last_peered":"2024-09-20T20:35:11.841692+0000","last_clean":"2024-09-20T20:35:11.841692+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:35:11.841692+0000","last_undegraded":"2024-09-20T20:35:11.841692+0000","last_fullsized":"2024-09-20T20:35:11.841692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'422","last_scrub_stamp":"2024-09-20T20:35:11.841502+0000","last_deep_scrub":"63'422","last_deep_scrub_stamp":"2024-09-20T20:35:11.841502+0000","last_clean_scrub_stamp":"2024-09-20T20:35:11.841502+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:19.045084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":593,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:29.864442+0000","last_change":"2024-09-20T20:35:29.864597+0000","last_active":"2024-09-20T20:35:29.864442+0000","last_peered":"2024-09-20T20:35:29.864442+0000","last_clean":"2024-09-20T20:35:29.864442+0000","last_became_active":"2024-09-20T20:34:41.636093+0000","last_became_peered":"2024-09-20T20:34:41.636093+0000","last_unstale":"2024-09-20T20:35:29.864442+0000","last_undegraded":"2024-09-20T20:35:29.864442+0000","last_fullsized":"2024-09-20T20:35:29.864442+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'405","last_scrub_stamp":"2024-09-20T20:35:29.864215+0000","last_deep_scrub":"63'405","last_deep_scrub_stamp":"2024-09-20T20:35:29.864215+0000","last_clean_scrub_stamp":"2024-09-20T20:35:29.864215+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:04:37.627319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.787487+0000","last_change":"2024-09-20T20:35:09.787632+0000","last_active":"2024-09-20T20:35:09.787487+0000","last_peered":"2024-09-20T20:35:09.787487+0000","last_clean":"2024-09-20T20:35:09.787487+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:35:09.787487+0000","last_undegraded":"2024-09-20T20:35:09.787487+0000","last_fullsized":"2024-09-20T20:35:09.787487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'414","last_scrub_stamp":"2024-09-20T20:35:09.787259+0000","last_deep_scrub":"63'414","last_deep_scrub_stamp":"2024-09-20T20:35:09.787259+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.787259+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:26:21.110972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":582,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:15.505027+0000","last_change":"2024-09-20T20:35:15.505087+0000","last_active":"2024-09-20T20:35:15.505027+0000","last_peered":"2024-09-20T20:35:15.505027+0000","last_clean":"2024-09-20T20:35:15.505027+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:35:15.505027+0000","last_undegraded":"2024-09-20T20:35:15.505027+0000","last_fullsized":"2024-09-20T20:35:15.505027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'395","last_scrub_stamp":"2024-09-20T20:35:15.504832+0000","last_deep_scrub":"63'395","last_deep_scrub_stamp":"2024-09-20T20:35:15.504832+0000","last_clean_scrub_stamp":"2024-09-20T20:35:15.504832+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:17.342033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.871773+0000","last_change":"2024-09-20T20:35:05.871834+0000","last_active":"2024-09-20T20:35:05.871773+0000","last_peered":"2024-09-20T20:35:05.871773+0000","last_clean":"2024-09-20T20:35:05.871773+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:35:05.871773+0000","last_undegraded":"2024-09-20T20:35:05.871773+0000","last_fullsized":"2024-09-20T20:35:05.871773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'367","last_scrub_stamp":"2024-09-20T20:35:05.871579+0000","last_deep_scrub":"63'367","last_deep_scrub_stamp":"2024-09-20T20:35:05.871579+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.871579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:13.777294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":827,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.438828+0000","last_change":"2024-09-20T20:34:54.438886+0000","last_active":"2024-09-20T20:34:54.438828+0000","last_peered":"2024-09-20T20:34:54.438828+0000","last_clean":"2024-09-20T20:34:54.438828+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:54.438828+0000","last_undegraded":"2024-09-20T20:34:54.438828+0000","last_fullsized":"2024-09-20T20:34:54.438828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'358","last_scrub_stamp":"2024-09-20T20:34:54.438632+0000","last_deep_scrub":"63'358","last_deep_scrub_stamp":"2024-09-20T20:34:54.438632+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.438632+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:56.379760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.608986+0000","last_change":"2024-09-20T20:35:09.609047+0000","last_active":"2024-09-20T20:35:09.608986+0000","last_peered":"2024-09-20T20:35:09.608986+0000","last_clean":"2024-09-20T20:35:09.608986+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:35:09.608986+0000","last_undegraded":"2024-09-20T20:35:09.608986+0000","last_fullsized":"2024-09-20T20:35:09.608986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'421","last_scrub_stamp":"2024-09-20T20:35:09.608780+0000","last_deep_scrub":"63'421","last_deep_scrub_stamp":"2024-09-20T20:35:09.608780+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.608780+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:29.678874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.846395+0000","last_change":"2024-09-20T20:34:54.846453+0000","last_active":"2024-09-20T20:34:54.846395+0000","last_peered":"2024-09-20T20:34:54.846395+0000","last_clean":"2024-09-20T20:34:54.846395+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:54.846395+0000","last_undegraded":"2024-09-20T20:34:54.846395+0000","last_fullsized":"2024-09-20T20:34:54.846395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'420","last_scrub_stamp":"2024-09-20T20:34:54.846176+0000","last_deep_scrub":"63'420","last_deep_scrub_stamp":"2024-09-20T20:34:54.846176+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.846176+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:49:14.810187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":707,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.844934+0000","last_change":"2024-09-20T20:34:58.844995+0000","last_active":"2024-09-20T20:34:58.844934+0000","last_peered":"2024-09-20T20:34:58.844934+0000","last_clean":"2024-09-20T20:34:58.844934+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:58.844934+0000","last_undegraded":"2024-09-20T20:34:58.844934+0000","last_fullsized":"2024-09-20T20:34:58.844934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-09-20T20:34:58.844737+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-09-20T20:34:58.844737+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.844737+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:13.120956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":625,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:27.782100+0000","last_change":"2024-09-20T20:35:27.782224+0000","last_active":"2024-09-20T20:35:27.782100+0000","last_peered":"2024-09-20T20:35:27.782100+0000","last_clean":"2024-09-20T20:35:27.782100+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:35:27.782100+0000","last_undegraded":"2024-09-20T20:35:27.782100+0000","last_fullsized":"2024-09-20T20:35:27.782100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'430","last_scrub_stamp":"2024-09-20T20:35:27.781800+0000","last_deep_scrub":"63'430","last_deep_scrub_stamp":"2024-09-20T20:35:27.781800+0000","last_clean_scrub_stamp":"2024-09-20T20:35:27.781800+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:20.603426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.888686+0000","last_change":"2024-09-20T20:34:54.888803+0000","last_active":"2024-09-20T20:34:54.888686+0000","last_peered":"2024-09-20T20:34:54.888686+0000","last_clean":"2024-09-20T20:34:54.888686+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:54.888686+0000","last_undegraded":"2024-09-20T20:34:54.888686+0000","last_fullsized":"2024-09-20T20:34:54.888686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'419","last_scrub_stamp":"2024-09-20T20:34:54.888376+0000","last_deep_scrub":"63'419","last_deep_scrub_stamp":"2024-09-20T20:34:54.888376+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.888376+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:52.642419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":642,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:14.548767+0000","last_change":"2024-09-20T20:35:14.548827+0000","last_active":"2024-09-20T20:35:14.548767+0000","last_peered":"2024-09-20T20:35:14.548767+0000","last_clean":"2024-09-20T20:35:14.548767+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:35:14.548767+0000","last_undegraded":"2024-09-20T20:35:14.548767+0000","last_fullsized":"2024-09-20T20:35:14.548767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-09-20T20:35:14.548579+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-09-20T20:35:14.548579+0000","last_clean_scrub_stamp":"2024-09-20T20:35:14.548579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:30.511048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":656,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:17.568485+0000","last_change":"2024-09-20T20:35:17.568485+0000","last_active":"2024-09-20T20:35:17.568485+0000","last_peered":"2024-09-20T20:35:17.568485+0000","last_clean":"2024-09-20T20:35:17.568485+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:35:17.568485+0000","last_undegraded":"2024-09-20T20:35:17.568485+0000","last_fullsized":"2024-09-20T20:35:17.568485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'461","last_scrub_stamp":"2024-09-20T20:35:17.568230+0000","last_deep_scrub":"63'461","last_deep_scrub_stamp":"2024-09-20T20:35:17.568230+0000","last_clean_scrub_stamp":"2024-09-20T20:35:17.568230+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:37.777458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.885617+0000","last_change":"2024-09-20T20:35:07.885674+0000","last_active":"2024-09-20T20:35:07.885617+0000","last_peered":"2024-09-20T20:35:07.885617+0000","last_clean":"2024-09-20T20:35:07.885617+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:35:07.885617+0000","last_undegraded":"2024-09-20T20:35:07.885617+0000","last_fullsized":"2024-09-20T20:35:07.885617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-09-20T20:35:07.885422+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-09-20T20:35:07.885422+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.885422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:06.231903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.889617+0000","last_change":"2024-09-20T20:35:03.889679+0000","last_active":"2024-09-20T20:35:03.889617+0000","last_peered":"2024-09-20T20:35:03.889617+0000","last_clean":"2024-09-20T20:35:03.889617+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:35:03.889617+0000","last_undegraded":"2024-09-20T20:35:03.889617+0000","last_fullsized":"2024-09-20T20:35:03.889617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'395","last_scrub_stamp":"2024-09-20T20:35:03.889430+0000","last_deep_scrub":"63'395","last_deep_scrub_stamp":"2024-09-20T20:35:03.889430+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.889430+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:44.178040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":975,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:27.508335+0000","last_change":"2024-09-20T20:35:27.508398+0000","last_active":"2024-09-20T20:35:27.508335+0000","last_peered":"2024-09-20T20:35:27.508335+0000","last_clean":"2024-09-20T20:35:27.508335+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:35:27.508335+0000","last_undegraded":"2024-09-20T20:35:27.508335+0000","last_fullsized":"2024-09-20T20:35:27.508335+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'440","last_scrub_stamp":"2024-09-20T20:35:27.508137+0000","last_deep_scrub":"63'440","last_deep_scrub_stamp":"2024-09-20T20:35:27.508137+0000","last_clean_scrub_stamp":"2024-09-20T20:35:27.508137+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:03:12.854669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1019,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:22.982657+0000","last_change":"2024-09-20T20:35:22.982723+0000","last_active":"2024-09-20T20:35:22.982657+0000","last_peered":"2024-09-20T20:35:22.982657+0000","last_clean":"2024-09-20T20:35:22.982657+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:35:22.982657+0000","last_undegraded":"2024-09-20T20:35:22.982657+0000","last_fullsized":"2024-09-20T20:35:22.982657+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-09-20T20:35:22.982444+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-09-20T20:35:22.982444+0000","last_clean_scrub_stamp":"2024-09-20T20:35:22.982444+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:48:53.371866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":703,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.558988+0000","last_change":"2024-09-20T20:35:00.559048+0000","last_active":"2024-09-20T20:35:00.558988+0000","last_peered":"2024-09-20T20:35:00.558988+0000","last_clean":"2024-09-20T20:35:00.558988+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:35:00.558988+0000","last_undegraded":"2024-09-20T20:35:00.558988+0000","last_fullsized":"2024-09-20T20:35:00.558988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'473","last_scrub_stamp":"2024-09-20T20:35:00.558787+0000","last_deep_scrub":"63'473","last_deep_scrub_stamp":"2024-09-20T20:35:00.558787+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.558787+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:32.658097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:26.537190+0000","last_change":"2024-09-20T20:35:26.537252+0000","last_active":"2024-09-20T20:35:26.537190+0000","last_peered":"2024-09-20T20:35:26.537190+0000","last_clean":"2024-09-20T20:35:26.537190+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:35:26.537190+0000","last_undegraded":"2024-09-20T20:35:26.537190+0000","last_fullsized":"2024-09-20T20:35:26.537190+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'423","last_scrub_stamp":"2024-09-20T20:35:26.536992+0000","last_deep_scrub":"63'423","last_deep_scrub_stamp":"2024-09-20T20:35:26.536992+0000","last_clean_scrub_stamp":"2024-09-20T20:35:26.536992+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:54.908549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1094,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:20.904543+0000","last_change":"2024-09-20T20:35:20.904609+0000","last_active":"2024-09-20T20:35:20.904543+0000","last_peered":"2024-09-20T20:35:20.904543+0000","last_clean":"2024-09-20T20:35:20.904543+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:35:20.904543+0000","last_undegraded":"2024-09-20T20:35:20.904543+0000","last_fullsized":"2024-09-20T20:35:20.904543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'490","last_scrub_stamp":"2024-09-20T20:35:20.904321+0000","last_deep_scrub":"63'490","last_deep_scrub_stamp":"2024-09-20T20:35:20.904321+0000","last_clean_scrub_stamp":"2024-09-20T20:35:20.904321+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:15.428195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":637,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:24.758928+0000","last_change":"2024-09-20T20:35:24.758989+0000","last_active":"2024-09-20T20:35:24.758928+0000","last_peered":"2024-09-20T20:35:24.758928+0000","last_clean":"2024-09-20T20:35:24.758928+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:35:24.758928+0000","last_undegraded":"2024-09-20T20:35:24.758928+0000","last_fullsized":"2024-09-20T20:35:24.758928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'416","last_scrub_stamp":"2024-09-20T20:35:24.758737+0000","last_deep_scrub":"63'416","last_deep_scrub_stamp":"2024-09-20T20:35:24.758737+0000","last_clean_scrub_stamp":"2024-09-20T20:35:24.758737+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:38.755058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:22.575697+0000","last_change":"2024-09-20T20:35:22.575755+0000","last_active":"2024-09-20T20:35:22.575697+0000","last_peered":"2024-09-20T20:35:22.575697+0000","last_clean":"2024-09-20T20:35:22.575697+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:35:22.575697+0000","last_undegraded":"2024-09-20T20:35:22.575697+0000","last_fullsized":"2024-09-20T20:35:22.575697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'392","last_scrub_stamp":"2024-09-20T20:35:22.575539+0000","last_deep_scrub":"63'392","last_deep_scrub_stamp":"2024-09-20T20:35:22.575539+0000","last_clean_scrub_stamp":"2024-09-20T20:35:22.575539+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:53:35.532622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":668,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.814096+0000","last_change":"2024-09-20T20:35:07.814229+0000","last_active":"2024-09-20T20:35:07.814096+0000","last_peered":"2024-09-20T20:35:07.814096+0000","last_clean":"2024-09-20T20:35:07.814096+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:35:07.814096+0000","last_undegraded":"2024-09-20T20:35:07.814096+0000","last_fullsized":"2024-09-20T20:35:07.814096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-09-20T20:35:07.813803+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-09-20T20:35:07.813803+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.813803+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:43.077510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1030,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:28.486875+0000","last_change":"2024-09-20T20:35:28.486999+0000","last_active":"2024-09-20T20:35:28.486875+0000","last_peered":"2024-09-20T20:35:28.486875+0000","last_clean":"2024-09-20T20:35:28.486875+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:35:28.486875+0000","last_undegraded":"2024-09-20T20:35:28.486875+0000","last_fullsized":"2024-09-20T20:35:28.486875+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'470","last_scrub_stamp":"2024-09-20T20:35:28.486528+0000","last_deep_scrub":"63'470","last_deep_scrub_stamp":"2024-09-20T20:35:28.486528+0000","last_clean_scrub_stamp":"2024-09-20T20:35:28.486528+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:50.606341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":629,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.801774+0000","last_change":"2024-09-20T20:34:59.801835+0000","last_active":"2024-09-20T20:34:59.801774+0000","last_peered":"2024-09-20T20:34:59.801774+0000","last_clean":"2024-09-20T20:34:59.801774+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:59.801774+0000","last_undegraded":"2024-09-20T20:34:59.801774+0000","last_fullsized":"2024-09-20T20:34:59.801774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'435","last_scrub_stamp":"2024-09-20T20:34:59.801577+0000","last_deep_scrub":"63'435","last_deep_scrub_stamp":"2024-09-20T20:34:59.801577+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.801577+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:05.024160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":573,"reported_epoch":95,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-20T20:35:30.813029+0000","last_change":"2024-09-20T20:35:30.812536+0000","last_active":"2024-09-20T20:35:30.813029+0000","last_peered":"2024-09-20T20:35:30.813029+0000","last_clean":"2024-09-20T20:35:30.813029+0000","last_became_active":"2024-09-20T20:34:42.644350+0000","last_became_peered":"2024-09-20T20:34:42.644350+0000","last_unstale":"2024-09-20T20:35:30.813029+0000","last_undegraded":"2024-09-20T20:35:30.813029+0000","last_fullsized":"2024-09-20T20:35:30.813029+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:29:53.967579+0000","last_clean_scrub_stamp":"2024-09-20T20:29:53.967579+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":506,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.453668+0000","last_change":"2024-09-20T20:34:55.453725+0000","last_active":"2024-09-20T20:34:55.453668+0000","last_peered":"2024-09-20T20:34:55.453668+0000","last_clean":"2024-09-20T20:34:55.453668+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:55.453668+0000","last_undegraded":"2024-09-20T20:34:55.453668+0000","last_fullsized":"2024-09-20T20:34:55.453668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'379","last_scrub_stamp":"2024-09-20T20:34:55.453479+0000","last_deep_scrub":"63'379","last_deep_scrub_stamp":"2024-09-20T20:34:55.453479+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.453479+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:08.044870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"95'458","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:22.810850+0000","last_change":"2024-09-20T20:35:22.810920+0000","last_active":"2024-09-20T20:35:22.810850+0000","last_peered":"2024-09-20T20:35:22.810850+0000","last_clean":"2024-09-20T20:35:22.810850+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:35:22.810850+0000","last_undegraded":"2024-09-20T20:35:22.810850+0000","last_fullsized":"2024-09-20T20:35:22.810850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'458","last_scrub_stamp":"2024-09-20T20:35:22.810660+0000","last_deep_scrub":"95'458","last_deep_scrub_stamp":"2024-09-20T20:35:22.810660+0000","last_clean_scrub_stamp":"2024-09-20T20:35:22.810660+0000","objects_scrubbed":4,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:54:00.214577+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":544,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.559888+0000","last_change":"2024-09-20T20:35:07.559949+0000","last_active":"2024-09-20T20:35:07.559888+0000","last_peered":"2024-09-20T20:35:07.559888+0000","last_clean":"2024-09-20T20:35:07.559888+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:35:07.559888+0000","last_undegraded":"2024-09-20T20:35:07.559888+0000","last_fullsized":"2024-09-20T20:35:07.559888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-09-20T20:35:07.559690+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-09-20T20:35:07.559690+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.559690+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:26:18.883403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.814543+0000","last_change":"2024-09-20T20:34:58.814606+0000","last_active":"2024-09-20T20:34:58.814543+0000","last_peered":"2024-09-20T20:34:58.814543+0000","last_clean":"2024-09-20T20:34:58.814543+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:58.814543+0000","last_undegraded":"2024-09-20T20:34:58.814543+0000","last_fullsized":"2024-09-20T20:34:58.814543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'56","last_scrub_stamp":"2024-09-20T20:34:58.814346+0000","last_deep_scrub":"63'56","last_deep_scrub_stamp":"2024-09-20T20:34:58.814346+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.814346+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:56.601755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1012,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:23.991849+0000","last_change":"2024-09-20T20:35:23.991910+0000","last_active":"2024-09-20T20:35:23.991849+0000","last_peered":"2024-09-20T20:35:23.991849+0000","last_clean":"2024-09-20T20:35:23.991849+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:35:23.991849+0000","last_undegraded":"2024-09-20T20:35:23.991849+0000","last_fullsized":"2024-09-20T20:35:23.991849+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'440","last_scrub_stamp":"2024-09-20T20:35:23.991644+0000","last_deep_scrub":"63'440","last_deep_scrub_stamp":"2024-09-20T20:35:23.991644+0000","last_clean_scrub_stamp":"2024-09-20T20:35:23.991644+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:46.465620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":249,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:19.637837+0000","last_change":"2024-09-20T20:35:19.637897+0000","last_active":"2024-09-20T20:35:19.637837+0000","last_peered":"2024-09-20T20:35:19.637837+0000","last_clean":"2024-09-20T20:35:19.637837+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:35:19.637837+0000","last_undegraded":"2024-09-20T20:35:19.637837+0000","last_fullsized":"2024-09-20T20:35:19.637837+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'64","last_scrub_stamp":"2024-09-20T20:35:19.637617+0000","last_deep_scrub":"63'64","last_deep_scrub_stamp":"2024-09-20T20:35:19.637617+0000","last_clean_scrub_stamp":"2024-09-20T20:35:19.637617+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:00.072115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":953,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:25.957430+0000","last_change":"2024-09-20T20:35:25.957491+0000","last_active":"2024-09-20T20:35:25.957430+0000","last_peered":"2024-09-20T20:35:25.957430+0000","last_clean":"2024-09-20T20:35:25.957430+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:35:25.957430+0000","last_undegraded":"2024-09-20T20:35:25.957430+0000","last_fullsized":"2024-09-20T20:35:25.957430+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-09-20T20:35:25.957238+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-09-20T20:35:25.957238+0000","last_clean_scrub_stamp":"2024-09-20T20:35:25.957238+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:32.300193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"95'57","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:17.729002+0000","last_change":"2024-09-20T20:35:17.729163+0000","last_active":"2024-09-20T20:35:17.729002+0000","last_peered":"2024-09-20T20:35:17.729002+0000","last_clean":"2024-09-20T20:35:17.729002+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:35:17.729002+0000","last_undegraded":"2024-09-20T20:35:17.729002+0000","last_fullsized":"2024-09-20T20:35:17.729002+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'57","last_scrub_stamp":"2024-09-20T20:35:17.728780+0000","last_deep_scrub":"95'57","last_deep_scrub_stamp":"2024-09-20T20:35:17.728780+0000","last_clean_scrub_stamp":"2024-09-20T20:35:17.728780+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:31.633093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'141","reported_seq":228,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.935706+0000","last_change":"2024-09-20T20:35:00.935774+0000","last_active":"2024-09-20T20:35:00.935706+0000","last_peered":"2024-09-20T20:35:00.935706+0000","last_clean":"2024-09-20T20:35:00.935706+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:35:00.935706+0000","last_undegraded":"2024-09-20T20:35:00.935706+0000","last_fullsized":"2024-09-20T20:35:00.935706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'141","last_scrub_stamp":"2024-09-20T20:35:00.935520+0000","last_deep_scrub":"95'141","last_deep_scrub_stamp":"2024-09-20T20:35:00.935520+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.935520+0000","objects_scrubbed":2,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:38:04.884983+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":917,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.614980+0000","last_change":"2024-09-20T20:35:04.615157+0000","last_active":"2024-09-20T20:35:04.614980+0000","last_peered":"2024-09-20T20:35:04.614980+0000","last_clean":"2024-09-20T20:35:04.614980+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:35:04.614980+0000","last_undegraded":"2024-09-20T20:35:04.614980+0000","last_fullsized":"2024-09-20T20:35:04.614980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'398","last_scrub_stamp":"2024-09-20T20:35:04.614732+0000","last_deep_scrub":"63'398","last_deep_scrub_stamp":"2024-09-20T20:35:04.614732+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.614732+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:13.018609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"95'265","reported_seq":450,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:18.636154+0000","last_change":"2024-09-20T20:35:18.636224+0000","last_active":"2024-09-20T20:35:18.636154+0000","last_peered":"2024-09-20T20:35:18.636154+0000","last_clean":"2024-09-20T20:35:18.636154+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:35:18.636154+0000","last_undegraded":"2024-09-20T20:35:18.636154+0000","last_fullsized":"2024-09-20T20:35:18.636154+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'265","last_scrub_stamp":"2024-09-20T20:35:18.635958+0000","last_deep_scrub":"95'265","last_deep_scrub_stamp":"2024-09-20T20:35:18.635958+0000","last_clean_scrub_stamp":"2024-09-20T20:35:18.635958+0000","objects_scrubbed":2,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:14.108873+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:21.611746+0000","last_change":"2024-09-20T20:35:21.611878+0000","last_active":"2024-09-20T20:35:21.611746+0000","last_peered":"2024-09-20T20:35:21.611746+0000","last_clean":"2024-09-20T20:35:21.611746+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:35:21.611746+0000","last_undegraded":"2024-09-20T20:35:21.611746+0000","last_fullsized":"2024-09-20T20:35:21.611746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-09-20T20:35:21.611408+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-09-20T20:35:21.611408+0000","last_clean_scrub_stamp":"2024-09-20T20:35:21.611408+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:43:09.456131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"95'454","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:21.834224+0000","last_change":"2024-09-20T20:35:21.834420+0000","last_active":"2024-09-20T20:35:21.834224+0000","last_peered":"2024-09-20T20:35:21.834224+0000","last_clean":"2024-09-20T20:35:21.834224+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:35:21.834224+0000","last_undegraded":"2024-09-20T20:35:21.834224+0000","last_fullsized":"2024-09-20T20:35:21.834224+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'454","last_scrub_stamp":"2024-09-20T20:35:21.833992+0000","last_deep_scrub":"95'454","last_deep_scrub_stamp":"2024-09-20T20:35:21.833992+0000","last_clean_scrub_stamp":"2024-09-20T20:35:21.833992+0000","objects_scrubbed":2,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:48:55.953898+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":644,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:53.819376+0000","last_change":"2024-09-20T20:34:53.819439+0000","last_active":"2024-09-20T20:34:53.819376+0000","last_peered":"2024-09-20T20:34:53.819376+0000","last_clean":"2024-09-20T20:34:53.819376+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:53.819376+0000","last_undegraded":"2024-09-20T20:34:53.819376+0000","last_fullsized":"2024-09-20T20:34:53.819376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-09-20T20:34:53.819178+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-09-20T20:34:53.819178+0000","last_clean_scrub_stamp":"2024-09-20T20:34:53.819178+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:55.658671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:19.786158+0000","last_change":"2024-09-20T20:35:19.786297+0000","last_active":"2024-09-20T20:35:19.786158+0000","last_peered":"2024-09-20T20:35:19.786158+0000","last_clean":"2024-09-20T20:35:19.786158+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:35:19.786158+0000","last_undegraded":"2024-09-20T20:35:19.786158+0000","last_fullsized":"2024-09-20T20:35:19.786158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'58","last_scrub_stamp":"2024-09-20T20:35:19.785925+0000","last_deep_scrub":"63'58","last_deep_scrub_stamp":"2024-09-20T20:35:19.785925+0000","last_clean_scrub_stamp":"2024-09-20T20:35:19.785925+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:32.192350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1083,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:18.893430+0000","last_change":"2024-09-20T20:35:18.893489+0000","last_active":"2024-09-20T20:35:18.893430+0000","last_peered":"2024-09-20T20:35:18.893430+0000","last_clean":"2024-09-20T20:35:18.893430+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:35:18.893430+0000","last_undegraded":"2024-09-20T20:35:18.893430+0000","last_fullsized":"2024-09-20T20:35:18.893430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'458","last_scrub_stamp":"2024-09-20T20:35:18.893238+0000","last_deep_scrub":"63'458","last_deep_scrub_stamp":"2024-09-20T20:35:18.893238+0000","last_clean_scrub_stamp":"2024-09-20T20:35:18.893238+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:05:11.317036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"95'198","reported_seq":389,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.873232+0000","last_change":"2024-09-20T20:35:06.873412+0000","last_active":"2024-09-20T20:35:06.873232+0000","last_peered":"2024-09-20T20:35:06.873232+0000","last_clean":"2024-09-20T20:35:06.873232+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:35:06.873232+0000","last_undegraded":"2024-09-20T20:35:06.873232+0000","last_fullsized":"2024-09-20T20:35:06.873232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'198","last_scrub_stamp":"2024-09-20T20:35:06.873016+0000","last_deep_scrub":"95'198","last_deep_scrub_stamp":"2024-09-20T20:35:06.873016+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.873016+0000","objects_scrubbed":3,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:02.462362+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.889637+0000","last_change":"2024-09-20T20:34:59.889698+0000","last_active":"2024-09-20T20:34:59.889637+0000","last_peered":"2024-09-20T20:34:59.889637+0000","last_clean":"2024-09-20T20:34:59.889637+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:59.889637+0000","last_undegraded":"2024-09-20T20:34:59.889637+0000","last_fullsized":"2024-09-20T20:34:59.889637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-09-20T20:34:59.889432+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-09-20T20:34:59.889432+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.889432+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:31.749238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"95'137","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.951254+0000","last_change":"2024-09-20T20:35:02.951316+0000","last_active":"2024-09-20T20:35:02.951254+0000","last_peered":"2024-09-20T20:35:02.951254+0000","last_clean":"2024-09-20T20:35:02.951254+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:35:02.951254+0000","last_undegraded":"2024-09-20T20:35:02.951254+0000","last_fullsized":"2024-09-20T20:35:02.951254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'137","last_scrub_stamp":"2024-09-20T20:35:02.951061+0000","last_deep_scrub":"95'137","last_deep_scrub_stamp":"2024-09-20T20:35:02.951061+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.951061+0000","objects_scrubbed":1,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:41.086825+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:25.760538+0000","last_change":"2024-09-20T20:35:25.760596+0000","last_active":"2024-09-20T20:35:25.760538+0000","last_peered":"2024-09-20T20:35:25.760538+0000","last_clean":"2024-09-20T20:35:25.760538+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:35:25.760538+0000","last_undegraded":"2024-09-20T20:35:25.760538+0000","last_fullsized":"2024-09-20T20:35:25.760538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-09-20T20:35:25.760350+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-09-20T20:35:25.760350+0000","last_clean_scrub_stamp":"2024-09-20T20:35:25.760350+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:52.991686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.599787+0000","last_change":"2024-09-20T20:35:05.599849+0000","last_active":"2024-09-20T20:35:05.599787+0000","last_peered":"2024-09-20T20:35:05.599787+0000","last_clean":"2024-09-20T20:35:05.599787+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:35:05.599787+0000","last_undegraded":"2024-09-20T20:35:05.599787+0000","last_fullsized":"2024-09-20T20:35:05.599787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'51","last_scrub_stamp":"2024-09-20T20:35:05.599586+0000","last_deep_scrub":"63'51","last_deep_scrub_stamp":"2024-09-20T20:35:05.599586+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.599586+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:53.756207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.965721+0000","last_change":"2024-09-20T20:35:01.965786+0000","last_active":"2024-09-20T20:35:01.965721+0000","last_peered":"2024-09-20T20:35:01.965721+0000","last_clean":"2024-09-20T20:35:01.965721+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:35:01.965721+0000","last_undegraded":"2024-09-20T20:35:01.965721+0000","last_fullsized":"2024-09-20T20:35:01.965721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'369","last_scrub_stamp":"2024-09-20T20:35:01.965520+0000","last_deep_scrub":"63'369","last_deep_scrub_stamp":"2024-09-20T20:35:01.965520+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.965520+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.253421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"95'482","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:13.594309+0000","last_change":"2024-09-20T20:35:13.594372+0000","last_active":"2024-09-20T20:35:13.594309+0000","last_peered":"2024-09-20T20:35:13.594309+0000","last_clean":"2024-09-20T20:35:13.594309+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:35:13.594309+0000","last_undegraded":"2024-09-20T20:35:13.594309+0000","last_fullsized":"2024-09-20T20:35:13.594309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'482","last_scrub_stamp":"2024-09-20T20:35:13.594117+0000","last_deep_scrub":"95'482","last_deep_scrub_stamp":"2024-09-20T20:35:13.594117+0000","last_clean_scrub_stamp":"2024-09-20T20:35:13.594117+0000","objects_scrubbed":1,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:09:27.225814+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":606,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.795657+0000","last_change":"2024-09-20T20:34:57.795721+0000","last_active":"2024-09-20T20:34:57.795657+0000","last_peered":"2024-09-20T20:34:57.795657+0000","last_clean":"2024-09-20T20:34:57.795657+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:57.795657+0000","last_undegraded":"2024-09-20T20:34:57.795657+0000","last_fullsized":"2024-09-20T20:34:57.795657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'396","last_scrub_stamp":"2024-09-20T20:34:57.795452+0000","last_deep_scrub":"63'396","last_deep_scrub_stamp":"2024-09-20T20:34:57.795452+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.795452+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:24.773347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"95'159","reported_seq":364,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:16.702400+0000","last_change":"2024-09-20T20:35:16.702473+0000","last_active":"2024-09-20T20:35:16.702400+0000","last_peered":"2024-09-20T20:35:16.702400+0000","last_clean":"2024-09-20T20:35:16.702400+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:35:16.702400+0000","last_undegraded":"2024-09-20T20:35:16.702400+0000","last_fullsized":"2024-09-20T20:35:16.702400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'159","last_scrub_stamp":"2024-09-20T20:35:16.702204+0000","last_deep_scrub":"95'159","last_deep_scrub_stamp":"2024-09-20T20:35:16.702204+0000","last_clean_scrub_stamp":"2024-09-20T20:35:16.702204+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:41.502501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":103,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:20.762656+0000","last_change":"2024-09-20T20:35:20.762716+0000","last_active":"2024-09-20T20:35:20.762656+0000","last_peered":"2024-09-20T20:35:20.762656+0000","last_clean":"2024-09-20T20:35:20.762656+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:35:20.762656+0000","last_undegraded":"2024-09-20T20:35:20.762656+0000","last_fullsized":"2024-09-20T20:35:20.762656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T20:35:20.762472+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T20:35:20.762472+0000","last_clean_scrub_stamp":"2024-09-20T20:35:20.762472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:34.627832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"95'562","reported_seq":739,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:15.907240+0000","last_change":"2024-09-20T20:35:15.907413+0000","last_active":"2024-09-20T20:35:15.907240+0000","last_peered":"2024-09-20T20:35:15.907240+0000","last_clean":"2024-09-20T20:35:15.907240+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:35:15.907240+0000","last_undegraded":"2024-09-20T20:35:15.907240+0000","last_fullsized":"2024-09-20T20:35:15.907240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'562","last_scrub_stamp":"2024-09-20T20:35:15.907014+0000","last_deep_scrub":"95'562","last_deep_scrub_stamp":"2024-09-20T20:35:15.907014+0000","last_clean_scrub_stamp":"2024-09-20T20:35:15.907014+0000","objects_scrubbed":2,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:09:29.538711+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":605,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.876626+0000","last_change":"2024-09-20T20:34:57.876683+0000","last_active":"2024-09-20T20:34:57.876626+0000","last_peered":"2024-09-20T20:34:57.876626+0000","last_clean":"2024-09-20T20:34:57.876626+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:57.876626+0000","last_undegraded":"2024-09-20T20:34:57.876626+0000","last_fullsized":"2024-09-20T20:34:57.876626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'426","last_scrub_stamp":"2024-09-20T20:34:57.876414+0000","last_deep_scrub":"63'426","last_deep_scrub_stamp":"2024-09-20T20:34:57.876414+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.876414+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:35.614386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:18.770316+0000","last_change":"2024-09-20T20:35:18.770393+0000","last_active":"2024-09-20T20:35:18.770316+0000","last_peered":"2024-09-20T20:35:18.770316+0000","last_clean":"2024-09-20T20:35:18.770316+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:35:18.770316+0000","last_undegraded":"2024-09-20T20:35:18.770316+0000","last_fullsized":"2024-09-20T20:35:18.770316+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:18.770125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:18.770125+0000","last_clean_scrub_stamp":"2024-09-20T20:35:18.770125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:33.871589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"95'128","reported_seq":382,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.934411+0000","last_change":"2024-09-20T20:35:04.934480+0000","last_active":"2024-09-20T20:35:04.934411+0000","last_peered":"2024-09-20T20:35:04.934411+0000","last_clean":"2024-09-20T20:35:04.934411+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:35:04.934411+0000","last_undegraded":"2024-09-20T20:35:04.934411+0000","last_fullsized":"2024-09-20T20:35:04.934411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'128","last_scrub_stamp":"2024-09-20T20:35:04.934220+0000","last_deep_scrub":"95'128","last_deep_scrub_stamp":"2024-09-20T20:35:04.934220+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.934220+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:46.935126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.571536+0000","last_change":"2024-09-20T20:35:01.571597+0000","last_active":"2024-09-20T20:35:01.571536+0000","last_peered":"2024-09-20T20:35:01.571536+0000","last_clean":"2024-09-20T20:35:01.571536+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:35:01.571536+0000","last_undegraded":"2024-09-20T20:35:01.571536+0000","last_fullsized":"2024-09-20T20:35:01.571536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'440","last_scrub_stamp":"2024-09-20T20:35:01.571344+0000","last_deep_scrub":"63'440","last_deep_scrub_stamp":"2024-09-20T20:35:01.571344+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.571344+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:13.494135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:10.801854+0000","last_change":"2024-09-20T20:35:10.801904+0000","last_active":"2024-09-20T20:35:10.801854+0000","last_peered":"2024-09-20T20:35:10.801854+0000","last_clean":"2024-09-20T20:35:10.801854+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:35:10.801854+0000","last_undegraded":"2024-09-20T20:35:10.801854+0000","last_fullsized":"2024-09-20T20:35:10.801854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:10.801655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:10.801655+0000","last_clean_scrub_stamp":"2024-09-20T20:35:10.801655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:28.256956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'324","reported_seq":416,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.646615+0000","last_change":"2024-09-20T20:35:02.646762+0000","last_active":"2024-09-20T20:35:02.646615+0000","last_peered":"2024-09-20T20:35:02.646615+0000","last_clean":"2024-09-20T20:35:02.646615+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:35:02.646615+0000","last_undegraded":"2024-09-20T20:35:02.646615+0000","last_fullsized":"2024-09-20T20:35:02.646615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'324","last_scrub_stamp":"2024-09-20T20:35:02.646394+0000","last_deep_scrub":"95'324","last_deep_scrub_stamp":"2024-09-20T20:35:02.646394+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.646394+0000","objects_scrubbed":2,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:13.258717+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.842059+0000","last_change":"2024-09-20T20:34:55.842119+0000","last_active":"2024-09-20T20:34:55.842059+0000","last_peered":"2024-09-20T20:34:55.842059+0000","last_clean":"2024-09-20T20:34:55.842059+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:55.842059+0000","last_undegraded":"2024-09-20T20:34:55.842059+0000","last_fullsized":"2024-09-20T20:34:55.842059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'346","last_scrub_stamp":"2024-09-20T20:34:55.841867+0000","last_deep_scrub":"63'346","last_deep_scrub_stamp":"2024-09-20T20:34:55.841867+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.841867+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:36.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":104,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:14.795295+0000","last_change":"2024-09-20T20:35:14.795357+0000","last_active":"2024-09-20T20:35:14.795295+0000","last_peered":"2024-09-20T20:35:14.795295+0000","last_clean":"2024-09-20T20:35:14.795295+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:35:14.795295+0000","last_undegraded":"2024-09-20T20:35:14.795295+0000","last_fullsized":"2024-09-20T20:35:14.795295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T20:35:14.795108+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T20:35:14.795108+0000","last_clean_scrub_stamp":"2024-09-20T20:35:14.795108+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:57.807959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:12.793541+0000","last_change":"2024-09-20T20:35:12.793601+0000","last_active":"2024-09-20T20:35:12.793541+0000","last_peered":"2024-09-20T20:35:12.793541+0000","last_clean":"2024-09-20T20:35:12.793541+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:35:12.793541+0000","last_undegraded":"2024-09-20T20:35:12.793541+0000","last_fullsized":"2024-09-20T20:35:12.793541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'62","last_scrub_stamp":"2024-09-20T20:35:12.793345+0000","last_deep_scrub":"63'62","last_deep_scrub_stamp":"2024-09-20T20:35:12.793345+0000","last_clean_scrub_stamp":"2024-09-20T20:35:12.793345+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:30.765371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.889678+0000","last_change":"2024-09-20T20:35:05.889736+0000","last_active":"2024-09-20T20:35:05.889678+0000","last_peered":"2024-09-20T20:35:05.889678+0000","last_clean":"2024-09-20T20:35:05.889678+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:35:05.889678+0000","last_undegraded":"2024-09-20T20:35:05.889678+0000","last_fullsized":"2024-09-20T20:35:05.889678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-09-20T20:35:05.889481+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-09-20T20:35:05.889481+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.889481+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:56.476099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"95'265","reported_seq":337,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.910010+0000","last_change":"2024-09-20T20:35:08.910079+0000","last_active":"2024-09-20T20:35:08.910010+0000","last_peered":"2024-09-20T20:35:08.910010+0000","last_clean":"2024-09-20T20:35:08.910010+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:35:08.910010+0000","last_undegraded":"2024-09-20T20:35:08.910010+0000","last_fullsized":"2024-09-20T20:35:08.910010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'265","last_scrub_stamp":"2024-09-20T20:35:08.909825+0000","last_deep_scrub":"95'265","last_deep_scrub_stamp":"2024-09-20T20:35:08.909825+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.909825+0000","objects_scrubbed":1,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:41.695165+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:12.800273+0000","last_change":"2024-09-20T20:35:12.800330+0000","last_active":"2024-09-20T20:35:12.800273+0000","last_peered":"2024-09-20T20:35:12.800273+0000","last_clean":"2024-09-20T20:35:12.800273+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:35:12.800273+0000","last_undegraded":"2024-09-20T20:35:12.800273+0000","last_fullsized":"2024-09-20T20:35:12.800273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:12.800079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:12.800079+0000","last_clean_scrub_stamp":"2024-09-20T20:35:12.800079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:40:38.092735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":851,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:23.586691+0000","last_change":"2024-09-20T20:35:23.586754+0000","last_active":"2024-09-20T20:35:23.586691+0000","last_peered":"2024-09-20T20:35:23.586691+0000","last_clean":"2024-09-20T20:35:23.586691+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:35:23.586691+0000","last_undegraded":"2024-09-20T20:35:23.586691+0000","last_fullsized":"2024-09-20T20:35:23.586691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'351","last_scrub_stamp":"2024-09-20T20:35:23.586483+0000","last_deep_scrub":"63'351","last_deep_scrub_stamp":"2024-09-20T20:35:23.586483+0000","last_clean_scrub_stamp":"2024-09-20T20:35:23.586483+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:34:39.974172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:14.818862+0000","last_change":"2024-09-20T20:35:14.818921+0000","last_active":"2024-09-20T20:35:14.818862+0000","last_peered":"2024-09-20T20:35:14.818862+0000","last_clean":"2024-09-20T20:35:14.818862+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:35:14.818862+0000","last_undegraded":"2024-09-20T20:35:14.818862+0000","last_fullsized":"2024-09-20T20:35:14.818862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'56","last_scrub_stamp":"2024-09-20T20:35:14.818660+0000","last_deep_scrub":"63'56","last_deep_scrub_stamp":"2024-09-20T20:35:14.818660+0000","last_clean_scrub_stamp":"2024-09-20T20:35:14.818660+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:38:20.860573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.493357+0000","last_change":"2024-09-20T20:34:57.493408+0000","last_active":"2024-09-20T20:34:57.493357+0000","last_peered":"2024-09-20T20:34:57.493357+0000","last_clean":"2024-09-20T20:34:57.493357+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:57.493357+0000","last_undegraded":"2024-09-20T20:34:57.493357+0000","last_fullsized":"2024-09-20T20:34:57.493357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:34:57.493161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:34:57.493161+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.493161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:00.107933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":907,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.566349+0000","last_change":"2024-09-20T20:35:08.566407+0000","last_active":"2024-09-20T20:35:08.566349+0000","last_peered":"2024-09-20T20:35:08.566349+0000","last_clean":"2024-09-20T20:35:08.566349+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:35:08.566349+0000","last_undegraded":"2024-09-20T20:35:08.566349+0000","last_fullsized":"2024-09-20T20:35:08.566349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'391","last_scrub_stamp":"2024-09-20T20:35:08.566148+0000","last_deep_scrub":"63'391","last_deep_scrub_stamp":"2024-09-20T20:35:08.566148+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.566148+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:26.021449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"95'65","reported_seq":242,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:17.892112+0000","last_change":"2024-09-20T20:35:17.892177+0000","last_active":"2024-09-20T20:35:17.892112+0000","last_peered":"2024-09-20T20:35:17.892112+0000","last_clean":"2024-09-20T20:35:17.892112+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:35:17.892112+0000","last_undegraded":"2024-09-20T20:35:17.892112+0000","last_fullsized":"2024-09-20T20:35:17.892112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'65","last_scrub_stamp":"2024-09-20T20:35:17.891923+0000","last_deep_scrub":"95'65","last_deep_scrub_stamp":"2024-09-20T20:35:17.891923+0000","last_clean_scrub_stamp":"2024-09-20T20:35:17.891923+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:34:15.855298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:11.849580+0000","last_change":"2024-09-20T20:35:11.849633+0000","last_active":"2024-09-20T20:35:11.849580+0000","last_peered":"2024-09-20T20:35:11.849580+0000","last_clean":"2024-09-20T20:35:11.849580+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:35:11.849580+0000","last_undegraded":"2024-09-20T20:35:11.849580+0000","last_fullsized":"2024-09-20T20:35:11.849580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:11.849387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:11.849387+0000","last_clean_scrub_stamp":"2024-09-20T20:35:11.849387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:02.332494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1070,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:24.969338+0000","last_change":"2024-09-20T20:35:24.969396+0000","last_active":"2024-09-20T20:35:24.969338+0000","last_peered":"2024-09-20T20:35:24.969338+0000","last_clean":"2024-09-20T20:35:24.969338+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:35:24.969338+0000","last_undegraded":"2024-09-20T20:35:24.969338+0000","last_fullsized":"2024-09-20T20:35:24.969338+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-09-20T20:35:24.969142+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-09-20T20:35:24.969142+0000","last_clean_scrub_stamp":"2024-09-20T20:35:24.969142+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:53:37.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"95'119","reported_seq":308,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.902062+0000","last_change":"2024-09-20T20:35:02.902128+0000","last_active":"2024-09-20T20:35:02.902062+0000","last_peered":"2024-09-20T20:35:02.902062+0000","last_clean":"2024-09-20T20:35:02.902062+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:35:02.902062+0000","last_undegraded":"2024-09-20T20:35:02.902062+0000","last_fullsized":"2024-09-20T20:35:02.902062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'119","last_scrub_stamp":"2024-09-20T20:35:02.901876+0000","last_deep_scrub":"95'119","last_deep_scrub_stamp":"2024-09-20T20:35:02.901876+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.901876+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:48.084840+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:15.743877+0000","last_change":"2024-09-20T20:35:15.743932+0000","last_active":"2024-09-20T20:35:15.743877+0000","last_peered":"2024-09-20T20:35:15.743877+0000","last_clean":"2024-09-20T20:35:15.743877+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:35:15.743877+0000","last_undegraded":"2024-09-20T20:35:15.743877+0000","last_fullsized":"2024-09-20T20:35:15.743877+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:15.743685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:15.743685+0000","last_clean_scrub_stamp":"2024-09-20T20:35:15.743685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:05.884885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.565469+0000","last_change":"2024-09-20T20:35:06.565643+0000","last_active":"2024-09-20T20:35:06.565469+0000","last_peered":"2024-09-20T20:35:06.565469+0000","last_clean":"2024-09-20T20:35:06.565469+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:35:06.565469+0000","last_undegraded":"2024-09-20T20:35:06.565469+0000","last_fullsized":"2024-09-20T20:35:06.565469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-09-20T20:35:06.565243+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-09-20T20:35:06.565243+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.565243+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:52.475888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":583,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.858941+0000","last_change":"2024-09-20T20:35:09.859000+0000","last_active":"2024-09-20T20:35:09.858941+0000","last_peered":"2024-09-20T20:35:09.858941+0000","last_clean":"2024-09-20T20:35:09.858941+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:35:09.858941+0000","last_undegraded":"2024-09-20T20:35:09.858941+0000","last_fullsized":"2024-09-20T20:35:09.858941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'398","last_scrub_stamp":"2024-09-20T20:35:09.858742+0000","last_deep_scrub":"63'398","last_deep_scrub_stamp":"2024-09-20T20:35:09.858742+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.858742+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:20.819085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"95'276","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.954637+0000","last_change":"2024-09-20T20:35:04.954704+0000","last_active":"2024-09-20T20:35:04.954637+0000","last_peered":"2024-09-20T20:35:04.954637+0000","last_clean":"2024-09-20T20:35:04.954637+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:35:04.954637+0000","last_undegraded":"2024-09-20T20:35:04.954637+0000","last_fullsized":"2024-09-20T20:35:04.954637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'276","last_scrub_stamp":"2024-09-20T20:35:04.954461+0000","last_deep_scrub":"95'276","last_deep_scrub_stamp":"2024-09-20T20:35:04.954461+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.954461+0000","objects_scrubbed":6,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:48:52.941148+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":600,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.881172+0000","last_change":"2024-09-20T20:35:03.881232+0000","last_active":"2024-09-20T20:35:03.881172+0000","last_peered":"2024-09-20T20:35:03.881172+0000","last_clean":"2024-09-20T20:35:03.881172+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:35:03.881172+0000","last_undegraded":"2024-09-20T20:35:03.881172+0000","last_fullsized":"2024-09-20T20:35:03.881172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'401","last_scrub_stamp":"2024-09-20T20:35:03.880955+0000","last_deep_scrub":"63'401","last_deep_scrub_stamp":"2024-09-20T20:35:03.880955+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.880955+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:44.587743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"95'91","reported_seq":280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:12.616152+0000","last_change":"2024-09-20T20:35:12.616216+0000","last_active":"2024-09-20T20:35:12.616152+0000","last_peered":"2024-09-20T20:35:12.616152+0000","last_clean":"2024-09-20T20:35:12.616152+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:35:12.616152+0000","last_undegraded":"2024-09-20T20:35:12.616152+0000","last_fullsized":"2024-09-20T20:35:12.616152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'91","last_scrub_stamp":"2024-09-20T20:35:12.615981+0000","last_deep_scrub":"95'91","last_deep_scrub_stamp":"2024-09-20T20:35:12.615981+0000","last_clean_scrub_stamp":"2024-09-20T20:35:12.615981+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:38:18.657894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"95'207","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:10.844990+0000","last_change":"2024-09-20T20:35:10.845053+0000","last_active":"2024-09-20T20:35:10.844990+0000","last_peered":"2024-09-20T20:35:10.844990+0000","last_clean":"2024-09-20T20:35:10.844990+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:35:10.844990+0000","last_undegraded":"2024-09-20T20:35:10.844990+0000","last_fullsized":"2024-09-20T20:35:10.844990+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'207","last_scrub_stamp":"2024-09-20T20:35:10.844799+0000","last_deep_scrub":"95'207","last_deep_scrub_stamp":"2024-09-20T20:35:10.844799+0000","last_clean_scrub_stamp":"2024-09-20T20:35:10.844799+0000","objects_scrubbed":1,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:31:24.782224+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1097,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:19.899611+0000","last_change":"2024-09-20T20:35:19.899677+0000","last_active":"2024-09-20T20:35:19.899611+0000","last_peered":"2024-09-20T20:35:19.899611+0000","last_clean":"2024-09-20T20:35:19.899611+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:35:19.899611+0000","last_undegraded":"2024-09-20T20:35:19.899611+0000","last_fullsized":"2024-09-20T20:35:19.899611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'470","last_scrub_stamp":"2024-09-20T20:35:19.899322+0000","last_deep_scrub":"63'470","last_deep_scrub_stamp":"2024-09-20T20:35:19.899322+0000","last_clean_scrub_stamp":"2024-09-20T20:35:19.899322+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:40.108550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.828455+0000","last_change":"2024-09-20T20:35:00.828517+0000","last_active":"2024-09-20T20:35:00.828455+0000","last_peered":"2024-09-20T20:35:00.828455+0000","last_clean":"2024-09-20T20:35:00.828455+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:35:00.828455+0000","last_undegraded":"2024-09-20T20:35:00.828455+0000","last_fullsized":"2024-09-20T20:35:00.828455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'58","last_scrub_stamp":"2024-09-20T20:35:00.828255+0000","last_deep_scrub":"63'58","last_deep_scrub_stamp":"2024-09-20T20:35:00.828255+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.828255+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:34:06.354325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":685,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.850033+0000","last_change":"2024-09-20T20:35:01.850097+0000","last_active":"2024-09-20T20:35:01.850033+0000","last_peered":"2024-09-20T20:35:01.850033+0000","last_clean":"2024-09-20T20:35:01.850033+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:35:01.850033+0000","last_undegraded":"2024-09-20T20:35:01.850033+0000","last_fullsized":"2024-09-20T20:35:01.850033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'495","last_scrub_stamp":"2024-09-20T20:35:01.849806+0000","last_deep_scrub":"63'495","last_deep_scrub_stamp":"2024-09-20T20:35:01.849806+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.849806+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:56.932808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":855,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:25.549581+0000","last_change":"2024-09-20T20:35:25.549641+0000","last_active":"2024-09-20T20:35:25.549581+0000","last_peered":"2024-09-20T20:35:25.549581+0000","last_clean":"2024-09-20T20:35:25.549581+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:35:25.549581+0000","last_undegraded":"2024-09-20T20:35:25.549581+0000","last_fullsized":"2024-09-20T20:35:25.549581+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'363","last_scrub_stamp":"2024-09-20T20:35:25.549374+0000","last_deep_scrub":"63'363","last_deep_scrub_stamp":"2024-09-20T20:35:25.549374+0000","last_clean_scrub_stamp":"2024-09-20T20:35:25.549374+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:40.289213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"95'701","reported_seq":878,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:13.816803+0000","last_change":"2024-09-20T20:35:13.816873+0000","last_active":"2024-09-20T20:35:13.816803+0000","last_peered":"2024-09-20T20:35:13.816803+0000","last_clean":"2024-09-20T20:35:13.816803+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:35:13.816803+0000","last_undegraded":"2024-09-20T20:35:13.816803+0000","last_fullsized":"2024-09-20T20:35:13.816803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'701","last_scrub_stamp":"2024-09-20T20:35:13.816611+0000","last_deep_scrub":"95'701","last_deep_scrub_stamp":"2024-09-20T20:35:13.816611+0000","last_clean_scrub_stamp":"2024-09-20T20:35:13.816611+0000","objects_scrubbed":2,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:22.773287+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":954,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:21.952829+0000","last_change":"2024-09-20T20:35:21.952890+0000","last_active":"2024-09-20T20:35:21.952829+0000","last_peered":"2024-09-20T20:35:21.952829+0000","last_clean":"2024-09-20T20:35:21.952829+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:35:21.952829+0000","last_undegraded":"2024-09-20T20:35:21.952829+0000","last_fullsized":"2024-09-20T20:35:21.952829+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'399","last_scrub_stamp":"2024-09-20T20:35:21.952627+0000","last_deep_scrub":"63'399","last_deep_scrub_stamp":"2024-09-20T20:35:21.952627+0000","last_clean_scrub_stamp":"2024-09-20T20:35:21.952627+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:57:41.018336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"95'184","reported_seq":375,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.805023+0000","last_change":"2024-09-20T20:35:08.805093+0000","last_active":"2024-09-20T20:35:08.805023+0000","last_peered":"2024-09-20T20:35:08.805023+0000","last_clean":"2024-09-20T20:35:08.805023+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:35:08.805023+0000","last_undegraded":"2024-09-20T20:35:08.805023+0000","last_fullsized":"2024-09-20T20:35:08.805023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'184","last_scrub_stamp":"2024-09-20T20:35:08.804833+0000","last_deep_scrub":"95'184","last_deep_scrub_stamp":"2024-09-20T20:35:08.804833+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.804833+0000","objects_scrubbed":1,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:54.715477+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":975,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:24.593502+0000","last_change":"2024-09-20T20:35:24.593560+0000","last_active":"2024-09-20T20:35:24.593502+0000","last_peered":"2024-09-20T20:35:24.593502+0000","last_clean":"2024-09-20T20:35:24.593502+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:35:24.593502+0000","last_undegraded":"2024-09-20T20:35:24.593502+0000","last_fullsized":"2024-09-20T20:35:24.593502+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'398","last_scrub_stamp":"2024-09-20T20:35:24.593299+0000","last_deep_scrub":"63'398","last_deep_scrub_stamp":"2024-09-20T20:35:24.593299+0000","last_clean_scrub_stamp":"2024-09-20T20:35:24.593299+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:47.609120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"95'239","reported_seq":338,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.583246+0000","last_change":"2024-09-20T20:34:59.583313+0000","last_active":"2024-09-20T20:34:59.583246+0000","last_peered":"2024-09-20T20:34:59.583246+0000","last_clean":"2024-09-20T20:34:59.583246+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:59.583246+0000","last_undegraded":"2024-09-20T20:34:59.583246+0000","last_fullsized":"2024-09-20T20:34:59.583246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'239","last_scrub_stamp":"2024-09-20T20:34:59.583051+0000","last_deep_scrub":"95'239","last_deep_scrub_stamp":"2024-09-20T20:34:59.583051+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.583051+0000","objects_scrubbed":3,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:48.952097+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":547,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.469043+0000","last_change":"2024-09-20T20:34:56.469100+0000","last_active":"2024-09-20T20:34:56.469043+0000","last_peered":"2024-09-20T20:34:56.469043+0000","last_clean":"2024-09-20T20:34:56.469043+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:56.469043+0000","last_undegraded":"2024-09-20T20:34:56.469043+0000","last_fullsized":"2024-09-20T20:34:56.469043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'379","last_scrub_stamp":"2024-09-20T20:34:56.468841+0000","last_deep_scrub":"63'379","last_deep_scrub_stamp":"2024-09-20T20:34:56.468841+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.468841+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:23.446737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"95'61","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:20.641761+0000","last_change":"2024-09-20T20:35:20.641852+0000","last_active":"2024-09-20T20:35:20.641761+0000","last_peered":"2024-09-20T20:35:20.641761+0000","last_clean":"2024-09-20T20:35:20.641761+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:35:20.641761+0000","last_undegraded":"2024-09-20T20:35:20.641761+0000","last_fullsized":"2024-09-20T20:35:20.641761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'61","last_scrub_stamp":"2024-09-20T20:35:20.641539+0000","last_deep_scrub":"95'61","last_deep_scrub_stamp":"2024-09-20T20:35:20.641539+0000","last_clean_scrub_stamp":"2024-09-20T20:35:20.641539+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:12.464449+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.875633+0000","last_change":"2024-09-20T20:34:55.875689+0000","last_active":"2024-09-20T20:34:55.875633+0000","last_peered":"2024-09-20T20:34:55.875633+0000","last_clean":"2024-09-20T20:34:55.875633+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:55.875633+0000","last_undegraded":"2024-09-20T20:34:55.875633+0000","last_fullsized":"2024-09-20T20:34:55.875633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'373","last_scrub_stamp":"2024-09-20T20:34:55.875446+0000","last_deep_scrub":"63'373","last_deep_scrub_stamp":"2024-09-20T20:34:55.875446+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.875446+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:30.314326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"95'201","reported_seq":381,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.882979+0000","last_change":"2024-09-20T20:35:06.883109+0000","last_active":"2024-09-20T20:35:06.882979+0000","last_peered":"2024-09-20T20:35:06.882979+0000","last_clean":"2024-09-20T20:35:06.882979+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:35:06.882979+0000","last_undegraded":"2024-09-20T20:35:06.882979+0000","last_fullsized":"2024-09-20T20:35:06.882979+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'201","last_scrub_stamp":"2024-09-20T20:35:06.882785+0000","last_deep_scrub":"95'201","last_deep_scrub_stamp":"2024-09-20T20:35:06.882785+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.882785+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:20.024822+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:26.779701+0000","last_change":"2024-09-20T20:35:26.779822+0000","last_active":"2024-09-20T20:35:26.779701+0000","last_peered":"2024-09-20T20:35:26.779701+0000","last_clean":"2024-09-20T20:35:26.779701+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:35:26.779701+0000","last_undegraded":"2024-09-20T20:35:26.779701+0000","last_fullsized":"2024-09-20T20:35:26.779701+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'391","last_scrub_stamp":"2024-09-20T20:35:26.779453+0000","last_deep_scrub":"63'391","last_deep_scrub_stamp":"2024-09-20T20:35:26.779453+0000","last_clean_scrub_stamp":"2024-09-20T20:35:26.779453+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:25.013464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"95'275","reported_seq":466,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:10.700864+0000","last_change":"2024-09-20T20:35:10.700944+0000","last_active":"2024-09-20T20:35:10.700864+0000","last_peered":"2024-09-20T20:35:10.700864+0000","last_clean":"2024-09-20T20:35:10.700864+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:35:10.700864+0000","last_undegraded":"2024-09-20T20:35:10.700864+0000","last_fullsized":"2024-09-20T20:35:10.700864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'275","last_scrub_stamp":"2024-09-20T20:35:10.700658+0000","last_deep_scrub":"95'275","last_deep_scrub_stamp":"2024-09-20T20:35:10.700658+0000","last_clean_scrub_stamp":"2024-09-20T20:35:10.700658+0000","objects_scrubbed":4,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:14.131284+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":623,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:11.642339+0000","last_change":"2024-09-20T20:35:11.642400+0000","last_active":"2024-09-20T20:35:11.642339+0000","last_peered":"2024-09-20T20:35:11.642339+0000","last_clean":"2024-09-20T20:35:11.642339+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:35:11.642339+0000","last_undegraded":"2024-09-20T20:35:11.642339+0000","last_fullsized":"2024-09-20T20:35:11.642339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'435","last_scrub_stamp":"2024-09-20T20:35:11.642148+0000","last_deep_scrub":"63'435","last_deep_scrub_stamp":"2024-09-20T20:35:11.642148+0000","last_clean_scrub_stamp":"2024-09-20T20:35:11.642148+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:20.598824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"95'66","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:16.889418+0000","last_change":"2024-09-20T20:35:16.889488+0000","last_active":"2024-09-20T20:35:16.889418+0000","last_peered":"2024-09-20T20:35:16.889418+0000","last_clean":"2024-09-20T20:35:16.889418+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:35:16.889418+0000","last_undegraded":"2024-09-20T20:35:16.889418+0000","last_fullsized":"2024-09-20T20:35:16.889418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'66","last_scrub_stamp":"2024-09-20T20:35:16.889224+0000","last_deep_scrub":"95'66","last_deep_scrub_stamp":"2024-09-20T20:35:16.889224+0000","last_clean_scrub_stamp":"2024-09-20T20:35:16.889224+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:11.227709+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":594,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:28.827736+0000","last_change":"2024-09-20T20:35:28.827850+0000","last_active":"2024-09-20T20:35:28.827736+0000","last_peered":"2024-09-20T20:35:28.827736+0000","last_clean":"2024-09-20T20:35:28.827736+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:35:28.827736+0000","last_undegraded":"2024-09-20T20:35:28.827736+0000","last_fullsized":"2024-09-20T20:35:28.827736+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'448","last_scrub_stamp":"2024-09-20T20:35:28.827510+0000","last_deep_scrub":"63'448","last_deep_scrub_stamp":"2024-09-20T20:35:28.827510+0000","last_clean_scrub_stamp":"2024-09-20T20:35:28.827510+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:59.674024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"95'59","reported_seq":244,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.823156+0000","last_change":"2024-09-20T20:34:56.823234+0000","last_active":"2024-09-20T20:34:56.823156+0000","last_peered":"2024-09-20T20:34:56.823156+0000","last_clean":"2024-09-20T20:34:56.823156+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:56.823156+0000","last_undegraded":"2024-09-20T20:34:56.823156+0000","last_fullsized":"2024-09-20T20:34:56.823156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'59","last_scrub_stamp":"2024-09-20T20:34:56.822965+0000","last_deep_scrub":"95'59","last_deep_scrub_stamp":"2024-09-20T20:34:56.822965+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.822965+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:09.414357+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6675,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6420,"ondisk_log_size":6420,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99324,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272516,"statfs":{"total":96636764160,"available":96535056384,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738443,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104352,"kb_used_data":28816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267488,"statfs":{"total":96636764160,"available":96529907712,"internally_reserved":0,"allocated":29507584,"data_stored":85109907,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743441,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57320,"kb_used_data":23640,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94314520,"statfs":{"total":96636764160,"available":96578068480,"internally_reserved":0,"allocated":24207360,"data_stored":90774901,"data_compressed":13901890,"data_compressed_allocated":16965632,"data_compressed_original":84058112,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:35:35.718 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-20T20:29:53.967579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=264, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=20, tm_hour=20, tm_min=34, tm_sec=52, tm_wday=4, tm_yday=264, tm_isdst=0) 2024-09-20T20:35:35.719 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-20T20:35:55.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-20T20:35:56.035 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:35:56.037 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-20T20:35:56.053 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-09-20T20:35:55.748910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128120423,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3010,"num_read_kb":1511709,"num_write":29392,"num_write_kb":4646185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6689,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33241,"ondisk_log_size":33241,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":260996,"kb_used_data":80404,"kb_used_omap":168,"kb_used_meta":180375,"kb_avail":282854524,"statfs":{"total":289910292480,"available":289643032576,"internally_reserved":0,"allocated":82333696,"data_stored":257450488,"data_compressed":37624865,"data_compressed_allocated":48259072,"data_compressed_original":224894976,"omap_allocated":172984,"internal_metadata":184704072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004336"},"pg_stats":[{"pgid":"4.3f","version":"63'451","reported_seq":642,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.620529+0000","last_change":"2024-09-20T20:35:03.620586+0000","last_active":"2024-09-20T20:35:03.620529+0000","last_peered":"2024-09-20T20:35:03.620529+0000","last_clean":"2024-09-20T20:35:03.620529+0000","last_became_active":"2024-09-20T20:34:26.682957+0000","last_became_peered":"2024-09-20T20:34:26.682957+0000","last_unstale":"2024-09-20T20:35:03.620529+0000","last_undegraded":"2024-09-20T20:35:03.620529+0000","last_fullsized":"2024-09-20T20:35:03.620529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'451","last_scrub_stamp":"2024-09-20T20:35:03.620336+0000","last_deep_scrub":"63'451","last_deep_scrub_stamp":"2024-09-20T20:35:03.620336+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.620336+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:42:44.363780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":38737,"num_write":421,"num_write_kb":150122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"63'427","reported_seq":678,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:16.528148+0000","last_change":"2024-09-20T20:35:16.528214+0000","last_active":"2024-09-20T20:35:16.528148+0000","last_peered":"2024-09-20T20:35:16.528148+0000","last_clean":"2024-09-20T20:35:16.528148+0000","last_became_active":"2024-09-20T20:29:55.009354+0000","last_became_peered":"2024-09-20T20:29:55.009354+0000","last_unstale":"2024-09-20T20:35:16.528148+0000","last_undegraded":"2024-09-20T20:35:16.528148+0000","last_fullsized":"2024-09-20T20:35:16.528148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'427","last_scrub_stamp":"2024-09-20T20:35:16.527952+0000","last_deep_scrub":"63'427","last_deep_scrub_stamp":"2024-09-20T20:35:16.527952+0000","last_clean_scrub_stamp":"2024-09-20T20:35:16.527952+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:51.609881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48797,"num_write":400,"num_write_kb":108299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"63'399","reported_seq":604,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:13.800695+0000","last_change":"2024-09-20T20:35:13.800756+0000","last_active":"2024-09-20T20:35:13.800695+0000","last_peered":"2024-09-20T20:35:13.800695+0000","last_clean":"2024-09-20T20:35:13.800695+0000","last_became_active":"2024-09-20T20:34:28.624307+0000","last_became_peered":"2024-09-20T20:34:28.624307+0000","last_unstale":"2024-09-20T20:35:13.800695+0000","last_undegraded":"2024-09-20T20:35:13.800695+0000","last_fullsized":"2024-09-20T20:35:13.800695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'399","last_scrub_stamp":"2024-09-20T20:35:13.800503+0000","last_deep_scrub":"63'399","last_deep_scrub_stamp":"2024-09-20T20:35:13.800503+0000","last_clean_scrub_stamp":"2024-09-20T20:35:13.800503+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:44:30.478240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22720,"num_write":371,"num_write_kb":80221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"63'396","reported_seq":572,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:23.783179+0000","last_change":"2024-09-20T20:35:23.783236+0000","last_active":"2024-09-20T20:35:23.783179+0000","last_peered":"2024-09-20T20:35:23.783179+0000","last_clean":"2024-09-20T20:35:23.783179+0000","last_became_active":"2024-09-20T20:34:29.623710+0000","last_became_peered":"2024-09-20T20:34:29.623710+0000","last_unstale":"2024-09-20T20:35:23.783179+0000","last_undegraded":"2024-09-20T20:35:23.783179+0000","last_fullsized":"2024-09-20T20:35:23.783179+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'396","last_scrub_stamp":"2024-09-20T20:35:23.782979+0000","last_deep_scrub":"63'396","last_deep_scrub_stamp":"2024-09-20T20:35:23.782979+0000","last_clean_scrub_stamp":"2024-09-20T20:35:23.782979+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:42:35.750041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5316,"num_write":365,"num_write_kb":51695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"63'413","reported_seq":528,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.524666+0000","last_change":"2024-09-20T20:34:58.524725+0000","last_active":"2024-09-20T20:34:58.524666+0000","last_peered":"2024-09-20T20:34:58.524666+0000","last_clean":"2024-09-20T20:34:58.524666+0000","last_became_active":"2024-09-20T20:34:26.684007+0000","last_became_peered":"2024-09-20T20:34:26.684007+0000","last_unstale":"2024-09-20T20:34:58.524666+0000","last_undegraded":"2024-09-20T20:34:58.524666+0000","last_fullsized":"2024-09-20T20:34:58.524666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'413","last_scrub_stamp":"2024-09-20T20:34:58.524458+0000","last_deep_scrub":"63'413","last_deep_scrub_stamp":"2024-09-20T20:34:58.524458+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.524458+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:39.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4053,"num_write":387,"num_write_kb":43112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"63'387","reported_seq":590,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.831717+0000","last_change":"2024-09-20T20:34:56.831778+0000","last_active":"2024-09-20T20:34:56.831717+0000","last_peered":"2024-09-20T20:34:56.831717+0000","last_clean":"2024-09-20T20:34:56.831717+0000","last_became_active":"2024-09-20T20:34:30.627873+0000","last_became_peered":"2024-09-20T20:34:30.627873+0000","last_unstale":"2024-09-20T20:34:56.831717+0000","last_undegraded":"2024-09-20T20:34:56.831717+0000","last_fullsized":"2024-09-20T20:34:56.831717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'387","last_scrub_stamp":"2024-09-20T20:34:56.831519+0000","last_deep_scrub":"63'387","last_deep_scrub_stamp":"2024-09-20T20:34:56.831519+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.831519+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:35.128128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29060,"num_write":367,"num_write_kb":65874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"63'422","reported_seq":635,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:11.841692+0000","last_change":"2024-09-20T20:35:11.841750+0000","last_active":"2024-09-20T20:35:11.841692+0000","last_peered":"2024-09-20T20:35:11.841692+0000","last_clean":"2024-09-20T20:35:11.841692+0000","last_became_active":"2024-09-20T20:34:27.619917+0000","last_became_peered":"2024-09-20T20:34:27.619917+0000","last_unstale":"2024-09-20T20:35:11.841692+0000","last_undegraded":"2024-09-20T20:35:11.841692+0000","last_fullsized":"2024-09-20T20:35:11.841692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'422","last_scrub_stamp":"2024-09-20T20:35:11.841502+0000","last_deep_scrub":"63'422","last_deep_scrub_stamp":"2024-09-20T20:35:11.841502+0000","last_clean_scrub_stamp":"2024-09-20T20:35:11.841502+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:19.045084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":30982,"num_write":392,"num_write_kb":75386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"63'405","reported_seq":593,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:29.864442+0000","last_change":"2024-09-20T20:35:29.864597+0000","last_active":"2024-09-20T20:35:29.864442+0000","last_peered":"2024-09-20T20:35:29.864442+0000","last_clean":"2024-09-20T20:35:29.864442+0000","last_became_active":"2024-09-20T20:34:41.636093+0000","last_became_peered":"2024-09-20T20:34:41.636093+0000","last_unstale":"2024-09-20T20:35:29.864442+0000","last_undegraded":"2024-09-20T20:35:29.864442+0000","last_fullsized":"2024-09-20T20:35:29.864442+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'405","last_scrub_stamp":"2024-09-20T20:35:29.864215+0000","last_deep_scrub":"63'405","last_deep_scrub_stamp":"2024-09-20T20:35:29.864215+0000","last_clean_scrub_stamp":"2024-09-20T20:35:29.864215+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:04:37.627319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29634,"num_write":365,"num_write_kb":116611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'414","reported_seq":596,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.787487+0000","last_change":"2024-09-20T20:35:09.787632+0000","last_active":"2024-09-20T20:35:09.787487+0000","last_peered":"2024-09-20T20:35:09.787487+0000","last_clean":"2024-09-20T20:35:09.787487+0000","last_became_active":"2024-09-20T20:29:54.996887+0000","last_became_peered":"2024-09-20T20:29:54.996887+0000","last_unstale":"2024-09-20T20:35:09.787487+0000","last_undegraded":"2024-09-20T20:35:09.787487+0000","last_fullsized":"2024-09-20T20:35:09.787487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'414","last_scrub_stamp":"2024-09-20T20:35:09.787259+0000","last_deep_scrub":"63'414","last_deep_scrub_stamp":"2024-09-20T20:35:09.787259+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.787259+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:26:21.110972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4861,"num_write":379,"num_write_kb":38334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'395","reported_seq":582,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:15.505027+0000","last_change":"2024-09-20T20:35:15.505087+0000","last_active":"2024-09-20T20:35:15.505027+0000","last_peered":"2024-09-20T20:35:15.505027+0000","last_clean":"2024-09-20T20:35:15.505027+0000","last_became_active":"2024-09-20T20:29:55.009233+0000","last_became_peered":"2024-09-20T20:29:55.009233+0000","last_unstale":"2024-09-20T20:35:15.505027+0000","last_undegraded":"2024-09-20T20:35:15.505027+0000","last_fullsized":"2024-09-20T20:35:15.505027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'395","last_scrub_stamp":"2024-09-20T20:35:15.504832+0000","last_deep_scrub":"63'395","last_deep_scrub_stamp":"2024-09-20T20:35:15.504832+0000","last_clean_scrub_stamp":"2024-09-20T20:35:15.504832+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:17.342033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5554,"num_write":345,"num_write_kb":38523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"63'367","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.871773+0000","last_change":"2024-09-20T20:35:05.871834+0000","last_active":"2024-09-20T20:35:05.871773+0000","last_peered":"2024-09-20T20:35:05.871773+0000","last_clean":"2024-09-20T20:35:05.871773+0000","last_became_active":"2024-09-20T20:34:25.636061+0000","last_became_peered":"2024-09-20T20:34:25.636061+0000","last_unstale":"2024-09-20T20:35:05.871773+0000","last_undegraded":"2024-09-20T20:35:05.871773+0000","last_fullsized":"2024-09-20T20:35:05.871773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'367","last_scrub_stamp":"2024-09-20T20:35:05.871579+0000","last_deep_scrub":"63'367","last_deep_scrub_stamp":"2024-09-20T20:35:05.871579+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.871579+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:13.777294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13255,"num_write":347,"num_write_kb":58512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"63'358","reported_seq":827,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.438828+0000","last_change":"2024-09-20T20:34:54.438886+0000","last_active":"2024-09-20T20:34:54.438828+0000","last_peered":"2024-09-20T20:34:54.438828+0000","last_clean":"2024-09-20T20:34:54.438828+0000","last_became_active":"2024-09-20T20:34:26.686409+0000","last_became_peered":"2024-09-20T20:34:26.686409+0000","last_unstale":"2024-09-20T20:34:54.438828+0000","last_undegraded":"2024-09-20T20:34:54.438828+0000","last_fullsized":"2024-09-20T20:34:54.438828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'358","last_scrub_stamp":"2024-09-20T20:34:54.438632+0000","last_deep_scrub":"63'358","last_deep_scrub_stamp":"2024-09-20T20:34:54.438632+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.438632+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:56.379760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33956,"num_write":336,"num_write_kb":83445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"63'421","reported_seq":548,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.608986+0000","last_change":"2024-09-20T20:35:09.609047+0000","last_active":"2024-09-20T20:35:09.608986+0000","last_peered":"2024-09-20T20:35:09.608986+0000","last_clean":"2024-09-20T20:35:09.608986+0000","last_became_active":"2024-09-20T20:34:26.690370+0000","last_became_peered":"2024-09-20T20:34:26.690370+0000","last_unstale":"2024-09-20T20:35:09.608986+0000","last_undegraded":"2024-09-20T20:35:09.608986+0000","last_fullsized":"2024-09-20T20:35:09.608986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'421","last_scrub_stamp":"2024-09-20T20:35:09.608780+0000","last_deep_scrub":"63'421","last_deep_scrub_stamp":"2024-09-20T20:35:09.608780+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.608780+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:52:29.678874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12891,"num_write":388,"num_write_kb":92355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"63'420","reported_seq":612,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.846395+0000","last_change":"2024-09-20T20:34:54.846453+0000","last_active":"2024-09-20T20:34:54.846395+0000","last_peered":"2024-09-20T20:34:54.846395+0000","last_clean":"2024-09-20T20:34:54.846395+0000","last_became_active":"2024-09-20T20:34:31.631425+0000","last_became_peered":"2024-09-20T20:34:31.631425+0000","last_unstale":"2024-09-20T20:34:54.846395+0000","last_undegraded":"2024-09-20T20:34:54.846395+0000","last_fullsized":"2024-09-20T20:34:54.846395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'420","last_scrub_stamp":"2024-09-20T20:34:54.846176+0000","last_deep_scrub":"63'420","last_deep_scrub_stamp":"2024-09-20T20:34:54.846176+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.846176+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:49:14.810187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18275,"num_write":394,"num_write_kb":79615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"63'443","reported_seq":707,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.844934+0000","last_change":"2024-09-20T20:34:58.844995+0000","last_active":"2024-09-20T20:34:58.844934+0000","last_peered":"2024-09-20T20:34:58.844934+0000","last_clean":"2024-09-20T20:34:58.844934+0000","last_became_active":"2024-09-20T20:34:29.629444+0000","last_became_peered":"2024-09-20T20:34:29.629444+0000","last_unstale":"2024-09-20T20:34:58.844934+0000","last_undegraded":"2024-09-20T20:34:58.844934+0000","last_fullsized":"2024-09-20T20:34:58.844934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-09-20T20:34:58.844737+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-09-20T20:34:58.844737+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.844737+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:13.120956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":52380,"num_write":414,"num_write_kb":113733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"63'430","reported_seq":625,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:27.782100+0000","last_change":"2024-09-20T20:35:27.782224+0000","last_active":"2024-09-20T20:35:27.782100+0000","last_peered":"2024-09-20T20:35:27.782100+0000","last_clean":"2024-09-20T20:35:27.782100+0000","last_became_active":"2024-09-20T20:34:38.622995+0000","last_became_peered":"2024-09-20T20:34:38.622995+0000","last_unstale":"2024-09-20T20:35:27.782100+0000","last_undegraded":"2024-09-20T20:35:27.782100+0000","last_fullsized":"2024-09-20T20:35:27.782100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'430","last_scrub_stamp":"2024-09-20T20:35:27.781800+0000","last_deep_scrub":"63'430","last_deep_scrub_stamp":"2024-09-20T20:35:27.781800+0000","last_clean_scrub_stamp":"2024-09-20T20:35:27.781800+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:20.603426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37111,"num_write":391,"num_write_kb":54663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"63'419","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:54.888686+0000","last_change":"2024-09-20T20:34:54.888803+0000","last_active":"2024-09-20T20:34:54.888686+0000","last_peered":"2024-09-20T20:34:54.888686+0000","last_clean":"2024-09-20T20:34:54.888686+0000","last_became_active":"2024-09-20T20:29:55.014769+0000","last_became_peered":"2024-09-20T20:29:55.014769+0000","last_unstale":"2024-09-20T20:34:54.888686+0000","last_undegraded":"2024-09-20T20:34:54.888686+0000","last_fullsized":"2024-09-20T20:34:54.888686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'419","last_scrub_stamp":"2024-09-20T20:34:54.888376+0000","last_deep_scrub":"63'419","last_deep_scrub_stamp":"2024-09-20T20:34:54.888376+0000","last_clean_scrub_stamp":"2024-09-20T20:34:54.888376+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:52.642419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15158,"num_write":385,"num_write_kb":46528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'418","reported_seq":642,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:14.548767+0000","last_change":"2024-09-20T20:35:14.548827+0000","last_active":"2024-09-20T20:35:14.548767+0000","last_peered":"2024-09-20T20:35:14.548767+0000","last_clean":"2024-09-20T20:35:14.548767+0000","last_became_active":"2024-09-20T20:29:55.001752+0000","last_became_peered":"2024-09-20T20:29:55.001752+0000","last_unstale":"2024-09-20T20:35:14.548767+0000","last_undegraded":"2024-09-20T20:35:14.548767+0000","last_fullsized":"2024-09-20T20:35:14.548767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-09-20T20:35:14.548579+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-09-20T20:35:14.548579+0000","last_clean_scrub_stamp":"2024-09-20T20:35:14.548579+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:37:30.511048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":18236,"num_write":384,"num_write_kb":83543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"63'461","reported_seq":656,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:17.568485+0000","last_change":"2024-09-20T20:35:17.568485+0000","last_active":"2024-09-20T20:35:17.568485+0000","last_peered":"2024-09-20T20:35:17.568485+0000","last_clean":"2024-09-20T20:35:17.568485+0000","last_became_active":"2024-09-20T20:30:59.448903+0000","last_became_peered":"2024-09-20T20:30:59.448903+0000","last_unstale":"2024-09-20T20:35:17.568485+0000","last_undegraded":"2024-09-20T20:35:17.568485+0000","last_fullsized":"2024-09-20T20:35:17.568485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'461","last_scrub_stamp":"2024-09-20T20:35:17.568230+0000","last_deep_scrub":"63'461","last_deep_scrub_stamp":"2024-09-20T20:35:17.568230+0000","last_clean_scrub_stamp":"2024-09-20T20:35:17.568230+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:37.777458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":30725,"num_write":422,"num_write_kb":109613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":624,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.885617+0000","last_change":"2024-09-20T20:35:07.885674+0000","last_active":"2024-09-20T20:35:07.885617+0000","last_peered":"2024-09-20T20:35:07.885617+0000","last_clean":"2024-09-20T20:35:07.885617+0000","last_became_active":"2024-09-20T20:34:26.650755+0000","last_became_peered":"2024-09-20T20:34:26.650755+0000","last_unstale":"2024-09-20T20:35:07.885617+0000","last_undegraded":"2024-09-20T20:35:07.885617+0000","last_fullsized":"2024-09-20T20:35:07.885617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-09-20T20:35:07.885422+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-09-20T20:35:07.885422+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.885422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:32:06.231903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10555,"num_write":400,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"63'395","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.889617+0000","last_change":"2024-09-20T20:35:03.889679+0000","last_active":"2024-09-20T20:35:03.889617+0000","last_peered":"2024-09-20T20:35:03.889617+0000","last_clean":"2024-09-20T20:35:03.889617+0000","last_became_active":"2024-09-20T20:34:24.628442+0000","last_became_peered":"2024-09-20T20:34:24.628442+0000","last_unstale":"2024-09-20T20:35:03.889617+0000","last_undegraded":"2024-09-20T20:35:03.889617+0000","last_fullsized":"2024-09-20T20:35:03.889617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'395","last_scrub_stamp":"2024-09-20T20:35:03.889430+0000","last_deep_scrub":"63'395","last_deep_scrub_stamp":"2024-09-20T20:35:03.889430+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.889430+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:44.178040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9532,"num_write":358,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"63'440","reported_seq":975,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:27.508335+0000","last_change":"2024-09-20T20:35:27.508398+0000","last_active":"2024-09-20T20:35:27.508335+0000","last_peered":"2024-09-20T20:35:27.508335+0000","last_clean":"2024-09-20T20:35:27.508335+0000","last_became_active":"2024-09-20T20:34:39.661860+0000","last_became_peered":"2024-09-20T20:34:39.661860+0000","last_unstale":"2024-09-20T20:35:27.508335+0000","last_undegraded":"2024-09-20T20:35:27.508335+0000","last_fullsized":"2024-09-20T20:35:27.508335+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'440","last_scrub_stamp":"2024-09-20T20:35:27.508137+0000","last_deep_scrub":"63'440","last_deep_scrub_stamp":"2024-09-20T20:35:27.508137+0000","last_clean_scrub_stamp":"2024-09-20T20:35:27.508137+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:03:12.854669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":25380,"num_write":415,"num_write_kb":76083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"63'443","reported_seq":1019,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:22.982657+0000","last_change":"2024-09-20T20:35:22.982723+0000","last_active":"2024-09-20T20:35:22.982657+0000","last_peered":"2024-09-20T20:35:22.982657+0000","last_clean":"2024-09-20T20:35:22.982657+0000","last_became_active":"2024-09-20T20:34:35.658436+0000","last_became_peered":"2024-09-20T20:34:35.658436+0000","last_unstale":"2024-09-20T20:35:22.982657+0000","last_undegraded":"2024-09-20T20:35:22.982657+0000","last_fullsized":"2024-09-20T20:35:22.982657+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-09-20T20:35:22.982444+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-09-20T20:35:22.982444+0000","last_clean_scrub_stamp":"2024-09-20T20:35:22.982444+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:48:53.371866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":32409,"num_write":412,"num_write_kb":129453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'473","reported_seq":703,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.558988+0000","last_change":"2024-09-20T20:35:00.559048+0000","last_active":"2024-09-20T20:35:00.558988+0000","last_peered":"2024-09-20T20:35:00.558988+0000","last_clean":"2024-09-20T20:35:00.558988+0000","last_became_active":"2024-09-20T20:34:26.680612+0000","last_became_peered":"2024-09-20T20:34:26.680612+0000","last_unstale":"2024-09-20T20:35:00.558988+0000","last_undegraded":"2024-09-20T20:35:00.558988+0000","last_fullsized":"2024-09-20T20:35:00.558988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'473","last_scrub_stamp":"2024-09-20T20:35:00.558787+0000","last_deep_scrub":"63'473","last_deep_scrub_stamp":"2024-09-20T20:35:00.558787+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.558787+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:13:32.658097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":65605,"num_write":441,"num_write_kb":93091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"63'423","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:26.537190+0000","last_change":"2024-09-20T20:35:26.537252+0000","last_active":"2024-09-20T20:35:26.537190+0000","last_peered":"2024-09-20T20:35:26.537190+0000","last_clean":"2024-09-20T20:35:26.537190+0000","last_became_active":"2024-09-20T20:34:38.661513+0000","last_became_peered":"2024-09-20T20:34:38.661513+0000","last_unstale":"2024-09-20T20:35:26.537190+0000","last_undegraded":"2024-09-20T20:35:26.537190+0000","last_fullsized":"2024-09-20T20:35:26.537190+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'423","last_scrub_stamp":"2024-09-20T20:35:26.536992+0000","last_deep_scrub":"63'423","last_deep_scrub_stamp":"2024-09-20T20:35:26.536992+0000","last_clean_scrub_stamp":"2024-09-20T20:35:26.536992+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:54.908549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11118,"num_write":403,"num_write_kb":50813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"63'490","reported_seq":1094,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:20.904543+0000","last_change":"2024-09-20T20:35:20.904609+0000","last_active":"2024-09-20T20:35:20.904543+0000","last_peered":"2024-09-20T20:35:20.904543+0000","last_clean":"2024-09-20T20:35:20.904543+0000","last_became_active":"2024-09-20T20:34:33.656584+0000","last_became_peered":"2024-09-20T20:34:33.656584+0000","last_unstale":"2024-09-20T20:35:20.904543+0000","last_undegraded":"2024-09-20T20:35:20.904543+0000","last_fullsized":"2024-09-20T20:35:20.904543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'490","last_scrub_stamp":"2024-09-20T20:35:20.904321+0000","last_deep_scrub":"63'490","last_deep_scrub_stamp":"2024-09-20T20:35:20.904321+0000","last_clean_scrub_stamp":"2024-09-20T20:35:20.904321+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:15.428195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":15111,"num_write":449,"num_write_kb":87882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'416","reported_seq":637,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:24.758928+0000","last_change":"2024-09-20T20:35:24.758989+0000","last_active":"2024-09-20T20:35:24.758928+0000","last_peered":"2024-09-20T20:35:24.758928+0000","last_clean":"2024-09-20T20:35:24.758928+0000","last_became_active":"2024-09-20T20:34:34.627555+0000","last_became_peered":"2024-09-20T20:34:34.627555+0000","last_unstale":"2024-09-20T20:35:24.758928+0000","last_undegraded":"2024-09-20T20:35:24.758928+0000","last_fullsized":"2024-09-20T20:35:24.758928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'416","last_scrub_stamp":"2024-09-20T20:35:24.758737+0000","last_deep_scrub":"63'416","last_deep_scrub_stamp":"2024-09-20T20:35:24.758737+0000","last_clean_scrub_stamp":"2024-09-20T20:35:24.758737+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:38.755058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":39845,"num_write":387,"num_write_kb":88221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"63'392","reported_seq":944,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:22.575697+0000","last_change":"2024-09-20T20:35:22.575755+0000","last_active":"2024-09-20T20:35:22.575697+0000","last_peered":"2024-09-20T20:35:22.575697+0000","last_clean":"2024-09-20T20:35:22.575697+0000","last_became_active":"2024-09-20T20:34:27.655403+0000","last_became_peered":"2024-09-20T20:34:27.655403+0000","last_unstale":"2024-09-20T20:35:22.575697+0000","last_undegraded":"2024-09-20T20:35:22.575697+0000","last_fullsized":"2024-09-20T20:35:22.575697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'392","last_scrub_stamp":"2024-09-20T20:35:22.575539+0000","last_deep_scrub":"63'392","last_deep_scrub_stamp":"2024-09-20T20:35:22.575539+0000","last_clean_scrub_stamp":"2024-09-20T20:35:22.575539+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:53:35.532622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":30857,"num_write":362,"num_write_kb":71304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"63'409","reported_seq":668,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.814096+0000","last_change":"2024-09-20T20:35:07.814229+0000","last_active":"2024-09-20T20:35:07.814096+0000","last_peered":"2024-09-20T20:35:07.814096+0000","last_clean":"2024-09-20T20:35:07.814096+0000","last_became_active":"2024-09-20T20:29:54.996965+0000","last_became_peered":"2024-09-20T20:29:54.996965+0000","last_unstale":"2024-09-20T20:35:07.814096+0000","last_undegraded":"2024-09-20T20:35:07.814096+0000","last_fullsized":"2024-09-20T20:35:07.814096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-09-20T20:35:07.813803+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-09-20T20:35:07.813803+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.813803+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:43.077510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":48336,"num_write":378,"num_write_kb":71933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'470","reported_seq":1030,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:28.486875+0000","last_change":"2024-09-20T20:35:28.486999+0000","last_active":"2024-09-20T20:35:28.486875+0000","last_peered":"2024-09-20T20:35:28.486875+0000","last_clean":"2024-09-20T20:35:28.486875+0000","last_became_active":"2024-09-20T20:34:40.667572+0000","last_became_peered":"2024-09-20T20:34:40.667572+0000","last_unstale":"2024-09-20T20:35:28.486875+0000","last_undegraded":"2024-09-20T20:35:28.486875+0000","last_fullsized":"2024-09-20T20:35:28.486875+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'470","last_scrub_stamp":"2024-09-20T20:35:28.486528+0000","last_deep_scrub":"63'470","last_deep_scrub_stamp":"2024-09-20T20:35:28.486528+0000","last_clean_scrub_stamp":"2024-09-20T20:35:28.486528+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:50.606341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18992,"num_write":430,"num_write_kb":55142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"63'435","reported_seq":629,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.801774+0000","last_change":"2024-09-20T20:34:59.801835+0000","last_active":"2024-09-20T20:34:59.801774+0000","last_peered":"2024-09-20T20:34:59.801774+0000","last_clean":"2024-09-20T20:34:59.801774+0000","last_became_active":"2024-09-20T20:29:54.998585+0000","last_became_peered":"2024-09-20T20:29:54.998585+0000","last_unstale":"2024-09-20T20:34:59.801774+0000","last_undegraded":"2024-09-20T20:34:59.801774+0000","last_fullsized":"2024-09-20T20:34:59.801774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'435","last_scrub_stamp":"2024-09-20T20:34:59.801577+0000","last_deep_scrub":"63'435","last_deep_scrub_stamp":"2024-09-20T20:34:59.801577+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.801577+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:05.024160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16488,"num_write":402,"num_write_kb":73012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'429","reported_seq":578,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:30.816133+0000","last_change":"2024-09-20T20:35:30.816192+0000","last_active":"2024-09-20T20:35:30.816133+0000","last_peered":"2024-09-20T20:35:30.816133+0000","last_clean":"2024-09-20T20:35:30.816133+0000","last_became_active":"2024-09-20T20:34:42.644350+0000","last_became_peered":"2024-09-20T20:34:42.644350+0000","last_unstale":"2024-09-20T20:35:30.816133+0000","last_undegraded":"2024-09-20T20:35:30.816133+0000","last_fullsized":"2024-09-20T20:35:30.816133+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'429","last_scrub_stamp":"2024-09-20T20:35:30.815945+0000","last_deep_scrub":"63'429","last_deep_scrub_stamp":"2024-09-20T20:35:30.815945+0000","last_clean_scrub_stamp":"2024-09-20T20:35:30.815945+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:40.639957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8670,"num_write":398,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"63'379","reported_seq":506,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.453668+0000","last_change":"2024-09-20T20:34:55.453725+0000","last_active":"2024-09-20T20:34:55.453668+0000","last_peered":"2024-09-20T20:34:55.453668+0000","last_clean":"2024-09-20T20:34:55.453668+0000","last_became_active":"2024-09-20T20:34:26.700479+0000","last_became_peered":"2024-09-20T20:34:26.700479+0000","last_unstale":"2024-09-20T20:34:55.453668+0000","last_undegraded":"2024-09-20T20:34:55.453668+0000","last_fullsized":"2024-09-20T20:34:55.453668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'379","last_scrub_stamp":"2024-09-20T20:34:55.453479+0000","last_deep_scrub":"63'379","last_deep_scrub_stamp":"2024-09-20T20:34:55.453479+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.453479+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:08.044870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":8634,"num_write":340,"num_write_kb":34371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"95'458","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:22.810850+0000","last_change":"2024-09-20T20:35:22.810920+0000","last_active":"2024-09-20T20:35:22.810850+0000","last_peered":"2024-09-20T20:35:22.810850+0000","last_clean":"2024-09-20T20:35:22.810850+0000","last_became_active":"2024-09-20T20:34:17.665791+0000","last_became_peered":"2024-09-20T20:34:17.665791+0000","last_unstale":"2024-09-20T20:35:22.810850+0000","last_undegraded":"2024-09-20T20:35:22.810850+0000","last_fullsized":"2024-09-20T20:35:22.810850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'458","last_scrub_stamp":"2024-09-20T20:35:22.810660+0000","last_deep_scrub":"95'458","last_deep_scrub_stamp":"2024-09-20T20:35:22.810660+0000","last_clean_scrub_stamp":"2024-09-20T20:35:22.810660+0000","objects_scrubbed":4,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:54:00.214577+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":399,"num_write_kb":8357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"63'408","reported_seq":544,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:07.559888+0000","last_change":"2024-09-20T20:35:07.559949+0000","last_active":"2024-09-20T20:35:07.559888+0000","last_peered":"2024-09-20T20:35:07.559888+0000","last_clean":"2024-09-20T20:35:07.559888+0000","last_became_active":"2024-09-20T20:34:26.687539+0000","last_became_peered":"2024-09-20T20:34:26.687539+0000","last_unstale":"2024-09-20T20:35:07.559888+0000","last_undegraded":"2024-09-20T20:35:07.559888+0000","last_fullsized":"2024-09-20T20:35:07.559888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-09-20T20:35:07.559690+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-09-20T20:35:07.559690+0000","last_clean_scrub_stamp":"2024-09-20T20:35:07.559690+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:26:18.883403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":11849,"num_write":371,"num_write_kb":63236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"63'56","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:58.814543+0000","last_change":"2024-09-20T20:34:58.814606+0000","last_active":"2024-09-20T20:34:58.814543+0000","last_peered":"2024-09-20T20:34:58.814543+0000","last_clean":"2024-09-20T20:34:58.814543+0000","last_became_active":"2024-09-20T20:34:17.687403+0000","last_became_peered":"2024-09-20T20:34:17.687403+0000","last_unstale":"2024-09-20T20:34:58.814543+0000","last_undegraded":"2024-09-20T20:34:58.814543+0000","last_fullsized":"2024-09-20T20:34:58.814543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'56","last_scrub_stamp":"2024-09-20T20:34:58.814346+0000","last_deep_scrub":"63'56","last_deep_scrub_stamp":"2024-09-20T20:34:58.814346+0000","last_clean_scrub_stamp":"2024-09-20T20:34:58.814346+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:56.601755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'440","reported_seq":1012,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:23.991849+0000","last_change":"2024-09-20T20:35:23.991910+0000","last_active":"2024-09-20T20:35:23.991849+0000","last_peered":"2024-09-20T20:35:23.991849+0000","last_clean":"2024-09-20T20:35:23.991849+0000","last_became_active":"2024-09-20T20:34:37.656125+0000","last_became_peered":"2024-09-20T20:34:37.656125+0000","last_unstale":"2024-09-20T20:35:23.991849+0000","last_undegraded":"2024-09-20T20:35:23.991849+0000","last_fullsized":"2024-09-20T20:35:23.991849+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'440","last_scrub_stamp":"2024-09-20T20:35:23.991644+0000","last_deep_scrub":"63'440","last_deep_scrub_stamp":"2024-09-20T20:35:23.991644+0000","last_clean_scrub_stamp":"2024-09-20T20:35:23.991644+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:46.465620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":16392,"num_write":403,"num_write_kb":63663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"63'64","reported_seq":249,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:19.637837+0000","last_change":"2024-09-20T20:35:19.637897+0000","last_active":"2024-09-20T20:35:19.637837+0000","last_peered":"2024-09-20T20:35:19.637837+0000","last_clean":"2024-09-20T20:35:19.637837+0000","last_became_active":"2024-09-20T20:34:17.676733+0000","last_became_peered":"2024-09-20T20:34:17.676733+0000","last_unstale":"2024-09-20T20:35:19.637837+0000","last_undegraded":"2024-09-20T20:35:19.637837+0000","last_fullsized":"2024-09-20T20:35:19.637837+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'64","last_scrub_stamp":"2024-09-20T20:35:19.637617+0000","last_deep_scrub":"63'64","last_deep_scrub_stamp":"2024-09-20T20:35:19.637617+0000","last_clean_scrub_stamp":"2024-09-20T20:35:19.637617+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:00.072115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"63'408","reported_seq":953,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:25.957430+0000","last_change":"2024-09-20T20:35:25.957491+0000","last_active":"2024-09-20T20:35:25.957430+0000","last_peered":"2024-09-20T20:35:25.957430+0000","last_clean":"2024-09-20T20:35:25.957430+0000","last_became_active":"2024-09-20T20:34:42.676288+0000","last_became_peered":"2024-09-20T20:34:42.676288+0000","last_unstale":"2024-09-20T20:35:25.957430+0000","last_undegraded":"2024-09-20T20:35:25.957430+0000","last_fullsized":"2024-09-20T20:35:25.957430+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-09-20T20:35:25.957238+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-09-20T20:35:25.957238+0000","last_clean_scrub_stamp":"2024-09-20T20:35:25.957238+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:32.300193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32887,"num_write":375,"num_write_kb":104374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"95'57","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:17.729002+0000","last_change":"2024-09-20T20:35:17.729163+0000","last_active":"2024-09-20T20:35:17.729002+0000","last_peered":"2024-09-20T20:35:17.729002+0000","last_clean":"2024-09-20T20:35:17.729002+0000","last_became_active":"2024-09-20T20:34:17.642652+0000","last_became_peered":"2024-09-20T20:34:17.642652+0000","last_unstale":"2024-09-20T20:35:17.729002+0000","last_undegraded":"2024-09-20T20:35:17.729002+0000","last_fullsized":"2024-09-20T20:35:17.729002+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'57","last_scrub_stamp":"2024-09-20T20:35:17.728780+0000","last_deep_scrub":"95'57","last_deep_scrub_stamp":"2024-09-20T20:35:17.728780+0000","last_clean_scrub_stamp":"2024-09-20T20:35:17.728780+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:31.633093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'141","reported_seq":228,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.935706+0000","last_change":"2024-09-20T20:35:00.935774+0000","last_active":"2024-09-20T20:35:00.935706+0000","last_peered":"2024-09-20T20:35:00.935706+0000","last_clean":"2024-09-20T20:35:00.935706+0000","last_became_active":"2024-09-20T20:34:20.798417+0000","last_became_peered":"2024-09-20T20:34:20.798417+0000","last_unstale":"2024-09-20T20:35:00.935706+0000","last_undegraded":"2024-09-20T20:35:00.935706+0000","last_fullsized":"2024-09-20T20:35:00.935706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'141","last_scrub_stamp":"2024-09-20T20:35:00.935520+0000","last_deep_scrub":"95'141","last_deep_scrub_stamp":"2024-09-20T20:35:00.935520+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.935520+0000","objects_scrubbed":2,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:38:04.884983+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"63'398","reported_seq":917,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.614980+0000","last_change":"2024-09-20T20:35:04.615157+0000","last_active":"2024-09-20T20:35:04.614980+0000","last_peered":"2024-09-20T20:35:04.614980+0000","last_clean":"2024-09-20T20:35:04.614980+0000","last_became_active":"2024-09-20T20:34:25.676366+0000","last_became_peered":"2024-09-20T20:34:25.676366+0000","last_unstale":"2024-09-20T20:35:04.614980+0000","last_undegraded":"2024-09-20T20:35:04.614980+0000","last_fullsized":"2024-09-20T20:35:04.614980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'398","last_scrub_stamp":"2024-09-20T20:35:04.614732+0000","last_deep_scrub":"63'398","last_deep_scrub_stamp":"2024-09-20T20:35:04.614732+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.614732+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:13.018609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4128,"num_write":367,"num_write_kb":54547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"95'265","reported_seq":450,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:18.636154+0000","last_change":"2024-09-20T20:35:18.636224+0000","last_active":"2024-09-20T20:35:18.636154+0000","last_peered":"2024-09-20T20:35:18.636154+0000","last_clean":"2024-09-20T20:35:18.636154+0000","last_became_active":"2024-09-20T20:34:17.676590+0000","last_became_peered":"2024-09-20T20:34:17.676590+0000","last_unstale":"2024-09-20T20:35:18.636154+0000","last_undegraded":"2024-09-20T20:35:18.636154+0000","last_fullsized":"2024-09-20T20:35:18.636154+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'265","last_scrub_stamp":"2024-09-20T20:35:18.635958+0000","last_deep_scrub":"95'265","last_deep_scrub_stamp":"2024-09-20T20:35:18.635958+0000","last_clean_scrub_stamp":"2024-09-20T20:35:18.635958+0000","objects_scrubbed":2,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:14.108873+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"63'442","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:21.611746+0000","last_change":"2024-09-20T20:35:21.611878+0000","last_active":"2024-09-20T20:35:21.611746+0000","last_peered":"2024-09-20T20:35:21.611746+0000","last_clean":"2024-09-20T20:35:21.611746+0000","last_became_active":"2024-09-20T20:34:26.685108+0000","last_became_peered":"2024-09-20T20:34:26.685108+0000","last_unstale":"2024-09-20T20:35:21.611746+0000","last_undegraded":"2024-09-20T20:35:21.611746+0000","last_fullsized":"2024-09-20T20:35:21.611746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-09-20T20:35:21.611408+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-09-20T20:35:21.611408+0000","last_clean_scrub_stamp":"2024-09-20T20:35:21.611408+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:43:09.456131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9238,"num_write":412,"num_write_kb":51134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"95'454","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:21.834224+0000","last_change":"2024-09-20T20:35:21.834420+0000","last_active":"2024-09-20T20:35:21.834224+0000","last_peered":"2024-09-20T20:35:21.834224+0000","last_clean":"2024-09-20T20:35:21.834224+0000","last_became_active":"2024-09-20T20:34:17.672757+0000","last_became_peered":"2024-09-20T20:34:17.672757+0000","last_unstale":"2024-09-20T20:35:21.834224+0000","last_undegraded":"2024-09-20T20:35:21.834224+0000","last_fullsized":"2024-09-20T20:35:21.834224+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'454","last_scrub_stamp":"2024-09-20T20:35:21.833992+0000","last_deep_scrub":"95'454","last_deep_scrub_stamp":"2024-09-20T20:35:21.833992+0000","last_clean_scrub_stamp":"2024-09-20T20:35:21.833992+0000","objects_scrubbed":2,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:48:55.953898+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":402,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"63'439","reported_seq":644,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:53.819376+0000","last_change":"2024-09-20T20:34:53.819439+0000","last_active":"2024-09-20T20:34:53.819376+0000","last_peered":"2024-09-20T20:34:53.819376+0000","last_clean":"2024-09-20T20:34:53.819376+0000","last_became_active":"2024-09-20T20:34:32.621958+0000","last_became_peered":"2024-09-20T20:34:32.621958+0000","last_unstale":"2024-09-20T20:34:53.819376+0000","last_undegraded":"2024-09-20T20:34:53.819376+0000","last_fullsized":"2024-09-20T20:34:53.819376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-09-20T20:34:53.819178+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-09-20T20:34:53.819178+0000","last_clean_scrub_stamp":"2024-09-20T20:34:53.819178+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:55.658671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34908,"num_write":404,"num_write_kb":120443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"63'58","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:19.786158+0000","last_change":"2024-09-20T20:35:19.786297+0000","last_active":"2024-09-20T20:35:19.786158+0000","last_peered":"2024-09-20T20:35:19.786158+0000","last_clean":"2024-09-20T20:35:19.786158+0000","last_became_active":"2024-09-20T20:34:17.668282+0000","last_became_peered":"2024-09-20T20:34:17.668282+0000","last_unstale":"2024-09-20T20:35:19.786158+0000","last_undegraded":"2024-09-20T20:35:19.786158+0000","last_fullsized":"2024-09-20T20:35:19.786158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'58","last_scrub_stamp":"2024-09-20T20:35:19.785925+0000","last_deep_scrub":"63'58","last_deep_scrub_stamp":"2024-09-20T20:35:19.785925+0000","last_clean_scrub_stamp":"2024-09-20T20:35:19.785925+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:32.192350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"63'458","reported_seq":1083,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:18.893430+0000","last_change":"2024-09-20T20:35:18.893489+0000","last_active":"2024-09-20T20:35:18.893430+0000","last_peered":"2024-09-20T20:35:18.893430+0000","last_clean":"2024-09-20T20:35:18.893430+0000","last_became_active":"2024-09-20T20:34:21.830883+0000","last_became_peered":"2024-09-20T20:34:21.830883+0000","last_unstale":"2024-09-20T20:35:18.893430+0000","last_undegraded":"2024-09-20T20:35:18.893430+0000","last_fullsized":"2024-09-20T20:35:18.893430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'458","last_scrub_stamp":"2024-09-20T20:35:18.893238+0000","last_deep_scrub":"63'458","last_deep_scrub_stamp":"2024-09-20T20:35:18.893238+0000","last_clean_scrub_stamp":"2024-09-20T20:35:18.893238+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:05:11.317036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":44796,"num_write":423,"num_write_kb":96066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"95'198","reported_seq":389,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.873232+0000","last_change":"2024-09-20T20:35:06.873412+0000","last_active":"2024-09-20T20:35:06.873232+0000","last_peered":"2024-09-20T20:35:06.873232+0000","last_clean":"2024-09-20T20:35:06.873232+0000","last_became_active":"2024-09-20T20:34:20.830016+0000","last_became_peered":"2024-09-20T20:34:20.830016+0000","last_unstale":"2024-09-20T20:35:06.873232+0000","last_undegraded":"2024-09-20T20:35:06.873232+0000","last_fullsized":"2024-09-20T20:35:06.873232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'198","last_scrub_stamp":"2024-09-20T20:35:06.873016+0000","last_deep_scrub":"95'198","last_deep_scrub_stamp":"2024-09-20T20:35:06.873016+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.873016+0000","objects_scrubbed":3,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:32:02.462362+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'439","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.889637+0000","last_change":"2024-09-20T20:34:59.889698+0000","last_active":"2024-09-20T20:34:59.889637+0000","last_peered":"2024-09-20T20:34:59.889637+0000","last_clean":"2024-09-20T20:34:59.889637+0000","last_became_active":"2024-09-20T20:34:22.619606+0000","last_became_peered":"2024-09-20T20:34:22.619606+0000","last_unstale":"2024-09-20T20:34:59.889637+0000","last_undegraded":"2024-09-20T20:34:59.889637+0000","last_fullsized":"2024-09-20T20:34:59.889637+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-09-20T20:34:59.889432+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-09-20T20:34:59.889432+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.889432+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:05:31.749238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4220,"num_write":403,"num_write_kb":38517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"95'137","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.951254+0000","last_change":"2024-09-20T20:35:02.951316+0000","last_active":"2024-09-20T20:35:02.951254+0000","last_peered":"2024-09-20T20:35:02.951254+0000","last_clean":"2024-09-20T20:35:02.951254+0000","last_became_active":"2024-09-20T20:34:20.796934+0000","last_became_peered":"2024-09-20T20:34:20.796934+0000","last_unstale":"2024-09-20T20:35:02.951254+0000","last_undegraded":"2024-09-20T20:35:02.951254+0000","last_fullsized":"2024-09-20T20:35:02.951254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'137","last_scrub_stamp":"2024-09-20T20:35:02.951061+0000","last_deep_scrub":"95'137","last_deep_scrub_stamp":"2024-09-20T20:35:02.951061+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.951061+0000","objects_scrubbed":1,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:43:41.086825+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"63'406","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:25.760538+0000","last_change":"2024-09-20T20:35:25.760596+0000","last_active":"2024-09-20T20:35:25.760538+0000","last_peered":"2024-09-20T20:35:25.760538+0000","last_clean":"2024-09-20T20:35:25.760538+0000","last_became_active":"2024-09-20T20:34:35.628099+0000","last_became_peered":"2024-09-20T20:34:35.628099+0000","last_unstale":"2024-09-20T20:35:25.760538+0000","last_undegraded":"2024-09-20T20:35:25.760538+0000","last_fullsized":"2024-09-20T20:35:25.760538+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-09-20T20:35:25.760350+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-09-20T20:35:25.760350+0000","last_clean_scrub_stamp":"2024-09-20T20:35:25.760350+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:52.991686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":27069,"num_write":379,"num_write_kb":50823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"63'51","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.599787+0000","last_change":"2024-09-20T20:35:05.599849+0000","last_active":"2024-09-20T20:35:05.599787+0000","last_peered":"2024-09-20T20:35:05.599787+0000","last_clean":"2024-09-20T20:35:05.599787+0000","last_became_active":"2024-09-20T20:34:26.683785+0000","last_became_peered":"2024-09-20T20:34:26.683785+0000","last_unstale":"2024-09-20T20:35:05.599787+0000","last_undegraded":"2024-09-20T20:35:05.599787+0000","last_fullsized":"2024-09-20T20:35:05.599787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'51","last_scrub_stamp":"2024-09-20T20:35:05.599586+0000","last_deep_scrub":"63'51","last_deep_scrub_stamp":"2024-09-20T20:35:05.599586+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.599586+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:53.756207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'369","reported_seq":614,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.965721+0000","last_change":"2024-09-20T20:35:01.965786+0000","last_active":"2024-09-20T20:35:01.965721+0000","last_peered":"2024-09-20T20:35:01.965721+0000","last_clean":"2024-09-20T20:35:01.965721+0000","last_became_active":"2024-09-20T20:34:23.624723+0000","last_became_peered":"2024-09-20T20:34:23.624723+0000","last_unstale":"2024-09-20T20:35:01.965721+0000","last_undegraded":"2024-09-20T20:35:01.965721+0000","last_fullsized":"2024-09-20T20:35:01.965721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'369","last_scrub_stamp":"2024-09-20T20:35:01.965520+0000","last_deep_scrub":"63'369","last_deep_scrub_stamp":"2024-09-20T20:35:01.965520+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.965520+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:31.253421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":46246,"num_write":340,"num_write_kb":38480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"95'482","reported_seq":659,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:13.594309+0000","last_change":"2024-09-20T20:35:13.594372+0000","last_active":"2024-09-20T20:35:13.594309+0000","last_peered":"2024-09-20T20:35:13.594309+0000","last_clean":"2024-09-20T20:35:13.594309+0000","last_became_active":"2024-09-20T20:29:53.994659+0000","last_became_peered":"2024-09-20T20:29:53.994659+0000","last_unstale":"2024-09-20T20:35:13.594309+0000","last_undegraded":"2024-09-20T20:35:13.594309+0000","last_fullsized":"2024-09-20T20:35:13.594309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'482","last_scrub_stamp":"2024-09-20T20:35:13.594117+0000","last_deep_scrub":"95'482","last_deep_scrub_stamp":"2024-09-20T20:35:13.594117+0000","last_clean_scrub_stamp":"2024-09-20T20:35:13.594117+0000","objects_scrubbed":1,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:09:27.225814+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":418,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"63'396","reported_seq":606,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.795657+0000","last_change":"2024-09-20T20:34:57.795721+0000","last_active":"2024-09-20T20:34:57.795657+0000","last_peered":"2024-09-20T20:34:57.795657+0000","last_clean":"2024-09-20T20:34:57.795657+0000","last_became_active":"2024-09-20T20:29:55.010247+0000","last_became_peered":"2024-09-20T20:29:55.010247+0000","last_unstale":"2024-09-20T20:34:57.795657+0000","last_undegraded":"2024-09-20T20:34:57.795657+0000","last_fullsized":"2024-09-20T20:34:57.795657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'396","last_scrub_stamp":"2024-09-20T20:34:57.795452+0000","last_deep_scrub":"63'396","last_deep_scrub_stamp":"2024-09-20T20:34:57.795452+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.795452+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:24.773347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18653,"num_write":366,"num_write_kb":66984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"95'159","reported_seq":364,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:16.702400+0000","last_change":"2024-09-20T20:35:16.702473+0000","last_active":"2024-09-20T20:35:16.702400+0000","last_peered":"2024-09-20T20:35:16.702400+0000","last_clean":"2024-09-20T20:35:16.702400+0000","last_became_active":"2024-09-20T20:34:17.639460+0000","last_became_peered":"2024-09-20T20:34:17.639460+0000","last_unstale":"2024-09-20T20:35:16.702400+0000","last_undegraded":"2024-09-20T20:35:16.702400+0000","last_fullsized":"2024-09-20T20:35:16.702400+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'159","last_scrub_stamp":"2024-09-20T20:35:16.702204+0000","last_deep_scrub":"95'159","last_deep_scrub_stamp":"2024-09-20T20:35:16.702204+0000","last_clean_scrub_stamp":"2024-09-20T20:35:16.702204+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:41.502501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":103,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:20.762656+0000","last_change":"2024-09-20T20:35:20.762716+0000","last_active":"2024-09-20T20:35:20.762656+0000","last_peered":"2024-09-20T20:35:20.762656+0000","last_clean":"2024-09-20T20:35:20.762656+0000","last_became_active":"2024-09-20T20:34:17.661426+0000","last_became_peered":"2024-09-20T20:34:17.661426+0000","last_unstale":"2024-09-20T20:35:20.762656+0000","last_undegraded":"2024-09-20T20:35:20.762656+0000","last_fullsized":"2024-09-20T20:35:20.762656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-20T20:35:20.762472+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-20T20:35:20.762472+0000","last_clean_scrub_stamp":"2024-09-20T20:35:20.762472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:49:34.627832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"95'562","reported_seq":739,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:15.907240+0000","last_change":"2024-09-20T20:35:15.907413+0000","last_active":"2024-09-20T20:35:15.907240+0000","last_peered":"2024-09-20T20:35:15.907240+0000","last_clean":"2024-09-20T20:35:15.907240+0000","last_became_active":"2024-09-20T20:29:53.993992+0000","last_became_peered":"2024-09-20T20:29:53.993992+0000","last_unstale":"2024-09-20T20:35:15.907240+0000","last_undegraded":"2024-09-20T20:35:15.907240+0000","last_fullsized":"2024-09-20T20:35:15.907240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'562","last_scrub_stamp":"2024-09-20T20:35:15.907014+0000","last_deep_scrub":"95'562","last_deep_scrub_stamp":"2024-09-20T20:35:15.907014+0000","last_clean_scrub_stamp":"2024-09-20T20:35:15.907014+0000","objects_scrubbed":2,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:09:29.538711+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'426","reported_seq":605,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.876626+0000","last_change":"2024-09-20T20:34:57.876683+0000","last_active":"2024-09-20T20:34:57.876626+0000","last_peered":"2024-09-20T20:34:57.876626+0000","last_clean":"2024-09-20T20:34:57.876626+0000","last_became_active":"2024-09-20T20:34:33.623119+0000","last_became_peered":"2024-09-20T20:34:33.623119+0000","last_unstale":"2024-09-20T20:34:57.876626+0000","last_undegraded":"2024-09-20T20:34:57.876626+0000","last_fullsized":"2024-09-20T20:34:57.876626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'426","last_scrub_stamp":"2024-09-20T20:34:57.876414+0000","last_deep_scrub":"63'426","last_deep_scrub_stamp":"2024-09-20T20:34:57.876414+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.876414+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:35.614386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":20222,"num_write":383,"num_write_kb":38645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:18.770316+0000","last_change":"2024-09-20T20:35:18.770393+0000","last_active":"2024-09-20T20:35:18.770316+0000","last_peered":"2024-09-20T20:35:18.770316+0000","last_clean":"2024-09-20T20:35:18.770316+0000","last_became_active":"2024-09-20T20:34:17.646092+0000","last_became_peered":"2024-09-20T20:34:17.646092+0000","last_unstale":"2024-09-20T20:35:18.770316+0000","last_undegraded":"2024-09-20T20:35:18.770316+0000","last_fullsized":"2024-09-20T20:35:18.770316+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:18.770125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:18.770125+0000","last_clean_scrub_stamp":"2024-09-20T20:35:18.770125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:33.871589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"95'128","reported_seq":382,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.934411+0000","last_change":"2024-09-20T20:35:04.934480+0000","last_active":"2024-09-20T20:35:04.934411+0000","last_peered":"2024-09-20T20:35:04.934411+0000","last_clean":"2024-09-20T20:35:04.934411+0000","last_became_active":"2024-09-20T20:34:17.707103+0000","last_became_peered":"2024-09-20T20:34:17.707103+0000","last_unstale":"2024-09-20T20:35:04.934411+0000","last_undegraded":"2024-09-20T20:35:04.934411+0000","last_fullsized":"2024-09-20T20:35:04.934411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'128","last_scrub_stamp":"2024-09-20T20:35:04.934220+0000","last_deep_scrub":"95'128","last_deep_scrub_stamp":"2024-09-20T20:35:04.934220+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.934220+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:31:46.935126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":65,"num_write_kb":1479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1182003,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'440","reported_seq":580,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.571536+0000","last_change":"2024-09-20T20:35:01.571597+0000","last_active":"2024-09-20T20:35:01.571536+0000","last_peered":"2024-09-20T20:35:01.571536+0000","last_clean":"2024-09-20T20:35:01.571536+0000","last_became_active":"2024-09-20T20:34:26.684993+0000","last_became_peered":"2024-09-20T20:34:26.684993+0000","last_unstale":"2024-09-20T20:35:01.571536+0000","last_undegraded":"2024-09-20T20:35:01.571536+0000","last_fullsized":"2024-09-20T20:35:01.571536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'440","last_scrub_stamp":"2024-09-20T20:35:01.571344+0000","last_deep_scrub":"63'440","last_deep_scrub_stamp":"2024-09-20T20:35:01.571344+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.571344+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T20:51:13.494135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22855,"num_write":412,"num_write_kb":112416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:10.801854+0000","last_change":"2024-09-20T20:35:10.801904+0000","last_active":"2024-09-20T20:35:10.801854+0000","last_peered":"2024-09-20T20:35:10.801854+0000","last_clean":"2024-09-20T20:35:10.801854+0000","last_became_active":"2024-09-20T20:29:49.812710+0000","last_became_peered":"2024-09-20T20:29:49.812710+0000","last_unstale":"2024-09-20T20:35:10.801854+0000","last_undegraded":"2024-09-20T20:35:10.801854+0000","last_fullsized":"2024-09-20T20:35:10.801854+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:10.801655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:10.801655+0000","last_clean_scrub_stamp":"2024-09-20T20:35:10.801655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:28.256956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082395700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'324","reported_seq":416,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.646615+0000","last_change":"2024-09-20T20:35:02.646762+0000","last_active":"2024-09-20T20:35:02.646615+0000","last_peered":"2024-09-20T20:35:02.646615+0000","last_clean":"2024-09-20T20:35:02.646615+0000","last_became_active":"2024-09-20T20:34:26.683068+0000","last_became_peered":"2024-09-20T20:34:26.683068+0000","last_unstale":"2024-09-20T20:35:02.646615+0000","last_undegraded":"2024-09-20T20:35:02.646615+0000","last_fullsized":"2024-09-20T20:35:02.646615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'324","last_scrub_stamp":"2024-09-20T20:35:02.646394+0000","last_deep_scrub":"95'324","last_deep_scrub_stamp":"2024-09-20T20:35:02.646394+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.646394+0000","objects_scrubbed":2,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:13.258717+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"63'346","reported_seq":568,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.842059+0000","last_change":"2024-09-20T20:34:55.842119+0000","last_active":"2024-09-20T20:34:55.842059+0000","last_peered":"2024-09-20T20:34:55.842059+0000","last_clean":"2024-09-20T20:34:55.842059+0000","last_became_active":"2024-09-20T20:29:55.014254+0000","last_became_peered":"2024-09-20T20:29:55.014254+0000","last_unstale":"2024-09-20T20:34:55.842059+0000","last_undegraded":"2024-09-20T20:34:55.842059+0000","last_fullsized":"2024-09-20T20:34:55.842059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'346","last_scrub_stamp":"2024-09-20T20:34:55.841867+0000","last_deep_scrub":"63'346","last_deep_scrub_stamp":"2024-09-20T20:34:55.841867+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.841867+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:30:36.113015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":26388,"num_write":326,"num_write_kb":54994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":104,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:14.795295+0000","last_change":"2024-09-20T20:35:14.795357+0000","last_active":"2024-09-20T20:35:14.795295+0000","last_peered":"2024-09-20T20:35:14.795295+0000","last_clean":"2024-09-20T20:35:14.795295+0000","last_became_active":"2024-09-20T20:34:17.651143+0000","last_became_peered":"2024-09-20T20:34:17.651143+0000","last_unstale":"2024-09-20T20:35:14.795295+0000","last_undegraded":"2024-09-20T20:35:14.795295+0000","last_fullsized":"2024-09-20T20:35:14.795295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-20T20:35:14.795108+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-20T20:35:14.795108+0000","last_clean_scrub_stamp":"2024-09-20T20:35:14.795108+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T22:43:57.807959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000769741,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"63'62","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:12.793541+0000","last_change":"2024-09-20T20:35:12.793601+0000","last_active":"2024-09-20T20:35:12.793541+0000","last_peered":"2024-09-20T20:35:12.793541+0000","last_clean":"2024-09-20T20:35:12.793541+0000","last_became_active":"2024-09-20T20:34:17.673620+0000","last_became_peered":"2024-09-20T20:34:17.673620+0000","last_unstale":"2024-09-20T20:35:12.793541+0000","last_undegraded":"2024-09-20T20:35:12.793541+0000","last_fullsized":"2024-09-20T20:35:12.793541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'62","last_scrub_stamp":"2024-09-20T20:35:12.793345+0000","last_deep_scrub":"63'62","last_deep_scrub_stamp":"2024-09-20T20:35:12.793345+0000","last_clean_scrub_stamp":"2024-09-20T20:35:12.793345+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:17:30.765371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"63'404","reported_seq":616,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:05.889678+0000","last_change":"2024-09-20T20:35:05.889736+0000","last_active":"2024-09-20T20:35:05.889678+0000","last_peered":"2024-09-20T20:35:05.889678+0000","last_clean":"2024-09-20T20:35:05.889678+0000","last_became_active":"2024-09-20T20:29:54.997174+0000","last_became_peered":"2024-09-20T20:29:54.997174+0000","last_unstale":"2024-09-20T20:35:05.889678+0000","last_undegraded":"2024-09-20T20:35:05.889678+0000","last_fullsized":"2024-09-20T20:35:05.889678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-09-20T20:35:05.889481+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-09-20T20:35:05.889481+0000","last_clean_scrub_stamp":"2024-09-20T20:35:05.889481+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:56.476099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17527,"num_write":363,"num_write_kb":63596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"95'265","reported_seq":337,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.910010+0000","last_change":"2024-09-20T20:35:08.910079+0000","last_active":"2024-09-20T20:35:08.910010+0000","last_peered":"2024-09-20T20:35:08.910010+0000","last_clean":"2024-09-20T20:35:08.910010+0000","last_became_active":"2024-09-20T20:34:20.795559+0000","last_became_peered":"2024-09-20T20:34:20.795559+0000","last_unstale":"2024-09-20T20:35:08.910010+0000","last_undegraded":"2024-09-20T20:35:08.910010+0000","last_fullsized":"2024-09-20T20:35:08.910010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'265","last_scrub_stamp":"2024-09-20T20:35:08.909825+0000","last_deep_scrub":"95'265","last_deep_scrub_stamp":"2024-09-20T20:35:08.909825+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.909825+0000","objects_scrubbed":1,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:41.695165+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:12.800273+0000","last_change":"2024-09-20T20:35:12.800330+0000","last_active":"2024-09-20T20:35:12.800273+0000","last_peered":"2024-09-20T20:35:12.800273+0000","last_clean":"2024-09-20T20:35:12.800273+0000","last_became_active":"2024-09-20T20:29:49.814253+0000","last_became_peered":"2024-09-20T20:29:49.814253+0000","last_unstale":"2024-09-20T20:35:12.800273+0000","last_undegraded":"2024-09-20T20:35:12.800273+0000","last_fullsized":"2024-09-20T20:35:12.800273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:12.800079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:12.800079+0000","last_clean_scrub_stamp":"2024-09-20T20:35:12.800079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:40:38.092735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074233700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'351","reported_seq":851,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:23.586691+0000","last_change":"2024-09-20T20:35:23.586754+0000","last_active":"2024-09-20T20:35:23.586691+0000","last_peered":"2024-09-20T20:35:23.586691+0000","last_clean":"2024-09-20T20:35:23.586691+0000","last_became_active":"2024-09-20T20:34:32.663352+0000","last_became_peered":"2024-09-20T20:34:32.663352+0000","last_unstale":"2024-09-20T20:35:23.586691+0000","last_undegraded":"2024-09-20T20:35:23.586691+0000","last_fullsized":"2024-09-20T20:35:23.586691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'351","last_scrub_stamp":"2024-09-20T20:35:23.586483+0000","last_deep_scrub":"63'351","last_deep_scrub_stamp":"2024-09-20T20:35:23.586483+0000","last_clean_scrub_stamp":"2024-09-20T20:35:23.586483+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:34:39.974172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8602,"num_write":311,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"63'56","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:14.818862+0000","last_change":"2024-09-20T20:35:14.818921+0000","last_active":"2024-09-20T20:35:14.818862+0000","last_peered":"2024-09-20T20:35:14.818862+0000","last_clean":"2024-09-20T20:35:14.818862+0000","last_became_active":"2024-09-20T20:29:53.994158+0000","last_became_peered":"2024-09-20T20:29:53.994158+0000","last_unstale":"2024-09-20T20:35:14.818862+0000","last_undegraded":"2024-09-20T20:35:14.818862+0000","last_fullsized":"2024-09-20T20:35:14.818862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'56","last_scrub_stamp":"2024-09-20T20:35:14.818660+0000","last_deep_scrub":"63'56","last_deep_scrub_stamp":"2024-09-20T20:35:14.818660+0000","last_clean_scrub_stamp":"2024-09-20T20:35:14.818660+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:38:20.860573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:57.493357+0000","last_change":"2024-09-20T20:34:57.493408+0000","last_active":"2024-09-20T20:34:57.493357+0000","last_peered":"2024-09-20T20:34:57.493357+0000","last_clean":"2024-09-20T20:34:57.493357+0000","last_became_active":"2024-09-20T20:34:26.685884+0000","last_became_peered":"2024-09-20T20:34:26.685884+0000","last_unstale":"2024-09-20T20:34:57.493357+0000","last_undegraded":"2024-09-20T20:34:57.493357+0000","last_fullsized":"2024-09-20T20:34:57.493357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:34:57.493161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:34:57.493161+0000","last_clean_scrub_stamp":"2024-09-20T20:34:57.493161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:00.107933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'391","reported_seq":907,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.566349+0000","last_change":"2024-09-20T20:35:08.566407+0000","last_active":"2024-09-20T20:35:08.566349+0000","last_peered":"2024-09-20T20:35:08.566349+0000","last_clean":"2024-09-20T20:35:08.566349+0000","last_became_active":"2024-09-20T20:34:22.653163+0000","last_became_peered":"2024-09-20T20:34:22.653163+0000","last_unstale":"2024-09-20T20:35:08.566349+0000","last_undegraded":"2024-09-20T20:35:08.566349+0000","last_fullsized":"2024-09-20T20:35:08.566349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'391","last_scrub_stamp":"2024-09-20T20:35:08.566148+0000","last_deep_scrub":"63'391","last_deep_scrub_stamp":"2024-09-20T20:35:08.566148+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.566148+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:29:26.021449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4144,"num_write":354,"num_write_kb":29931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"95'65","reported_seq":242,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:17.892112+0000","last_change":"2024-09-20T20:35:17.892177+0000","last_active":"2024-09-20T20:35:17.892112+0000","last_peered":"2024-09-20T20:35:17.892112+0000","last_clean":"2024-09-20T20:35:17.892112+0000","last_became_active":"2024-09-20T20:29:53.997297+0000","last_became_peered":"2024-09-20T20:29:53.997297+0000","last_unstale":"2024-09-20T20:35:17.892112+0000","last_undegraded":"2024-09-20T20:35:17.892112+0000","last_fullsized":"2024-09-20T20:35:17.892112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'65","last_scrub_stamp":"2024-09-20T20:35:17.891923+0000","last_deep_scrub":"95'65","last_deep_scrub_stamp":"2024-09-20T20:35:17.891923+0000","last_clean_scrub_stamp":"2024-09-20T20:35:17.891923+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:34:15.855298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:11.849580+0000","last_change":"2024-09-20T20:35:11.849633+0000","last_active":"2024-09-20T20:35:11.849580+0000","last_peered":"2024-09-20T20:35:11.849580+0000","last_clean":"2024-09-20T20:35:11.849580+0000","last_became_active":"2024-09-20T20:29:49.812845+0000","last_became_peered":"2024-09-20T20:29:49.812845+0000","last_unstale":"2024-09-20T20:35:11.849580+0000","last_undegraded":"2024-09-20T20:35:11.849580+0000","last_fullsized":"2024-09-20T20:35:11.849580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:11.849387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:11.849387+0000","last_clean_scrub_stamp":"2024-09-20T20:35:11.849387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:35:02.332494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088992300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'460","reported_seq":1070,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:24.969338+0000","last_change":"2024-09-20T20:35:24.969396+0000","last_active":"2024-09-20T20:35:24.969338+0000","last_peered":"2024-09-20T20:35:24.969338+0000","last_clean":"2024-09-20T20:35:24.969338+0000","last_became_active":"2024-09-20T20:34:41.670121+0000","last_became_peered":"2024-09-20T20:34:41.670121+0000","last_unstale":"2024-09-20T20:35:24.969338+0000","last_undegraded":"2024-09-20T20:35:24.969338+0000","last_fullsized":"2024-09-20T20:35:24.969338+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-09-20T20:35:24.969142+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-09-20T20:35:24.969142+0000","last_clean_scrub_stamp":"2024-09-20T20:35:24.969142+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:53:37.926225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":56677,"num_write":426,"num_write_kb":108789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"95'119","reported_seq":308,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:02.902062+0000","last_change":"2024-09-20T20:35:02.902128+0000","last_active":"2024-09-20T20:35:02.902062+0000","last_peered":"2024-09-20T20:35:02.902062+0000","last_clean":"2024-09-20T20:35:02.902062+0000","last_became_active":"2024-09-20T20:34:17.679250+0000","last_became_peered":"2024-09-20T20:34:17.679250+0000","last_unstale":"2024-09-20T20:35:02.902062+0000","last_undegraded":"2024-09-20T20:35:02.902062+0000","last_fullsized":"2024-09-20T20:35:02.902062+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'119","last_scrub_stamp":"2024-09-20T20:35:02.901876+0000","last_deep_scrub":"95'119","last_deep_scrub_stamp":"2024-09-20T20:35:02.901876+0000","last_clean_scrub_stamp":"2024-09-20T20:35:02.901876+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:48.084840+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":1204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:15.743877+0000","last_change":"2024-09-20T20:35:15.743932+0000","last_active":"2024-09-20T20:35:15.743877+0000","last_peered":"2024-09-20T20:35:15.743877+0000","last_clean":"2024-09-20T20:35:15.743877+0000","last_became_active":"2024-09-20T20:34:17.635664+0000","last_became_peered":"2024-09-20T20:34:17.635664+0000","last_unstale":"2024-09-20T20:35:15.743877+0000","last_undegraded":"2024-09-20T20:35:15.743877+0000","last_fullsized":"2024-09-20T20:35:15.743877+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T20:35:15.743685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T20:35:15.743685+0000","last_clean_scrub_stamp":"2024-09-20T20:35:15.743685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:05.884885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'408","reported_seq":945,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.565469+0000","last_change":"2024-09-20T20:35:06.565643+0000","last_active":"2024-09-20T20:35:06.565469+0000","last_peered":"2024-09-20T20:35:06.565469+0000","last_clean":"2024-09-20T20:35:06.565469+0000","last_became_active":"2024-09-20T20:34:24.660802+0000","last_became_peered":"2024-09-20T20:34:24.660802+0000","last_unstale":"2024-09-20T20:35:06.565469+0000","last_undegraded":"2024-09-20T20:35:06.565469+0000","last_fullsized":"2024-09-20T20:35:06.565469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-09-20T20:35:06.565243+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-09-20T20:35:06.565243+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.565243+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:52.475888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":17900,"num_write":371,"num_write_kb":67782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"63'398","reported_seq":583,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:09.858941+0000","last_change":"2024-09-20T20:35:09.859000+0000","last_active":"2024-09-20T20:35:09.858941+0000","last_peered":"2024-09-20T20:35:09.858941+0000","last_clean":"2024-09-20T20:35:09.858941+0000","last_became_active":"2024-09-20T20:34:26.661398+0000","last_became_peered":"2024-09-20T20:34:26.661398+0000","last_unstale":"2024-09-20T20:35:09.858941+0000","last_undegraded":"2024-09-20T20:35:09.858941+0000","last_fullsized":"2024-09-20T20:35:09.858941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'398","last_scrub_stamp":"2024-09-20T20:35:09.858742+0000","last_deep_scrub":"63'398","last_deep_scrub_stamp":"2024-09-20T20:35:09.858742+0000","last_clean_scrub_stamp":"2024-09-20T20:35:09.858742+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:20.819085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8989,"num_write":353,"num_write_kb":64931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"95'276","reported_seq":452,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:04.954637+0000","last_change":"2024-09-20T20:35:04.954704+0000","last_active":"2024-09-20T20:35:04.954637+0000","last_peered":"2024-09-20T20:35:04.954637+0000","last_clean":"2024-09-20T20:35:04.954637+0000","last_became_active":"2024-09-20T20:34:20.797028+0000","last_became_peered":"2024-09-20T20:34:20.797028+0000","last_unstale":"2024-09-20T20:35:04.954637+0000","last_undegraded":"2024-09-20T20:35:04.954637+0000","last_fullsized":"2024-09-20T20:35:04.954637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'276","last_scrub_stamp":"2024-09-20T20:35:04.954461+0000","last_deep_scrub":"95'276","last_deep_scrub_stamp":"2024-09-20T20:35:04.954461+0000","last_clean_scrub_stamp":"2024-09-20T20:35:04.954461+0000","objects_scrubbed":6,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:48:52.941148+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8618671,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":8529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4423785,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"63'401","reported_seq":600,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:03.881172+0000","last_change":"2024-09-20T20:35:03.881232+0000","last_active":"2024-09-20T20:35:03.881172+0000","last_peered":"2024-09-20T20:35:03.881172+0000","last_clean":"2024-09-20T20:35:03.881172+0000","last_became_active":"2024-09-20T20:29:54.997239+0000","last_became_peered":"2024-09-20T20:29:54.997239+0000","last_unstale":"2024-09-20T20:35:03.881172+0000","last_undegraded":"2024-09-20T20:35:03.881172+0000","last_fullsized":"2024-09-20T20:35:03.881172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'401","last_scrub_stamp":"2024-09-20T20:35:03.880955+0000","last_deep_scrub":"63'401","last_deep_scrub_stamp":"2024-09-20T20:35:03.880955+0000","last_clean_scrub_stamp":"2024-09-20T20:35:03.880955+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:44.587743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":360,"num_write_kb":38379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"95'91","reported_seq":280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:12.616152+0000","last_change":"2024-09-20T20:35:12.616216+0000","last_active":"2024-09-20T20:35:12.616152+0000","last_peered":"2024-09-20T20:35:12.616152+0000","last_clean":"2024-09-20T20:35:12.616152+0000","last_became_active":"2024-09-20T20:34:17.711229+0000","last_became_peered":"2024-09-20T20:34:17.711229+0000","last_unstale":"2024-09-20T20:35:12.616152+0000","last_undegraded":"2024-09-20T20:35:12.616152+0000","last_fullsized":"2024-09-20T20:35:12.616152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'91","last_scrub_stamp":"2024-09-20T20:35:12.615981+0000","last_deep_scrub":"95'91","last_deep_scrub_stamp":"2024-09-20T20:35:12.615981+0000","last_clean_scrub_stamp":"2024-09-20T20:35:12.615981+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T00:38:18.657894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"95'207","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:10.844990+0000","last_change":"2024-09-20T20:35:10.845053+0000","last_active":"2024-09-20T20:35:10.844990+0000","last_peered":"2024-09-20T20:35:10.844990+0000","last_clean":"2024-09-20T20:35:10.844990+0000","last_became_active":"2024-09-20T20:34:20.795806+0000","last_became_peered":"2024-09-20T20:34:20.795806+0000","last_unstale":"2024-09-20T20:35:10.844990+0000","last_undegraded":"2024-09-20T20:35:10.844990+0000","last_fullsized":"2024-09-20T20:35:10.844990+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'207","last_scrub_stamp":"2024-09-20T20:35:10.844799+0000","last_deep_scrub":"95'207","last_deep_scrub_stamp":"2024-09-20T20:35:10.844799+0000","last_clean_scrub_stamp":"2024-09-20T20:35:10.844799+0000","objects_scrubbed":1,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:31:24.782224+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'470","reported_seq":1097,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:19.899611+0000","last_change":"2024-09-20T20:35:19.899677+0000","last_active":"2024-09-20T20:35:19.899611+0000","last_peered":"2024-09-20T20:35:19.899611+0000","last_clean":"2024-09-20T20:35:19.899611+0000","last_became_active":"2024-09-20T20:34:28.659424+0000","last_became_peered":"2024-09-20T20:34:28.659424+0000","last_unstale":"2024-09-20T20:35:19.899611+0000","last_undegraded":"2024-09-20T20:35:19.899611+0000","last_fullsized":"2024-09-20T20:35:19.899611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'470","last_scrub_stamp":"2024-09-20T20:35:19.899322+0000","last_deep_scrub":"63'470","last_deep_scrub_stamp":"2024-09-20T20:35:19.899322+0000","last_clean_scrub_stamp":"2024-09-20T20:35:19.899322+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:40.108550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39128,"num_write":446,"num_write_kb":88761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"63'58","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:00.828455+0000","last_change":"2024-09-20T20:35:00.828517+0000","last_active":"2024-09-20T20:35:00.828455+0000","last_peered":"2024-09-20T20:35:00.828455+0000","last_clean":"2024-09-20T20:35:00.828455+0000","last_became_active":"2024-09-20T20:34:17.689421+0000","last_became_peered":"2024-09-20T20:34:17.689421+0000","last_unstale":"2024-09-20T20:35:00.828455+0000","last_undegraded":"2024-09-20T20:35:00.828455+0000","last_fullsized":"2024-09-20T20:35:00.828455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'58","last_scrub_stamp":"2024-09-20T20:35:00.828255+0000","last_deep_scrub":"63'58","last_deep_scrub_stamp":"2024-09-20T20:35:00.828255+0000","last_clean_scrub_stamp":"2024-09-20T20:35:00.828255+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:34:06.354325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'495","reported_seq":685,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:01.850033+0000","last_change":"2024-09-20T20:35:01.850097+0000","last_active":"2024-09-20T20:35:01.850033+0000","last_peered":"2024-09-20T20:35:01.850033+0000","last_clean":"2024-09-20T20:35:01.850033+0000","last_became_active":"2024-09-20T20:29:54.998468+0000","last_became_peered":"2024-09-20T20:29:54.998468+0000","last_unstale":"2024-09-20T20:35:01.850033+0000","last_undegraded":"2024-09-20T20:35:01.850033+0000","last_fullsized":"2024-09-20T20:35:01.850033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'495","last_scrub_stamp":"2024-09-20T20:35:01.849806+0000","last_deep_scrub":"63'495","last_deep_scrub_stamp":"2024-09-20T20:35:01.849806+0000","last_clean_scrub_stamp":"2024-09-20T20:35:01.849806+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:56.932808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9006,"num_write":468,"num_write_kb":137374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'363","reported_seq":855,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:25.549581+0000","last_change":"2024-09-20T20:35:25.549641+0000","last_active":"2024-09-20T20:35:25.549581+0000","last_peered":"2024-09-20T20:35:25.549581+0000","last_clean":"2024-09-20T20:35:25.549581+0000","last_became_active":"2024-09-20T20:34:37.658768+0000","last_became_peered":"2024-09-20T20:34:37.658768+0000","last_unstale":"2024-09-20T20:35:25.549581+0000","last_undegraded":"2024-09-20T20:35:25.549581+0000","last_fullsized":"2024-09-20T20:35:25.549581+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'363","last_scrub_stamp":"2024-09-20T20:35:25.549374+0000","last_deep_scrub":"63'363","last_deep_scrub_stamp":"2024-09-20T20:35:25.549374+0000","last_clean_scrub_stamp":"2024-09-20T20:35:25.549374+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:01:40.289213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8495,"num_write":334,"num_write_kb":55079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"95'701","reported_seq":878,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:13.816803+0000","last_change":"2024-09-20T20:35:13.816873+0000","last_active":"2024-09-20T20:35:13.816803+0000","last_peered":"2024-09-20T20:35:13.816803+0000","last_clean":"2024-09-20T20:35:13.816803+0000","last_became_active":"2024-09-20T20:29:53.994510+0000","last_became_peered":"2024-09-20T20:29:53.994510+0000","last_unstale":"2024-09-20T20:35:13.816803+0000","last_undegraded":"2024-09-20T20:35:13.816803+0000","last_fullsized":"2024-09-20T20:35:13.816803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'701","last_scrub_stamp":"2024-09-20T20:35:13.816611+0000","last_deep_scrub":"95'701","last_deep_scrub_stamp":"2024-09-20T20:35:13.816611+0000","last_clean_scrub_stamp":"2024-09-20T20:35:13.816611+0000","objects_scrubbed":2,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:22.773287+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":8477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'399","reported_seq":954,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:21.952829+0000","last_change":"2024-09-20T20:35:21.952890+0000","last_active":"2024-09-20T20:35:21.952829+0000","last_peered":"2024-09-20T20:35:21.952829+0000","last_clean":"2024-09-20T20:35:21.952829+0000","last_became_active":"2024-09-20T20:34:34.656086+0000","last_became_peered":"2024-09-20T20:34:34.656086+0000","last_unstale":"2024-09-20T20:35:21.952829+0000","last_undegraded":"2024-09-20T20:35:21.952829+0000","last_fullsized":"2024-09-20T20:35:21.952829+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'399","last_scrub_stamp":"2024-09-20T20:35:21.952627+0000","last_deep_scrub":"63'399","last_deep_scrub_stamp":"2024-09-20T20:35:21.952627+0000","last_clean_scrub_stamp":"2024-09-20T20:35:21.952627+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:57:41.018336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21996,"num_write":370,"num_write_kb":50802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"95'184","reported_seq":375,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:08.805023+0000","last_change":"2024-09-20T20:35:08.805093+0000","last_active":"2024-09-20T20:35:08.805023+0000","last_peered":"2024-09-20T20:35:08.805023+0000","last_clean":"2024-09-20T20:35:08.805023+0000","last_became_active":"2024-09-20T20:34:20.833187+0000","last_became_peered":"2024-09-20T20:34:20.833187+0000","last_unstale":"2024-09-20T20:35:08.805023+0000","last_undegraded":"2024-09-20T20:35:08.805023+0000","last_fullsized":"2024-09-20T20:35:08.805023+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'184","last_scrub_stamp":"2024-09-20T20:35:08.804833+0000","last_deep_scrub":"95'184","last_deep_scrub_stamp":"2024-09-20T20:35:08.804833+0000","last_clean_scrub_stamp":"2024-09-20T20:35:08.804833+0000","objects_scrubbed":1,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:54.715477+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'398","reported_seq":975,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:24.593502+0000","last_change":"2024-09-20T20:35:24.593560+0000","last_active":"2024-09-20T20:35:24.593502+0000","last_peered":"2024-09-20T20:35:24.593502+0000","last_clean":"2024-09-20T20:35:24.593502+0000","last_became_active":"2024-09-20T20:34:36.664846+0000","last_became_peered":"2024-09-20T20:34:36.664846+0000","last_unstale":"2024-09-20T20:35:24.593502+0000","last_undegraded":"2024-09-20T20:35:24.593502+0000","last_fullsized":"2024-09-20T20:35:24.593502+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'398","last_scrub_stamp":"2024-09-20T20:35:24.593299+0000","last_deep_scrub":"63'398","last_deep_scrub_stamp":"2024-09-20T20:35:24.593299+0000","last_clean_scrub_stamp":"2024-09-20T20:35:24.593299+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:47.609120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52177,"num_write":357,"num_write_kb":63267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"95'239","reported_seq":338,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:59.583246+0000","last_change":"2024-09-20T20:34:59.583313+0000","last_active":"2024-09-20T20:34:59.583246+0000","last_peered":"2024-09-20T20:34:59.583246+0000","last_clean":"2024-09-20T20:34:59.583246+0000","last_became_active":"2024-09-20T20:34:26.692613+0000","last_became_peered":"2024-09-20T20:34:26.692613+0000","last_unstale":"2024-09-20T20:34:59.583246+0000","last_undegraded":"2024-09-20T20:34:59.583246+0000","last_fullsized":"2024-09-20T20:34:59.583246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'239","last_scrub_stamp":"2024-09-20T20:34:59.583051+0000","last_deep_scrub":"95'239","last_deep_scrub_stamp":"2024-09-20T20:34:59.583051+0000","last_clean_scrub_stamp":"2024-09-20T20:34:59.583051+0000","objects_scrubbed":3,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:40:48.952097+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":12376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"63'379","reported_seq":547,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.469043+0000","last_change":"2024-09-20T20:34:56.469100+0000","last_active":"2024-09-20T20:34:56.469043+0000","last_peered":"2024-09-20T20:34:56.469043+0000","last_clean":"2024-09-20T20:34:56.469043+0000","last_became_active":"2024-09-20T20:34:26.692652+0000","last_became_peered":"2024-09-20T20:34:26.692652+0000","last_unstale":"2024-09-20T20:34:56.469043+0000","last_undegraded":"2024-09-20T20:34:56.469043+0000","last_fullsized":"2024-09-20T20:34:56.469043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'379","last_scrub_stamp":"2024-09-20T20:34:56.468841+0000","last_deep_scrub":"63'379","last_deep_scrub_stamp":"2024-09-20T20:34:56.468841+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.468841+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:07:23.446737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36106,"num_write":353,"num_write_kb":75125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"95'61","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:20.641761+0000","last_change":"2024-09-20T20:35:20.641852+0000","last_active":"2024-09-20T20:35:20.641761+0000","last_peered":"2024-09-20T20:35:20.641761+0000","last_clean":"2024-09-20T20:35:20.641761+0000","last_became_active":"2024-09-20T20:34:17.710132+0000","last_became_peered":"2024-09-20T20:34:17.710132+0000","last_unstale":"2024-09-20T20:35:20.641761+0000","last_undegraded":"2024-09-20T20:35:20.641761+0000","last_fullsized":"2024-09-20T20:35:20.641761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'61","last_scrub_stamp":"2024-09-20T20:35:20.641539+0000","last_deep_scrub":"95'61","last_deep_scrub_stamp":"2024-09-20T20:35:20.641539+0000","last_clean_scrub_stamp":"2024-09-20T20:35:20.641539+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:17:12.464449+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"63'373","reported_seq":571,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:55.875633+0000","last_change":"2024-09-20T20:34:55.875689+0000","last_active":"2024-09-20T20:34:55.875633+0000","last_peered":"2024-09-20T20:34:55.875633+0000","last_clean":"2024-09-20T20:34:55.875633+0000","last_became_active":"2024-09-20T20:34:31.631098+0000","last_became_peered":"2024-09-20T20:34:31.631098+0000","last_unstale":"2024-09-20T20:34:55.875633+0000","last_undegraded":"2024-09-20T20:34:55.875633+0000","last_fullsized":"2024-09-20T20:34:55.875633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'373","last_scrub_stamp":"2024-09-20T20:34:55.875446+0000","last_deep_scrub":"63'373","last_deep_scrub_stamp":"2024-09-20T20:34:55.875446+0000","last_clean_scrub_stamp":"2024-09-20T20:34:55.875446+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:30.314326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22665,"num_write":343,"num_write_kb":42081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"95'201","reported_seq":381,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:06.882979+0000","last_change":"2024-09-20T20:35:06.883109+0000","last_active":"2024-09-20T20:35:06.882979+0000","last_peered":"2024-09-20T20:35:06.882979+0000","last_clean":"2024-09-20T20:35:06.882979+0000","last_became_active":"2024-09-20T20:34:20.795734+0000","last_became_peered":"2024-09-20T20:34:20.795734+0000","last_unstale":"2024-09-20T20:35:06.882979+0000","last_undegraded":"2024-09-20T20:35:06.882979+0000","last_fullsized":"2024-09-20T20:35:06.882979+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'201","last_scrub_stamp":"2024-09-20T20:35:06.882785+0000","last_deep_scrub":"95'201","last_deep_scrub_stamp":"2024-09-20T20:35:06.882785+0000","last_clean_scrub_stamp":"2024-09-20T20:35:06.882785+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:20.024822+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2895448,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"63'391","reported_seq":587,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:26.779701+0000","last_change":"2024-09-20T20:35:26.779822+0000","last_active":"2024-09-20T20:35:26.779701+0000","last_peered":"2024-09-20T20:35:26.779701+0000","last_clean":"2024-09-20T20:35:26.779701+0000","last_became_active":"2024-09-20T20:34:36.626427+0000","last_became_peered":"2024-09-20T20:34:36.626427+0000","last_unstale":"2024-09-20T20:35:26.779701+0000","last_undegraded":"2024-09-20T20:35:26.779701+0000","last_fullsized":"2024-09-20T20:35:26.779701+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'391","last_scrub_stamp":"2024-09-20T20:35:26.779453+0000","last_deep_scrub":"63'391","last_deep_scrub_stamp":"2024-09-20T20:35:26.779453+0000","last_clean_scrub_stamp":"2024-09-20T20:35:26.779453+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:25.013464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29978,"num_write":359,"num_write_kb":66831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"95'275","reported_seq":466,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:10.700864+0000","last_change":"2024-09-20T20:35:10.700944+0000","last_active":"2024-09-20T20:35:10.700864+0000","last_peered":"2024-09-20T20:35:10.700864+0000","last_clean":"2024-09-20T20:35:10.700864+0000","last_became_active":"2024-09-20T20:34:20.833050+0000","last_became_peered":"2024-09-20T20:34:20.833050+0000","last_unstale":"2024-09-20T20:35:10.700864+0000","last_undegraded":"2024-09-20T20:35:10.700864+0000","last_fullsized":"2024-09-20T20:35:10.700864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'275","last_scrub_stamp":"2024-09-20T20:35:10.700658+0000","last_deep_scrub":"95'275","last_deep_scrub_stamp":"2024-09-20T20:35:10.700658+0000","last_clean_scrub_stamp":"2024-09-20T20:35:10.700658+0000","objects_scrubbed":4,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:14.131284+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":12394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"63'435","reported_seq":623,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:11.642339+0000","last_change":"2024-09-20T20:35:11.642400+0000","last_active":"2024-09-20T20:35:11.642339+0000","last_peered":"2024-09-20T20:35:11.642339+0000","last_clean":"2024-09-20T20:35:11.642339+0000","last_became_active":"2024-09-20T20:34:26.688559+0000","last_became_peered":"2024-09-20T20:34:26.688559+0000","last_unstale":"2024-09-20T20:35:11.642339+0000","last_undegraded":"2024-09-20T20:35:11.642339+0000","last_fullsized":"2024-09-20T20:35:11.642339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'435","last_scrub_stamp":"2024-09-20T20:35:11.642148+0000","last_deep_scrub":"63'435","last_deep_scrub_stamp":"2024-09-20T20:35:11.642148+0000","last_clean_scrub_stamp":"2024-09-20T20:35:11.642148+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T23:15:20.598824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46016,"num_write":407,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"95'66","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:16.889418+0000","last_change":"2024-09-20T20:35:16.889488+0000","last_active":"2024-09-20T20:35:16.889418+0000","last_peered":"2024-09-20T20:35:16.889418+0000","last_clean":"2024-09-20T20:35:16.889418+0000","last_became_active":"2024-09-20T20:29:53.996129+0000","last_became_peered":"2024-09-20T20:29:53.996129+0000","last_unstale":"2024-09-20T20:35:16.889418+0000","last_undegraded":"2024-09-20T20:35:16.889418+0000","last_fullsized":"2024-09-20T20:35:16.889418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'66","last_scrub_stamp":"2024-09-20T20:35:16.889224+0000","last_deep_scrub":"95'66","last_deep_scrub_stamp":"2024-09-20T20:35:16.889224+0000","last_clean_scrub_stamp":"2024-09-20T20:35:16.889224+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:46:11.227709+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'448","reported_seq":594,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:35:28.827736+0000","last_change":"2024-09-20T20:35:28.827850+0000","last_active":"2024-09-20T20:35:28.827736+0000","last_peered":"2024-09-20T20:35:28.827736+0000","last_clean":"2024-09-20T20:35:28.827736+0000","last_became_active":"2024-09-20T20:34:40.636757+0000","last_became_peered":"2024-09-20T20:34:40.636757+0000","last_unstale":"2024-09-20T20:35:28.827736+0000","last_undegraded":"2024-09-20T20:35:28.827736+0000","last_fullsized":"2024-09-20T20:35:28.827736+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'448","last_scrub_stamp":"2024-09-20T20:35:28.827510+0000","last_deep_scrub":"63'448","last_deep_scrub_stamp":"2024-09-20T20:35:28.827510+0000","last_clean_scrub_stamp":"2024-09-20T20:35:28.827510+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:59.674024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1238,"num_write":418,"num_write_kb":47114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"95'59","reported_seq":244,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-20T20:34:56.823156+0000","last_change":"2024-09-20T20:34:56.823234+0000","last_active":"2024-09-20T20:34:56.823156+0000","last_peered":"2024-09-20T20:34:56.823156+0000","last_clean":"2024-09-20T20:34:56.823156+0000","last_became_active":"2024-09-20T20:34:17.679322+0000","last_became_peered":"2024-09-20T20:34:17.679322+0000","last_unstale":"2024-09-20T20:34:56.823156+0000","last_undegraded":"2024-09-20T20:34:56.823156+0000","last_fullsized":"2024-09-20T20:34:56.823156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'59","last_scrub_stamp":"2024-09-20T20:34:56.822965+0000","last_deep_scrub":"95'59","last_deep_scrub_stamp":"2024-09-20T20:34:56.822965+0000","last_clean_scrub_stamp":"2024-09-20T20:34:56.822965+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T21:12:09.414357+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2809,"num_read_kb":1510112,"num_write":24585,"num_write_kb":4514852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6675,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26657,"ondisk_log_size":26657,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127530036,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":65,"num_read_kb":1479,"num_write":4602,"num_write_kb":127871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37861454,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79560704,"data_stored":255060072,"data_compressed":37601929,"data_compressed_allocated":48177152,"data_compressed_original":223748096,"omap_allocated":168199,"internal_metadata":0},"log_size":6420,"ondisk_log_size":6420,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22936,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738446,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99324,"kb_used_data":27948,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94272516,"statfs":{"total":96636764160,"available":96535056384,"internally_reserved":0,"allocated":28618752,"data_stored":81565680,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104352,"kb_used_data":28816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94267488,"statfs":{"total":96636764160,"available":96529907712,"internally_reserved":0,"allocated":29507584,"data_stored":85109907,"data_compressed":12006702,"data_compressed_allocated":15814656,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":69,"seq":296352743445,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57320,"kb_used_data":23640,"kb_used_omap":165,"kb_used_meta":33498,"kb_avail":94314520,"statfs":{"total":96636764160,"available":96578068480,"internally_reserved":0,"allocated":24207360,"data_stored":90774901,"data_compressed":13901890,"data_compressed_allocated":16965632,"data_compressed_original":84058112,"omap_allocated":169794,"internal_metadata":34302142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11468,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":89781300,"data_compressed":13890422,"data_compressed_allocated":16924672,"data_compressed_original":83484672,"omap_allocated":168199,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28565504,"data_stored":84116325,"data_compressed":11995234,"data_compressed_allocated":15773696,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27734016,"data_stored":81162447,"data_compressed":11716273,"data_compressed_allocated":15478784,"data_compressed_original":68915200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T20:35:56.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-20T20:35:56.413 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-20T20:35:56.414 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T20:35:56.742 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:35:56.742 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T20:29:54.341626+0000","modified":"2024-09-20T20:29:56.333455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.70:6803/89722736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":89722736},{"type":"v1","addr":"172.21.15.70:6803","nonce":89722736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-09-20T20:35:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-09-20T20:35:56.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-20T20:35:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:35:57.088 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"btime":"2024-09-20T20:29:56:995410+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-20T20:29:54.341626+0000","modified":"2024-09-20T20:29:56.333455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.70:6803/89722736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":89722736},{"type":"v1","addr":"172.21.15.70:6803","nonce":89722736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4230,"qdb_cluster":[4230]},"id":1}]} 2024-09-20T20:35:57.088 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-09-20T20:35:57.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-20T20:35:57.399 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-20T20:35:57.400 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":95,"fsid":"49cfe37c-8fc4-44b8-a85f-d53d77eb9d19","created":"2024-09-20T20:29:32.709374+0000","modified":"2024-09-20T20:34:42.660804+0000","last_up_change":"2024-09-20T20:34:16.788033+0000","last_in_change":"2024-09-20T20:29:33.925164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T20:29:43.674922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-20T20:29:48.243188+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-20T20:29:52.828296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-20T20:29:53.322652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1faec90a-457d-4941-a408-c3a5b5f8e2f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":57,"up_from":69,"up_thru":94,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6801","nonce":575774322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6803","nonce":575774322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6807","nonce":575774322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":575774322},{"type":"v1","addr":"172.21.15.79:6805","nonce":575774322}]},"public_addr":"172.21.15.79:6801/575774322","cluster_addr":"172.21.15.79:6803/575774322","heartbeat_back_addr":"172.21.15.79:6807/575774322","heartbeat_front_addr":"172.21.15.79:6805/575774322","state":["exists","up"]},{"osd":1,"uuid":"99ce4df8-04c8-4992-9306-22ca73b3e744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6801","nonce":3440150315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6803","nonce":3440150315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6807","nonce":3440150315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3440150315},{"type":"v1","addr":"172.21.15.90:6805","nonce":3440150315}]},"public_addr":"172.21.15.90:6801/3440150315","cluster_addr":"172.21.15.90:6803/3440150315","heartbeat_back_addr":"172.21.15.90:6807/3440150315","heartbeat_front_addr":"172.21.15.90:6805/3440150315","state":["exists","up"]},{"osd":2,"uuid":"9427eb75-9576-46b8-9123-f40e3ad555fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6801","nonce":3717183720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6803","nonce":3717183720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6807","nonce":3717183720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3717183720},{"type":"v1","addr":"172.21.15.187:6805","nonce":3717183720}]},"public_addr":"172.21.15.187:6801/3717183720","cluster_addr":"172.21.15.187:6803/3717183720","heartbeat_back_addr":"172.21.15.187:6807/3717183720","heartbeat_front_addr":"172.21.15.187:6805/3717183720","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.098836+0000","dead_epoch":57},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:39.812954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T20:29:40.075239+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.2d","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T20:35:57.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-20T20:35:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-20T20:35:57.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-20T20:35:57.793 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2024-09-20T20:35:58.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-20T20:35:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2024-09-20T20:35:59.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-20T20:36:00.859 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2024-09-20T20:36:00.884 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-20T20:36:00.884 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-20T20:36:00.884 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:00.895 INFO:tasks.ceph.mds.a:Stopped 2024-09-20T20:36:00.896 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-20T20:36:00.896 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-20T20:36:00.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:00.957 INFO:tasks.ceph.osd.0:Stopped 2024-09-20T20:36:00.957 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-20T20:36:00.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:01.048 INFO:tasks.ceph.osd.1:Stopped 2024-09-20T20:36:01.048 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-20T20:36:01.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:02.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-20T20:36:07.151 INFO:tasks.ceph.osd.2:Stopped 2024-09-20T20:36:07.151 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-20T20:36:07.151 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-20T20:36:07.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:07.179 INFO:tasks.ceph.mgr.x:Stopped 2024-09-20T20:36:07.179 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-20T20:36:07.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:07.249 INFO:tasks.ceph.mgr.y:Stopped 2024-09-20T20:36:07.249 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-20T20:36:07.249 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-20T20:36:07.249 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:07.305 INFO:tasks.ceph.mon.a:Stopped 2024-09-20T20:36:07.305 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-20T20:36:07.306 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:07.361 INFO:tasks.ceph.mon.b:Stopped 2024-09-20T20:36:07.361 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-20T20:36:07.361 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T20:36:07.418 INFO:tasks.ceph.mon.c:Stopped 2024-09-20T20:36:07.418 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-20T20:36:07.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-20T20:36:07.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-20T20:36:07.479 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:36:07.479 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-20T20:36:07.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com 2024-09-20T20:36:07.572 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-20T20:36:07.774 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-20T20:36:07.774 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-20T20:36:07.965 INFO:tasks.ceph:Archiving mon data... 2024-09-20T20:36:07.966 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/data/mon.a.tgz 2024-09-20T20:36:07.966 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-20T20:36:07.972 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.3ByazP03YS 2024-09-20T20:36:07.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3ByazP03YS 2024-09-20T20:36:08.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.3ByazP03YS 2024-09-20T20:36:08.173 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.3ByazP03YS is 389KB 2024-09-20T20:36:08.234 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.3ByazP03YS 2024-09-20T20:36:08.239 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/data/mon.b.tgz 2024-09-20T20:36:08.239 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-20T20:36:08.285 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.OJPz9TB7vt 2024-09-20T20:36:08.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.OJPz9TB7vt 2024-09-20T20:36:08.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.OJPz9TB7vt 2024-09-20T20:36:08.529 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.OJPz9TB7vt is 548KB 2024-09-20T20:36:08.594 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.OJPz9TB7vt 2024-09-20T20:36:08.600 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/data/mon.c.tgz 2024-09-20T20:36:08.600 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-20T20:36:08.649 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.0WTh8Y305W 2024-09-20T20:36:08.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0WTh8Y305W 2024-09-20T20:36:08.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.0WTh8Y305W 2024-09-20T20:36:08.892 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.0WTh8Y305W is 548KB 2024-09-20T20:36:08.954 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.0WTh8Y305W 2024-09-20T20:36:08.959 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-20T20:36:08.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-20T20:36:09.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-20T20:36:09.004 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-20T20:36:09.006 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-20T20:36:09.081 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-20T20:36:09.091 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-20T20:36:09.096 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-20T20:36:09.102 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-20T20:36:09.102 INFO:tasks.ceph:Archiving crash dumps... 2024-09-20T20:36:09.104 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi070/crash 2024-09-20T20:36:09.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-20T20:36:09.140 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi079/crash 2024-09-20T20:36:09.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-20T20:36:09.177 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi090/crash 2024-09-20T20:36:09.178 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-20T20:36:09.192 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi187/crash 2024-09-20T20:36:09.193 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-20T20:36:09.206 INFO:tasks.ceph:Compressing logs... 2024-09-20T20:36:09.206 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T20:36:09.209 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T20:36:09.223 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T20:36:09.228 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27346.log 2024-09-20T20:36:09.229 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27061.log 2024-09-20T20:36:09.229 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22947.log 2024-09-20T20:36:09.229 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27346.log.gz 2024-09-20T20:36:09.230 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28834.log 2024-09-20T20:36:09.230 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27061.log.gz 2024-09-20T20:36:09.230 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28004.log 2024-09-20T20:36:09.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22947.log: /var/log/ceph/ceph-client.admin.28834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28834.log.gz 2024-09-20T20:36:09.232 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23487.log 2024-09-20T20:36:09.232 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22947.log.gz 2024-09-20T20:36:09.232 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.28004.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25410.log 2024-09-20T20:36:09.233 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28004.log.gz 2024-09-20T20:36:09.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23487.log.gz 2024-09-20T20:36:09.233 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27401.log 2024-09-20T20:36:09.233 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24529.log 2024-09-20T20:36:09.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25410.log.gz 2024-09-20T20:36:09.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27401.log.gz 2024-09-20T20:36:09.233 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24643.log 2024-09-20T20:36:09.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27497.log 2024-09-20T20:36:09.235 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24529.log.gz 2024-09-20T20:36:09.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26222.log 2024-09-20T20:36:09.235 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24643.log.gz 2024-09-20T20:36:09.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27497.log.gz 2024-09-20T20:36:09.236 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27116.log 2024-09-20T20:36:09.236 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26222.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-20T20:36:09.236 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26222.log.gz 2024-09-20T20:36:09.236 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24310.log 2024-09-20T20:36:09.236 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27116.log.gz 2024-09-20T20:36:09.236 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27229.log 2024-09-20T20:36:09.236 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24784.log 2024-09-20T20:36:09.236 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24310.log.gz 2024-09-20T20:36:09.238 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26861.log 2024-09-20T20:36:09.238 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27229.log.gz 2024-09-20T20:36:09.238 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24476.log 2024-09-20T20:36:09.238 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24784.log.gz 2024-09-20T20:36:09.238 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26861.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.25830.log -- replaced with /var/log/ceph/ceph-client.admin.26861.log.gz 2024-09-20T20:36:09.238 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-20T20:36:09.238 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23821.log 2024-09-20T20:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24476.log.gz 2024-09-20T20:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25524.log 2024-09-20T20:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25830.log.gz 2024-09-20T20:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.23821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25353.log 2024-09-20T20:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr: 33.5% -- replaced with /var/log/ceph/ceph-client.0.23821.log.gz 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27636.log 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25524.log.gz 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25353.log.gz 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26033.log 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22362.log 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27636.log.gz 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26142.log 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26033.log.gz 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22362.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22362.log.gz 2024-09-20T20:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.26832.log 2024-09-20T20:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26142.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21719.log 2024-09-20T20:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26142.log.gz 2024-09-20T20:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25208.log 2024-09-20T20:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26832.log.gz 2024-09-20T20:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.tmp-client.admin.21719.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph.tmp-client.admin.21719.log.gz -- 2024-09-20T20:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.24871.log 2024-09-20T20:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28130.log 2024-09-20T20:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25208.log.gz 2024-09-20T20:36:09.244 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T20:36:09.245 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-20T20:36:09.245 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.1117.log 2024-09-20T20:36:09.245 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.1117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.1117.log.gz 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27288.log 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24871.log.gz 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28130.log.gz 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27006.log 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27010.log 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27288.log.gz 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24581.log 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27006.log.gz 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26168.log 2024-09-20T20:36:09.254 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27010.log.gz 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23565.log 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24581.log.gz 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26168.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.26168.log.gz 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23176.log 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22812.log 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23565.log.gz 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26382.log 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23176.log.gz 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24306.log 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22812.log.gz 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23384.log 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26382.log.gz 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22574.log 2024-09-20T20:36:09.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24306.log.gz 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27527.log 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23384.log.gz 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24555.log 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22574.log.gz 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22630.log 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27527.log.gz 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25153.log 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24555.log.gz 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24192.log 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22630.log.gz 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24867.log 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25153.log.gz 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25975.log 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24192.log.gz 2024-09-20T20:36:09.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29009.log 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24867.log.gz 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26801.log 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25975.log.gz 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27584.log 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29009.log.gz 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22385.log 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26801.log.gz 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28938.log 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27584.log.gz 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28104.log 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22385.log.gz 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26705.log 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28938.log.gz 2024-09-20T20:36:09.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25102.log 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28104.log.gz 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27852.log 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26705.log.gz 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25435.log 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25102.log.gz 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22137.log 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27852.log.gz 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24104.log 2024-09-20T20:36:09.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25435.log.gz 2024-09-20T20:36:09.266 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-20T20:36:09.278 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27425.log 2024-09-20T20:36:09.278 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22137.log.gz 2024-09-20T20:36:09.278 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25322.log 2024-09-20T20:36:09.278 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24104.log.gz 2024-09-20T20:36:09.278 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26037.log 2024-09-20T20:36:09.278 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27425.log.gz 2024-09-20T20:36:09.278 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26976.log 2024-09-20T20:36:09.278 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25322.log.gz 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22656.log 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26037.log.gz 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23332.log 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26976.log.gz 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22760.log 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22656.log.gz 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23332.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23332.log.gz 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27851.log 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22760.log.gz 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24833.log 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23098.log 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27851.log.gz 2024-09-20T20:36:09.279 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25103.log 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24833.log.gz 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23098.log.gz 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28860.log 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26951.log 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25103.log.gz 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28520.log 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28860.log.gz 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24696.log 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26951.log.gz 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25073.log 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28520.log.gz 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24363.log 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24696.log.gz 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24809.log 2024-09-20T20:36:09.280 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25073.log.gz 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28676.log 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24363.log.gz 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25550.log 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24809.log.gz 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25581.log 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28676.log.gz 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22682.log 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25550.log.gz 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25581.log.gz 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24073.log 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24000.log 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22682.log.gz 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22950.log 2024-09-20T20:36:09.281 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24073.log.gz 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25885.log 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24000.log.gz 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22890.log 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22950.log.gz 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25885.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.25885.log.gz 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.29035.log 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28964.log 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22890.log.gz 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29035.log.gz 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24924.log 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26586.log 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28964.log.gz 2024-09-20T20:36:09.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24924.log.gz 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28390.log 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27714.log 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26586.log.gz 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28390.log.gz 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28702.log 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28338.log 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27714.log.gz 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28702.log.gz 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24606.log 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25679.log 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28338.log.gz 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24606.log.gz 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28494.log 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23513.log 2024-09-20T20:36:09.283 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25679.log.gz 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28494.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28494.log.gz 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28208.log 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27770.log 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23513.log.gz 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28208.log.gz 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22257.log 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25016.log 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27770.log.gz 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22257.log.gz 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27688.log 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24727.log 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25016.log.gz 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27688.log.gz 2024-09-20T20:36:09.284 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26449.log 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24161.log 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24727.log.gz 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26449.log.gz 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26351.log 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24753.log 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24161.log.gz 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26351.log.gz 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22600.log 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22864.log 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24753.log.gz 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22600.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22600.log.gz 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23969.log 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23595.log 2024-09-20T20:36:09.285 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22864.log.gz 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23969.log.gz 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23028.log 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28008.log 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23595.log.gz 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23028.log.gz 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23027.log 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25296.log 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28008.log.gz 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23027.log.gz 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28078.log 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26539.log 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25296.log.gz 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28078.log.gz 2024-09-20T20:36:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26581.log 2024-09-20T20:36:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28416.log 2024-09-20T20:36:09.287 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26539.log.gz 2024-09-20T20:36:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26581.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26581.log.gz 2024-09-20T20:36:09.287 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.26918.log 2024-09-20T20:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23631.log 2024-09-20T20:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28416.log.gz 2024-09-20T20:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26918.log.gz 2024-09-20T20:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25147.log 2024-09-20T20:36:09.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25861.log 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23631.log.gz 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25147.log.gz 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25042.log 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28546.log 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25861.log.gz 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25042.log.gz 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25467.log 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23254.log 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28546.log.gz 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25467.log.gz 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23630.log 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23102.log 2024-09-20T20:36:09.318 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23254.log.gz 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23630.log.gz 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23184.log 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26719.log 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23102.log.gz 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28156.log 0.0% 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.23184.log.gz 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26719.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26719.log.gz 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28156.log.gz 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28234.log 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24129.log 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28234.log.gz 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24218.log 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24129.log.gz 2024-09-20T20:36:09.319 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27773.log 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24218.log.gz 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22513.log 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25239.log 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27773.log.gz 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26487.log 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22513.log.gz 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27662.log 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25239.log.gz 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26218.log 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26487.log.gz 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27200.log 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27662.log.gz 2024-09-20T20:36:09.320 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24047.log 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26218.log.gz 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27200.log: 94.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25377.log 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27200.log.gz 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25804.log 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24047.log.gz 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25606.log 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25377.log.gz 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25804.log.gz 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27926.log 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.25606.log: /var/log/ceph/ceph-client.admin.22312.log 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25606.log.gz 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27926.log.gz 2024-09-20T20:36:09.321 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26194.log 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26511.log 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22312.log.gz 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27260.log 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26194.log.gz 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26511.log.gz 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26083.log 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28886.log 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27260.log.gz 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26083.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.28624.log -- replaced with /var/log/ceph/ceph-client.admin.26083.log.gz 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23306.log 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28886.log.gz 2024-09-20T20:36:09.322 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22838.log 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28624.log.gz 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23306.log.gz 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28442.log 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22838.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22838.log.gz 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28442.log.gz 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28286.log 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24419.log 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24274.log 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28286.log.gz 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24419.log.gz 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22786.log 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25769.log 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24274.log.gz 2024-09-20T20:36:09.323 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23857.log 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22786.log.gz 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25769.log.gz 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26290.log 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25918.log 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23857.log.gz 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26643.log 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26290.log.gz 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25918.log.gz 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26089.log 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24472.log 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26643.log: /var/log/ceph/ceph-client.admin.26089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26643.log.gz 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28364.log 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26089.log.gz 2024-09-20T20:36:09.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24472.log.gz 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22949.log 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27930.log 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28364.log.gz 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28260.log 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22949.log.gz 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27930.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27930.log.gz 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28260.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28260.log.gz 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26006.log 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23280.log 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23358.log 2024-09-20T20:36:09.325 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26006.log.gz 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23020.log/var/log/ceph/ceph-client.admin.23280.log: 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23280.log.gz 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23358.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23358.log.gz 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/ceph-client.admin.23410.log 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23020.log.gz 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23680.log 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23410.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23410.log.gz 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22708.log 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23680.log.gz 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27317.log 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28784.log 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22708.log.gz 2024-09-20T20:36:09.326 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27317.log.gz 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22457.log 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28572.log 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28784.log.gz 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28468.log 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22457.log.gz 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28572.log.gz 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22114.log 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22916.log 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28468.log.gz 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22114.log.gz 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26892.log 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24642.log 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22916.log.gz 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26892.log.gz 2024-09-20T20:36:09.327 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23937.log 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23436.log 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24642.log.gz 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26415.log 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23937.log.gz 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23436.log: 49.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.23436.log.gz 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27922.log 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27372.log 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26415.log.gz 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27145.log 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27922.log.gz 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27372.log.gz 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25949.log 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24955.log 2024-09-20T20:36:09.328 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27145.log.gz 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23180.log 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25949.log.gz 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24955.log.gz 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28650.log 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28000.log 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23180.log: 0.0%/var/log/ceph/ceph-client.admin.28650.log: -- replaced with /var/log/ceph/ceph-client.admin.23180.log.gz 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28650.log.gz 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27774.log 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22485.log 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28000.log.gz 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27774.log.gz 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24249.log 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.22485.log: /var/log/ceph/ceph-client.admin.27740.log 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22485.log.gz 2024-09-20T20:36:09.329 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24249.log.gz 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28728.log 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27740.log.gz 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24394.log 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22337.log 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28728.log.gz 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23888.log 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24394.log.gz 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21921.log 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22337.log.gz 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23996.log 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23888.log.gz 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.21921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23539.log 2024-09-20T20:36:09.330 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21921.log.gz 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24446.log 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23996.log.gz 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28757.log 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23539.log.gz 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28810.log 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24446.log.gz 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27090.log 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28757.log.gz 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26248.log 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28810.log.gz 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25493.log 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27090.log.gz 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27610.log 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26248.log.gz 2024-09-20T20:36:09.331 INFO:teuthology.orchestra.run.smithi070.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-20T20:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22431.log/var/log/ceph/ceph-client.admin.25493.log: 2024-09-20T20:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25493.log.gz 2024-09-20T20:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27610.log.gz 2024-09-20T20:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28182.log 2024-09-20T20:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28598.log 2024-09-20T20:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22431.log.gz 2024-09-20T20:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27844.log 2024-09-20T20:36:09.332 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28182.log.gz 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25265.log 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28598.log.gz 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22548.log 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27844.log.gz 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25716.log 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25265.log.gz 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23106.log 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22548.log.gz 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27471.log 2024-09-20T20:36:09.336 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25716.log.gz 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24985.log 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23106.log.gz 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28912.log 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27471.log.gz 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27558.log 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24985.log.gz 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28312.log 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28912.log.gz 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27170.log 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27558.log.gz 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22734.log 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28312.log.gz 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.27170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27170.log.gz 2024-09-20T20:36:09.337 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22734.log.gz 2024-09-20T20:36:09.421 INFO:teuthology.orchestra.run.smithi070.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-20T20:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-20T20:36:09.481 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22969.log 2024-09-20T20:36:09.481 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-20T20:36:09.482 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.22969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22921.log 2024-09-20T20:36:09.482 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22969.log.gz 2024-09-20T20:36:09.482 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22945.log 2024-09-20T20:36:09.483 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.22921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22921.log.gz 2024-09-20T20:36:09.483 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.22945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22945.log.gz 2024-09-20T20:36:09.552 INFO:teuthology.orchestra.run.smithi070.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-20T20:36:09.554 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-20T20:36:09.554 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m0.343s 2024-09-20T20:36:09.554 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m0.817s 2024-09-20T20:36:09.554 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.092s 2024-09-20T20:36:12.046 INFO:teuthology.orchestra.run.smithi079.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-20T20:36:12.047 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-20T20:36:12.047 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m2.822s 2024-09-20T20:36:12.047 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m2.671s 2024-09-20T20:36:12.047 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.122s 2024-09-20T20:36:13.066 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.1.log: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-20T20:36:13.068 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-20T20:36:13.068 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m3.825s 2024-09-20T20:36:13.068 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m3.697s 2024-09-20T20:36:13.069 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m0.129s 2024-09-20T20:36:14.871 INFO:teuthology.orchestra.run.smithi187.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-20T20:36:14.872 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-09-20T20:36:14.872 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m5.610s 2024-09-20T20:36:14.872 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m5.213s 2024-09-20T20:36:14.872 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m0.201s 2024-09-20T20:36:14.873 INFO:tasks.ceph:Archiving logs... 2024-09-20T20:36:14.873 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi070/log 2024-09-20T20:36:14.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T20:36:15.153 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi079/log 2024-09-20T20:36:15.154 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T20:36:15.537 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi090/log 2024-09-20T20:36:15.538 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T20:36:16.018 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi187/log 2024-09-20T20:36:16.019 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T20:36:16.717 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-20T20:36:16.726 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-20T20:36:16.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T20:36:16.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T20:36:16.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T20:36:16.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T20:36:16.852 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-20T20:36:16.866 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-20T20:36:16.866 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:36:16.869 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:36:16.872 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:36:16.875 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T20:36:16.879 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:36:16.879 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-20T20:36:16.879 INFO:teuthology.orchestra.run.smithi070.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.060 -2.138 2.027 2024-09-20T20:36:16.879 INFO:teuthology.orchestra.run.smithi070.stdout:*hv02.front.sepi 96.245.170.99 3 u 27 64 377 0.058 -1.993 2.026 2024-09-20T20:36:16.879 INFO:teuthology.orchestra.run.smithi070.stdout:+hv03.front.sepi 74.6.168.72 3 u 22 64 377 0.071 -0.381 2.048 2024-09-20T20:36:16.879 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:36:16.886 INFO:teuthology.orchestra.run.smithi090.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:36:16.886 INFO:teuthology.orchestra.run.smithi090.stdout:============================================================================== 2024-09-20T20:36:16.886 INFO:teuthology.orchestra.run.smithi090.stdout:*hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.064 -0.577 1.519 2024-09-20T20:36:16.886 INFO:teuthology.orchestra.run.smithi090.stdout:+hv02.front.sepi 96.245.170.99 3 u 27 64 377 0.067 -2.610 1.751 2024-09-20T20:36:16.886 INFO:teuthology.orchestra.run.smithi090.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.079 +1.074 1.436 2024-09-20T20:36:16.886 INFO:teuthology.orchestra.run.smithi090.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:36:16.889 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:36:16.889 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-09-20T20:36:16.889 INFO:teuthology.orchestra.run.smithi187.stdout:+hv01.front.sepi 67.205.162.81 3 u 31 64 377 0.083 -1.517 0.642 2024-09-20T20:36:16.889 INFO:teuthology.orchestra.run.smithi187.stdout:*hv02.front.sepi 96.245.170.99 3 u 31 64 377 0.091 -1.308 0.588 2024-09-20T20:36:16.889 INFO:teuthology.orchestra.run.smithi187.stdout:+hv03.front.sepi 74.6.168.72 3 u 28 64 377 0.076 +0.592 0.529 2024-09-20T20:36:16.889 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:36:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-20T20:36:16.992 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-20T20:36:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi 67.205.162.81 3 u 4 64 7 0.191 +30.243 1.530 2024-09-20T20:36:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi 96.245.170.99 3 u 2 64 7 0.099 +30.472 1.496 2024-09-20T20:36:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi 74.6.168.72 3 u - 64 7 0.172 +31.808 1.576 2024-09-20T20:36:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-20T20:36:16.993 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-20T20:36:17.003 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-20T20:36:17.003 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-20T20:36:17.011 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-20T20:36:17.020 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-20T20:36:17.028 INFO:teuthology.task.internal:Duration was 1033.549191 seconds 2024-09-20T20:36:17.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-20T20:36:17.037 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-20T20:36:17.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T20:36:17.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T20:36:17.042 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T20:36:17.044 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T20:36:17.093 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-20T20:36:17.093 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-20T20:36:17.093 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T20:36:17.129 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-09-20T20:36:17.129 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T20:36:17.139 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-09-20T20:36:17.140 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T20:36:17.150 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-09-20T20:36:17.151 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T20:36:17.162 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-20T20:36:17.163 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T20:36:17.173 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T20:36:17.183 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T20:36:17.195 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T20:36:17.261 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-20T20:36:17.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T20:36:17.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T20:36:17.265 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T20:36:17.267 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T20:36:17.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-20T20:36:17.383 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-20T20:36:17.383 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T20:36:17.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T20:36:17.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T20:36:17.426 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T20:36:17.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-20T20:36:17.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T20:36:17.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T20:36:17.455 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T20:36:17.462 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-20T20:36:17.471 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T20:36:17.479 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-09-20T20:36:17.480 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-09-20T20:36:17.492 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-09-20T20:36:17.610 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T20:36:17.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:36:17.615 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T20:36:17.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:36:17.620 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T20:36:17.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:36:17.625 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T20:36:17.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T20:36:17.657 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-20T20:36:17.673 INFO:teuthology.task.internal:Transferring archived files... 2024-09-20T20:36:17.674 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi070 2024-09-20T20:36:17.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T20:36:17.697 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi079 2024-09-20T20:36:17.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T20:36:17.717 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi090 2024-09-20T20:36:17.718 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T20:36:17.739 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-19_21:32:06-powercycle-squid-distro-default-smithi/7912567/remote/smithi187 2024-09-20T20:36:17.739 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T20:36:17.764 INFO:teuthology.task.internal:Removing archive directory... 2024-09-20T20:36:17.765 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T20:36:17.768 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T20:36:17.772 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T20:36:17.783 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T20:36:17.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-20T20:36:17.817 INFO:teuthology.task.internal:Not uploading archives. 2024-09-20T20:36:17.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-20T20:36:17.827 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-20T20:36:17.827 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T20:36:17.829 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T20:36:17.831 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T20:36:17.832 INFO:teuthology.orchestra.run.smithi070.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 20:36 /home/ubuntu/cephtest 2024-09-20T20:36:17.834 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T20:36:17.835 INFO:teuthology.orchestra.run.smithi079.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 20:36 /home/ubuntu/cephtest 2024-09-20T20:36:17.837 INFO:teuthology.orchestra.run.smithi090.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 20:36 /home/ubuntu/cephtest 2024-09-20T20:36:17.854 INFO:teuthology.orchestra.run.smithi187.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 20 20:36 /home/ubuntu/cephtest 2024-09-20T20:36:17.855 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-20T20:36:17.865 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-20T20:36:17.896 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 1033.549191236496 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-20T20:36:17.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T20:36:17.980 INFO:teuthology.run:pass